They already learned. A lot or basically everything evern written and available digital.

And context window work very well. You can 'teach' an llm a new programming lanuage and other things through it.