Comment by mystraline

> You can crank the crank on an LLM 10^20 times and it will still get smarter.

No, it won't.

Training/learning is separate from the execution of the model. Takes megadollars to train and kilodollars to effectively run.

Its basically a really complicated PID loop. You can test and 'learn' the 3 neuron function, and then you can put it into execution. Can't do both.

Sure, theres context length and fine tuning to slightly alter a model.

But theres no adaptive, self-growing LLM. Probably won't be for a long time.