Comment by encyclopedism

This is a poor take on what LLM's actually are. They don't understand in any real sense.

If you had enough paper and ink and the patience to go through it all you could take all the training data and manually step through and train the same model. Then once you have trained the model you could use more pen and paper to step through the correct prompts to arrive at the answer. All of this would be a completely mechanical process.