Comment by joshdavham

> Theoretically its preferred way of talking is would be the average of all the training data

This is incorrect. Furthermore, what the LLM says is also determined by what its user wants it to say, and how frequently the user wants the LLM to post on the internet. This will have a large effect on the internet’s word frequency distribution.