Comment by kgeist

Comment by kgeist 19 hours ago

0 replies

Early LLMs used to have this often. I think's that where the "repetition penalty" parameter comes from. I suspect output quality can be improved with better sampling parameters.