Comment by quadrature
Comment by quadrature 3 days ago
LLMs sample the next token from a conditional probability distribution, the hope is that dumb sequences are less probable but they will just happen naturally.
Comment by quadrature 3 days ago
LLMs sample the next token from a conditional probability distribution, the hope is that dumb sequences are less probable but they will just happen naturally.
It's more like the choice between "the" and "a" than "yes" and "no".
Funny how those probabilities consistently at 2pm UK time when all the Americans come online...