Comment by hodgehog11
Comment by hodgehog11 a day ago
Wow, that was fast.
I've thought for a while that ensembling approaches would become the next stage of LLM development after CoT, since it provides yet another effective, independent axis for scaling laws. Great to see that perspective is taking off. The open weight community has an opportunity to take these ideas and run with them better than OpenAI has.
Yet a context hell comes with that