Comment by cycomanic

I was posting this the other day. I find that all llms no matter their benchmark scores make enough mistakes that I always have to check their work, so pretty much any chat with an llm ends up like this: Me: question... Llm: certainly the answer is... Me: that answer can't be correct because of some test case... Llm: Certainly, my previous answer was obviously incorrect (if it was obviously wrong why give it to me?), here is the correct solution

The same pattern continues for a couple of iterations until I get the correct solution.

The problem is, the llm responses are so slow that I could just work out the problem myself in the time (I typically ask questions that I know I can solve, it just takes too much time at the moment, e.g. Just yesterday I asked a question about some interlocked indeces, which I was to lazy to work out myself at the time).

Instead of the llms with increasing benchmark scores I want an llm that is of similar level to the current ones, but answers instantaneously so I can iterate quickly.