Comment by d--b

Yeah, but people here also know that AI that doesn’t use vast amounts of energy is generally returning mediocre results. And mediocre results are not useful at all. So whatever you save on energy doesn’t really matter if the utility is going to zero.

Your comparison to cars is good. A cheap car will be slower and less comfortable but will get you where you want to be ultimately. That’s the core value of the car. A bad LLM may not get you anywhere. It’s more like having a cheap powerdrill that can drill through plaster but not through concrete, in the end you still want the expensive drill…