Comment by az226

The bitter lesson is all about more data/compute. Doesn’t matter if it costs more because it’s not as efficient, the scale is what matters at the end of the day. Sure you’d reach farther with both scale and optimization, but raw scale still takes the cake.