Comment by fooey
I wish I saw more people realizing the build out promising being made by the big AI are physically impossible
not only is it impossible to build that much power generation on those timelines
it's also not possible to build enough GPUs to fill a purported tripling of US datacenter capacity
what's the ROI on giant empty warehouses full of empty server racks and no electricity?
That's why its increasingly more important to find answers how to build these models that work sustainably. The approach of training with HUGE amount of data requiring HUGE infra seems to have blinded the hype-bros that they are not planning to innovate to do it in a small-scale.