Comment by ijidak
Isn't the NVIDIA-TSMC duopoly the problem here?
The cost of these data centers and ongoing inference is mostly the outrageous cost of GPUs, no?
I don't understand why the entire industry isn't looking to diversify the GPU constraint so that the hardware makers drop prices.
Why no industry initiative to break NVIDIA's strangehold and next TSMC's?
Or are GPUs a small line item in the outrageous spend companies like OpenAI are committing to?
Because it would take many years, and Google is using its own TPUs anyway.