Comment by Andrex
It feels like (to me) that Google's TPU advantage (speculation is Meta is buying a bunch) will be one of the last things to be commoditized, which gives them a larger moat. Normal chips are hard enough to come by for this stuff.
It feels like (to me) that Google's TPU advantage (speculation is Meta is buying a bunch) will be one of the last things to be commoditized, which gives them a larger moat. Normal chips are hard enough to come by for this stuff.
That will be less of a problem since OAI can spill out to other providers as needed if their own capacity is under high utilization. They already use coreweave, aws, azure, etc. Google doesn't do that as far as I know and don't see why they would, so they are stuck eating the capacity planning.
Also, they have all the infra to actually use all that tpus advantage (as well as actual researchers, contrariwise to OpenAI)