Comment by YetAnotherNick
Comment by YetAnotherNick 3 days ago
Just doesn't make sense. If you make significantly more money renting TPU, why not rent them cheaper to shift the customers(and save billions that you are giving to Nvidia). TPU right now isn't significantly more cheaper to external customer.
Again I am talking about LLM training/inference which if I were to guess is more than half of the workload currently for which the switching cost is close to 0.