Comment by dan-robertson
Comment by dan-robertson 17 hours ago
For inference you don’t need gpus to be clustered together as much (generally training has lots of synchronisation steps so you can be bottlenecked on that instead of ‘real’ work) as they can handle separate tasks in parallel. But maybe other economies of scale still make you want to put them together (and therefore on average further from the power).
I guess there was a bit of thought about transmission with the reference to high voltages. Another interesting thing: batteries allow you to reduce the needed capacity for transmission lines – if you have batteries near generation and then transmit power at a lower maximum, same average rate than if you only have batteries near use, you can more efficiently use the available transmission.
I guess the main reason for gas to be a problem is if you can’t get new generation (eg lack of turbines).