Comment by eru

Comment by eru a day ago

3 replies

Yes. Though we don't know for sure whether that's because they actually have lower costs, or whether it's just the Chinese taxpayer being forced to serve us a treat.

chronogram a day ago

Third party providers are still cheap though. The closed models are the ones where you can't see the real cost to running them.

  • eru a day ago

    Oh, I was mostly talking about the Chinese taxpayer footing the training bill.

    You are right that we can directly observe the cost of inference for open models.

    • rescbr a day ago

      Not sure the Chinese taxpayer is footing the bill though - of course, it might not be net zero, there might be secondary effects, etc.

      A few days ago I read an article saying the Chinese utilities have a pricing structure that favors high-tech industries (say, an AI data center), making the difference by charging more the energy-intensive but less sophisticated industries (an aluminium smelter, for example).

      Admittedly, there are some advantages when you do central and long-term economic planning.