Comment by busterarm
Exactly this.
We have to use cloud because we're at the low end of 10^5 servers. Once you hit the high end of 10^3 this is really where you need to be.
Everything we're doing is highly inefficient because of decades of fast and loose development by immature software engineers...and having components in the stack that did the same.
If I had 5 years to rewrite and redesign the product to reflect today's computing reality, I could eliminate 90%+ of the cost. But I'll never get that kind of time. Not with 1000 more engineers and 1000 more years and the most willing customers.
You might get lucky enough that you and a bunch of your customers are so fed up with your company that you get to create the competition.
You have over a 100,000 servers? How is this? This is wild to ponder. I can only guess your monthly bill is in the millions. Are you able to say the company?