Comment by ants_everywhere
Comment by ants_everywhere 3 days ago
IO-bound doesn't mean it doesn't use much CPU. A tool can use a lot of IO and also a lot of CPU.
> then saving that tiny bit of CPU actually saved no money
this doesn't follow
> since it was already riding on the spare capacity of other investments
nor does this
Take for example a CLI that downloads and verifies the Bitcoin blockchain. It may spend most of its time downloading blocks, but it spends a ton of time calling SHA256 to verify those blocks. Similarly with a tool that downloads and checksums large files like Docker images.
If you have a fleet of 650K developer machines all running this util, then at some point it becomes cost effective to optimize the CPU usage.
Whether that point was reached in this example is not something I know. It seems like the L7 and their manager believed it was. But OP believes it wasn't. Either way, we don't know from OP's description of the situation.
Sure, something like that is technically consistent with the description, but unlikely to be relevant. If you're thinking of a program that downloads a bunch of data and then does a bunch of cryptographic operations on it, what are the odds that the first description in your mind is "spends most of its time on HTTP requests"? Slim, I'd say, even if it's technically the majority of the time.