Comment by bambax
> The best thing for consumers would be if all these model providers strictly provided usage-based API pricing
Using openrouter myself I find the costs of APIs to be extremely low and affordable? I don't send the whole codebase to every question, I just ask about what I need, and everything is actually ridiculously cheap? $20 lasts about 3 months.
I tried to plug CC on my OpenRouter account, and just asking it what my project was doing (a directory containing three .sh of around 100 LOC each), I saw like 20 API requests to OpenRouter accounting for almost $1 in total.
Meanwhile copy/pasting those shells in OpenRouter's Chat and asking the same question resulted in a single API request costing a tenth of a cent.
I could probably try tuning everything to keep costs down, but idk if it's worth the efforts.