Comment by rglullis
It's not the open models that suck, it's the infrastructure around them. None of current "open weights providers" have:
- good tools for agentic workflows
- no tools for context management
- infrastructure for input token caching
Why would the open weights providers need their own tools for agentic workflows when you can just plug their OpenAI-compatible API URL into existing tools?
Also, there are many providers of open source models with caching (Moonshot AI, Groq, DeepSeek, FireWorks AI, MiniMax): https://openrouter.ai/docs/guides/best-practices/prompt-cach...