Comment by pjm331 Comment by pjm331 12 hours ago 0 replies Copy Link View on Hacker News You are maybe confusing caching and context windows. Caching is mainly about keeping inference costs down