jmuncor 4 days ago

That is exactly the idea, later we can actually tap into the middle and optimize how the context is actually being used. Feels like the current anthropic tools like compact don't do a great job at it.

teodorasgenova 4 days ago

Curious - what pushed you toward a proxy vs adding observability/instrumentation in the code?