Comment by BeetleB
It will tell you how much each request cost you as well as a running total.
You your /tokens to see how many tokens it has in its context for the next request. You manage it by dropping files and clearing the context.
It will tell you how much each request cost you as well as a running total.
You your /tokens to see how many tokens it has in its context for the next request. You manage it by dropping files and clearing the context.