I have been playing around with ways to save token costs. The first way is to use caveman to truncate output tokens, compress tokens with Caveman compress, and compress the input with headroom
1 Like
I have been playing around with ways to save token costs. The first way is to use caveman to truncate output tokens, compress tokens with Caveman compress, and compress the input with headroom