Caching makes a huge difference to cost. On Fireworks AI, for example, if it hits the cache, you pay only 20%. And uncached is just $0.14/M tokens for DSV4-0731! I get entire re-architecture projects (with new tests and documentation) done for mere dollars. DSV4-0731 is a daily driver for me.
But note that you have to use Cline (or other harness) if using vscode. I was shocked at how poor the recent versions of GitHub Copilot are at using the cache (with Fireworks AI, but I believe it's a more generic problem).
But note that you have to use Cline (or other harness) if using vscode. I was shocked at how poor the recent versions of GitHub Copilot are at using the cache (with Fireworks AI, but I believe it's a more generic problem).
https://x.com/vijucat/status/2085415745144672492?s=20