What are you doing where you're getting Sol on XHigh or Max to run out on the $200 plan? Last night, I had 48% of my weekly limit left, so I spun up 4 projects I had been working on and ran them all on Ultra with Fast mode and /goal, and it took over 4 hours to burn through that. I mean, I was reeeeally trying to use it up because I just can't use it up with normal usage for weekend and after-work programming. I've had Max crunching on something this morning for 3 hours now and I've only used 4% of my weekly limit ...
> What are you doing where you're getting Sol on XHigh or Max to run out on the $200 plan?
Real work. $200 looks good on the outside until the essence of it, e.g. the models lie. I gave a list of spec to Sol and Sol decided some items didn't need to be done and the reason was "unproven", "not enough evidence", etc.
They all come up with amazing ways to lie (or be lazy). Often times what you get isn't what you asked for (only on the surface). E.g. I ran it to iteratively bench and optimize a better data structure for the project. It spent hours and finally came up with something. When I check it out -- it benchmarked the wrong criteria and was way off. So here we go again. Most AI work looks good on the surface. There are infinite edge cases.
So to do real work and gate it you need to:
1. Plan
2. Get it to do the work
3. Get independent agents to check from different angles
4. Take that feedback and get it to fix those gaps
5. Match against the plan and redo parts if needed
Every task is easily 4-5x the estimated amount of tokens.
p.s. well I did burn some banked resets building a compiler for some language AND it is still NOT done. Every time it says done I say check it says ok we still have bugs...
