> tends to get better results than Fable with less need for extreme token burning shenanigans like 18 hours of subagents.
The strength here was less the code quality and rather the long horizon task tracking.
This was a very large task - I was chatting with the maintainers and we estimated 4 to 6 months work over multiple phases for human coding.
Fable is able to handle that long goal, with incremental steps along the way, handle the verification and course correct when it finds a problem.
I think the larger context helps here some, but the strength of the model on this specific thing is notably better.
I'm not alone in noticing this. https://www.primeintellect.ai/research/nanogpt-speedrun shows Fable is able to manage a run nearly 1/3 longer than Sol (8.7 days vs 6.1 days). In my use cases Sol is much closer to Opus 5 though.
This is very true, especially vs Opus 5.
> tends to get better results than Fable with less need for extreme token burning shenanigans like 18 hours of subagents.
The strength here was less the code quality and rather the long horizon task tracking.
This was a very large task - I was chatting with the maintainers and we estimated 4 to 6 months work over multiple phases for human coding.
Fable is able to handle that long goal, with incremental steps along the way, handle the verification and course correct when it finds a problem.
I think the larger context helps here some, but the strength of the model on this specific thing is notably better.
I'm not alone in noticing this. https://www.primeintellect.ai/research/nanogpt-speedrun shows Fable is able to manage a run nearly 1/3 longer than Sol (8.7 days vs 6.1 days). In my use cases Sol is much closer to Opus 5 though.