> my last big task was 100% Codex using Sol max (re-sizing my AWS infrastructure using CDK)
Fwiw, you could do this with any small or medium model, and it's easier with the aws-docs mcp. AWS is pretty stable, well documented, and programmatic, so most AI can figure out what it needs pretty quick
I'm not claiming an eval on what is or isn't possible. Rather I am stating my satisfaction with what I actually used and the actual result I obtained.
What I can say is that over the course of ~1 week I was able to review, plan, implement, test and release a significant change to a production system using Code Sol max. Any other claim about how any other model might have completed the same task is outside of my experience.
Fwiw, you could do this with any small or medium model, and it's easier with the aws-docs mcp. AWS is pretty stable, well documented, and programmatic, so most AI can figure out what it needs pretty quick