I think speed is going to be important for a second reason - ever since I've started using LLM's a lot in my work I enjoy it much less. The main reason is that I ask the LLM something and have to wait because I know it's going to prompt me at random every few minutes. A lot of the day has become staring aimlessly at the screen. The prompts are too random and frequent for me to do something else in the interim. It's pretty soul destroying and this can't be how 'work' looks going forward or people are going to burn out.
This is why I switched to codex --yolo running in a container/vm. Now it does what it needs to do without bugging me and I can do other stuff. When it pings me I know there is something to review.
Yes I know they can escape containers, but that's not what I'm tasking them with.
You can easily setup codex rules to auto approve local stuff but gate external effects like push/jira write/curl - works better for me than full yolo mode - depends if it's a solo project or working with a team.