You probably can't build such a model without unlimited access to YouTube and Google has been tightening the screws on that over the years pretty systematically.
to be fair, all it's doing is sampling the frames and maybe doing transcription, if I'm not mistaken. So you can do it with the other models too, you just need to sample the frames yourself and do the transcript yourself
it does this at a variable rate of frames which you can set - not sure if it is transcribing or natively understanding audio, but I think it's the latter since it is much faster than most transcription models I am aware of
Regardless you are right - I can roll my own.... but why
Yes, was going to say I use it exclusively for video and audio. The ability to give it a YouTube link through the API and ask questions about it is awesome
I've built some tools using AI. A custom GUI that has "copy context" and "copy image" buttons, to make prompting easy, and the camera position is persisted to disk on each change so that the agent can run a command to get a screenshot of it.
I'm thinking about inlining an AI chat window directly - I guess I might fire off a prompt to do that right now.
Personally both, i use openscad with opencode, and paste images but it is pretty often the modell decides by itself it wants to see a render and uses the render shell commands to get a image to look at.
