Do you think model trainers are pelicanmaxxing now?

mchinen · 2026-09-01T20:17:14

There was a real probe into this, seems like no:

https://dylancastillo.co/posts/pelicanmaxxing.html

https://news.ycombinator.com/item?id=49010129

parineum · 2026-09-02T03:56:16

I don't really see how replacing the vehicle and the animal is a good test.

It'd be better to just have it draw a completely, linguistically, unrelated scene.

Like, a single tree in a meadow bending in the wind.

y-curious · 2026-09-02T13:09:08

Then it’s not a benchmark. I think his thesis is solid: if neither pelicans nor bicycles stick out, it follows that there isn’t special attention being given to them by the labs

parineum · 2026-09-02T14:05:20

I do think that the bicycles stick out. They all look remarkably similar, aside from the DeepSeek test.

CryptoBanker · 2026-09-01T20:25:17

Feels like it's been pretty obvious that they have been for a while now