Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

ARC leaderboard has results from semi-private data for frontier models, they have another competition for private data.

It is described in their methodology: https://arcprize.org/policy

It makes sense, since once OpenAI API receive task, it is not private anymore but leaked to OpenAI.



Where are results for private data?

Which LLMs participate on private set? Open weight LLMs only?


Yes, they run competitions once a year amongst open weight models




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: