Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If you are working in a company and using language models, it is a very good idea to hold a bunch of evals you can trust and use to validate new models. Calibrate every once in a while with prod data. We have our own and the only numbers on quality and cost I trust come from this setup.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: