Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I think OpenAI has a few hidden advantages that are not obvious at this point. It could be additional training data, filtering/preprocessing that data, some changes to the architecture, who knows? None of the open source models are even close to GPT 3.5, what to speak about GPT 4? I've tried everything and the 60G llama variants so i'm not sure it's about number of parameters. They definitely have some hidden sauce.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: