Is it possible to do further training on the weights they release? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

bilsbie on July 14, 2023 | parent | context | favorite | on: Meta to release open-source commercial AI model

Is it possible to do further training on the weights they release?

brucethemoose2 on July 14, 2023 [–]

Yes, and there are a sea of finetunes. See: https://huggingface.co/models?sort=modified&search=Ggml

QLORA is the most cost effective method so far. Some people also do finetuning on Google TPUs

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact