Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Start with a quant, you can run the Qwen 27B model at 4-bit on one 3090, presumably 6/8-bit on 2x3090.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: