I'm running qwen 3.6 27b at 8bit quantization and 262k context. It takes 53gb of... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

barbacoa 76 days ago | parent | context | favorite | on: Qwen 3.6 27B is the sweet spot for local developme...

I'm running qwen 3.6 27b at 8bit quantization and 262k context. It takes 53gb of vram on my system.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact