Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Each cartridge costs $1,000. Do you still want it?


For fast Kimi K3? You're damn right I do


$1,000 only gets you the Qwen 27B cartridge. For Kimi K3 it would be more like $100,000 (and the "cartridge" is the size of a refrigerator).


I would gladly pay $100,000 for local K3 running at 18,000 tok/sec.


Some hurried goalpost-moving there! If we take Qwen 27B as the benchmark of equivalent power (rather than its default configuration with no fine-tuning), I can still think of applications. Auto summarization for legal document databases and other high security/offline contexts, contraband detection, moderating websites like HN etc :)


Me? Probably not. A business or a hoster, sure. There'd probably end up being an aftermarket in used cartridges with slightly older but still good models on them.


Yeah. I have 3 max20 plans.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: