Trying to scale text inference to 1 million tok/s on cheap hardware. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

pinstripes 3 months ago | parent | context | favorite | on: Ask HN: What are you working on? (June 2026)

Trying to scale text inference to 1 million tok/s on cheap hardware.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact