Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

For those commenting on the long reasoning, it may be interesting to know that the reasoning effort is set to xhigh by default [0]. Other possible values are medium, low and none. Flag for changing it in llama.cpp below, but note that the long reasoning seems to contribute a great deal to the quality.

  --chat-template-kwargs '{"preserve_thinking":true,"reasoning_effort":"medium"}'
[0] https://unsloth.ai/docs/models/qwen3.8#thinking--preserve-th...


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: