6 Commits
Author SHA1 Message Date
Mukkesh Ganesh f69d50686d feat(server): report timings on every streamed chunk when requested (#887) 2026-11-09 21:44:40 -08:00
Xiaoze Fan 4503c424ee feat(server): add continuous_usage_stats and count shell tok/s from it (#868)
* feat(server): report running usage on stream chunks with continuous_usage_stats

* fix(shell): count tokens instead of stream chunks in the live tok/s

* refactor(server): build both openai stream usages from GenUsage

* fix(shell): reset the first-delta count per turn and ignore zero running totals
2026-11-04 22:58:51 -08:00
cherry77-cloud c8186396f5 fix(sampling): apply presence and frequency penalties (#527)
* fix(sampling): apply presence and frequency penalties

* fix(server): reject non-finite sampling penalties

* fix(server): bound presence and frequency penalties
2026-10-11 12:41:07 -07:00
Xiaoze Fan d7cd6ed88b [Feature] unify reasoning effort on one shared scale (#5)
* feat(server): accept every reasoning-effort dialect

* refactor(server): derive thinking gears from the checkpoint, not a registry
2026-08-15 23:40:52 -07:00
Xiaoze Fan 4f510f1ba6 feat(server): enable reasoning_effort on /v1/chat/completions (#2)
* feat(server): enable reasoning_effort on /v1/chat/completions

* fix(server): glm thinking-off mislabeling and reasoning_effort mapping edge cases
2026-08-14 00:02:32 -07:00
Xiaoze FanandShuo Yang 3af9d90ee5 feat: initial open-source release
Co-authored-by: Shuo Yang <andy_yang@berkeley.edu>
2026-08-11 22:53:25 +00:00