Commit Graph
4 Commits
Author SHA1 Message Date
Xiaoze Fan c2c3e828e8 feat(spec): verify draft tokens on the target side (#836)
* feat(spec): add the speculative verify infrastructure

* feat(scheduler): run decode steps as speculative verify steps

* chore(engine): mark the speculative decoding config fields with one comment

* feat(server): add short aliases for the speculative decoding flags
2026-10-28 21:18:02 -07:00
cherry77-cloud c8186396f5 fix(sampling): apply presence and frequency penalties (#527)
* fix(sampling): apply presence and frequency penalties

* fix(server): reject non-finite sampling penalties

* fix(server): bound presence and frequency penalties
2026-10-11 12:41:07 -07:00
cherry77-cloud cc1f5c2c91 fix(engine): preserve greedy sampling in mixed batches (#471) 2026-09-18 21:00:44 -07:00
Xiaoze FanandShuo Yang 3af9d90ee5 feat: initial open-source release
Co-authored-by: Shuo Yang <andy_yang@berkeley.edu>
2026-08-11 22:53:25 +00:00