Files
FreeToken/python
Xiaoze Fanandandy-yang-1 cee23bf44a fix(runtime): correct overlap token limits and cache safety (#546)
* fix(scheduler): count delivered tokens under overlap

* fix(moe): initialize slots used by inactive hybrid routes

* fix(kvcache): report usable window capacity floors

* refactor(moe): inline the zeroed slot cache allocation

* test: drop the new regression tests

---------

Co-authored-by: andy-yang-1 <andy_yang@berkeley.edu>
2026-09-23 22:22:48 -07:00
..