mirror of
https://github.com/FlashML-org/FreeToken.git
synced 2026-11-21 01:52:30 +08:00
* fix(moe): skip inactive gguf routes in hybrid decode * perf(moe): run the inactive-route memset and zeroing only in hybrid decode Only hybrid decode hands the GGUF kernel -1 routes, so mul_mat_id takes an inactive flag and MMQ does the ids_src1 memset and the zeroing pass only when it is set. Prefill and fused / offload decode go back to the main-branch MMQ calls. * perf(moe): compare expert ids unsigned in mm_ids_helper A negative (inactive) id compared unsigned sorts after every expert and equals none, so the helper needs no remap to INT_MAX; the remap made nvcc unroll its token loop half as far.