mirror of
https://github.com/FlashML-org/FreeToken.git
synced 2026-11-23 02:00:02 +08:00
The VNNI dots were compute bound per core; with fewer instructions per weight they reach the DRAM read bandwidth. The W4A8 kernel now follows FREETOKEN_CPU_MOE_ISA.