mirror of
https://github.com/FlashML-org/FreeToken.git
synced 2026-11-22 04:15:36 +08:00
The VNNI dots were compute bound per core; with fewer instructions per weight they reach the DRAM read bandwidth. The W4A8 kernel now follows FREETOKEN_CPU_MOE_ISA.