mirror of
https://github.com/FlashML-org/FreeToken.git
synced 2026-11-21 01:52:30 +08:00
The VNNI dots were compute bound per core; with fewer instructions per weight they reach the DRAM read bandwidth. The W4A8 kernel now follows FREETOKEN_CPU_MOE_ISA.