mirror of
https://github.com/FlashML-org/FreeToken.git
synced 2026-11-21 01:52:30 +08:00
* feat(cpu-moe): serve GGUF experts on the cpu and hybrid backends through ggml-cpu * feat(cpu-moe): run float GGUF expert rows on the cpu through ggml-cpu's vec_dot * feat(cpu-moe): build ggml-cpu for each llama.cpp x86 variant and run the best one the CPU supports