3 Commits
Author SHA1 Message Date
Xiaoze Fan 3381b6eb0a feat(gguf): run experts whose gate_up and down mix float and quantized types (#702)
* feat(gguf): run experts whose gate_up and down mix float and quantized types

* fix(kernel): map an fp32 compute type to tl.float32 in fused_moe_kernel_triton

* fix(gguf): write float expert GEMM output in the activation dtype
2026-10-15 23:20:12 -07:00
Xiaoze Fan 2d8b9cc1ea perf(kernel): avoid the activation layout conversion in fp8 moe decode and read mxfp4 gemv weights as column pairs (#653) 2026-10-09 00:15:07 -07:00
Xiaoze FanandShuo Yang 3af9d90ee5 feat: initial open-source release
Co-authored-by: Shuo Yang <andy_yang@berkeley.edu>
2026-08-11 22:53:25 +00:00