mirror of
https://github.com/FlashML-org/FreeToken.git
synced 2026-11-22 07:03:05 +08:00
Serve the HF safetensors and GGUF files. The decoder gains per-layer inputs, KV-shared layers and E2B's double-wide MLP. - --embed-weights host moves the per-layer table to pinned host RAM, which fits these models on an 8 GB GPU. - The vision tower does not implement clipped linears, so these checkpoints serve text only. - Each KV-shared layer still stores its own KV copy.