AINewsnow

Fork of FreeToken with DeepSeek-V4.1, vision and speculative decoding (2x3090 numbers inside)

I've been running FreeToken on my 2x3090 box for a while and ended up maintaining a fork of it. Posting it in case it's useful to anyone else here. Quick context if you haven't used it: FreeToken is an edge-native MoE serving engine. It offloads experts to host RAM/NVMe and co-executes on CPU+GPU s…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-22 12:29 · r/LocalLLaMA
    Fork of FreeToken with DeepSeek-V4.1, vision and speculative decoding (2x3090 numbers inside)

More stories

  1. Anthropic CEO Dario Amodei to Brief UN Security Council on AI — Bloomberg AI
  2. Has anyone actually replaced Claude with DeepSeek V4.1 Flash/Pro for tool-heavy daily work? — r/ClaudeAI
  3. XiaomiMiMo/MiMo-V2.6-Pro-RL · Hugging Face — r/LocalLLaMA
  4. Sources: the Cyberspace Administration of China is investigating DeepSeek and Moonshot over alleged data leaks to Anthropic via Claude and has questioned staff (The Information) — Techmeme
  5. Xiaomi's MiMo-V2.6-Pro Tops Open-Weight Rankings With a 1T-Parameter Model — AlphaSignal
  6. Model grafting: turning Qwen3.5-4B into a causal encoder-decoder after the fact — r/LocalLLaMA
  7. Jev's calibration was measured. The LLMs won [D] — r/MachineLearning
  8. DeepSeek's Liang: Next Models Must Train on Huawei and Domestic Chips — Pandaily

Get the daily brief of stories like this at 6:30 every morning →