AINewsnow

Backup your quants!

source: https://huggingface.co/mradermacher/model_requests I'm sure the situation is the same for other quant producers. If you have anything you want to keep, it's best to make a backup now. If you have the means to, please create torrents of them and share them here: https://llama.garden https://…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-25 12:25 · r/LocalLLaMA
    Backup your quants!

More stories

  1. GitHub - vincalkr/DS41Engine: DeepSeek-V4.1-Flash 1017 on 1x-2x RX 7900 XTX (gfx1100, ROCm/HIP): max optimizations — r/LocalLLM
  2. Qwen 3.8 Flash Next (129 GB) is better than 2.6 bpw DeepSeek V4.1 Flash 1017 (187 GB + 203 GB Engram) — r/LocalLLaMA
  3. Massive B70 spec-decoding improvement - Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp — r/LocalLLaMA
  4. Flint 40B-A2.5B - ABLITERATED! — r/huggingface
  5. Qwen3.8-27B at 262k context on a 16 GB RX 9070 on Windows: ~80 t/s with achyudh's ROCm KV-streaming fork — r/LocalLLM
  6. I ran local AI inference (AMD GPU) for 30 days and measured every watt — here's the real cost vs cloud APIs — r/LocalLLM
  7. LLM on Android Phone updates — r/LocalLLM
  8. I built an offline manga translator for Android that users local AI models — r/ClaudeAI

Get the daily brief of stories like this at 6:30 every morning →