AINewsnow

LFM3-1.7b seems impressive

Been testing Liquid's LFM3-1.7B (Q8_0 GGUF, llama.cpp, ROCm) as a candidate for compression and summarization work 4.1k t/s prefill and ~78 t/s decode on a Strix Halo iGPU ~7.1k / ~151 if you tensor-split it across a 7900 XTX + XT its way more coherent at decent sized prompts (32k-64k) then 1.7b de…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-01 15:38 · r/LocalLLaMA
    LFM3-1.7b seems impressive

More stories

  1. 769 tok/s on a Single RTX 4090: Spark-X2.6-1.7B DSpark — DEV Community — Machine Learning
  2. Halving the KV Cache Doubles Capacity and Buys 1% of Speed — DEV Community — Machine Learning
  3. How we fit a 27B model on a 12 GB laptop GPU — DEV Community — Machine Learning
  4. Run a 35B to 180B LLM Without a GPU: VIDRAFT POCKET Passes 3.15 Million Downloads — DEV Community — Machine Learning
  5. How to Run LFM3-Omni-2B GGUF Locally (Only llama.cpp Makes It Talk Back) — DEV Community — Machine Learning
  6. A game scripting language that runs speech-to-text 5x faster than llama.cpp on CPU — Lobsters AI
  7. I wrote a Rust inference engine for Qwen models on a 12 GB GPU, decode is ~1.7x llama.cpp on my RTX3060 — r/LocalLLM
  8. A 2.6B model on an iPhone that always answers in valid JSON — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →