AINewsnow

How to Run LFM3-Omni-2B GGUF Locally (Only llama.cpp Makes It Talk Back)

LFM3-Omni-2B is Liquid AI's new 2B model that takes text, images, video and audio in and answers in text or 24 kHz speech. The Q4_K_M GGUF is 1.1 GB, plus a 292 MB mmproj file, and llama.cpp v0.8.0 runs all of it, voice output included. Ollama and LM Studio load it too, but neither of them makes it…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-31 20:20 · DEV Community — Machine Learning
    How to Run LFM3-Omni-2B GGUF Locally (Only llama.cpp Makes It Talk Back)

More stories

  1. A game scripting language that runs speech-to-text 5x faster than llama.cpp on CPU — Lobsters AI
  2. A 2.6B model on an iPhone that always answers in valid JSON — DEV Community — Machine Learning
  3. NVIDIA RTX Spark: Grace CPU and Blackwell GPU on one package, up to 128GB shared memory — r/ArtificialInteligence
  4. Spark-X2.6-4B DSpark Is Here: More Than 2x Average BF16 Inference Speed — DEV Community — Machine Learning
  5. Which coding agent gets the most out of a local Qwen 3.8 27B? I lined up 10 and logged tokens, cache and sandbox blocks — r/AI_Agents
  6. I dpo post-trained llama-3.1-8b to be 100% more robust against jailbreaks (and measured what it costs) — r/huggingface
  7. Run TeleAI's Xing4.0-29B-A4B GGUF via ik_llama.cpp — Full native mHC/MLA runtime + HF converter — r/LocalLLM
  8. PSA: Upgrade Flash Next to DFlash2 if you haven't! +17% on average — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →