AINewsnow

Pithos a dependency-free C inference engine for LFM2.5-24B-A2B: 1.9x llama.cpp CUDA generation on a GTX 1650 laptop

Hi all, Pithos is an inference engine for Liquid AI's LFM2 / LFM2.5 models, written from scratch in C11 with no dependencies (only Win32/POSIX). One executable gives you terminal chat, an OpenAI-compatible server, a web agent (Pandora) and a terminal agent. Why The 24B MoE model (about 2B active pe…

Read the full story at r/LocalLLM ↗

Timeline · 3 reports

  1. 2026-10-28 21:22 · r/huggingface
    Pithos a dependency-free C inference engine for LFM2.5-24B-A2B: 1.9x llama.cpp CUDA generation on a GTX 1650 laptop
  2. 2026-10-28 19:48 · r/LocalLLM
    Running a 35B model on a GTX 1650 Super using custom llama.cpp + models.ini tuning (Building an automated bare-metal provisioner)
  3. 2026-10-27 20:38 · r/LocalLLM
    Pithos a dependency-free C inference engine for LFM2.5-24B-A2B: 1.9x llama.cpp CUDA generation on a GTX 1650 laptop

More stories

  1. Janas: a C inference engine that runs MoE models bigger than your RAM by streaming experts from NVMe, plus an almost complete OpenAI-compatible server, MCP tools, vision and speech (GPL-3.0) — r/LocalLLM
  2. Gemini 4 Carbon: our next frontier model — Google Gemini Blog
  3. I dpo post-trained llama-3.1-8b to be 100% more robust against jailbreaks (and measured what it costs) — r/huggingface
  4. Arc Pro B60 on WSL2 (Vulkan via Mesa Dozen) is 8 to 40 times slower than native Windows Vulkan, and Qwen3.8-27B segfaults inside Intel's LLVM. Anyone seen this? — r/LocalLLM
  5. Amazon AWS posts 39% revenue growth as cloud rivals also accelerate — CNBC Technology
  6. Local Qwen 3.8 27B as the worker, Opus as the planner: same 38 tests passed, half the API bill — r/LocalLLM
  7. Why does my local LLM keep reverting to generic prose despite extensive author-style examples and prompt engineering? Am I overengineering this? — r/LocalLLM
  8. I tested a 12B open-source AI Humanizer locally. Here's what I found. — r/learnmachinelearning

Get the daily brief of stories like this at 6:30 every morning →