AINewsnow

Running a 35B model on a GTX 1650 Super using custom llama.cpp + models.ini tuning (Building an automated bare-metal provisioner)

Coverage of "Running a 35B model on a GTX 1650 Super using custom llama.cpp + models.ini tuning (Building an automated bare-metal provisioner)" from 2 sources, with a live timeline of who reported what and when.

Read the full story at r/LocalLLM ↗

Timeline · 2 reports

  1. 2026-10-28 21:22 · r/huggingface
    Pithos a dependency-free C inference engine for LFM2.5-24B-A2B: 1.9x llama.cpp CUDA generation on a GTX 1650 laptop
  2. 2026-10-28 19:48 · r/LocalLLM
    Running a 35B model on a GTX 1650 Super using custom llama.cpp + models.ini tuning (Building an automated bare-metal provisioner)

More stories

  1. I dpo post-trained llama-3.1-8b to be 100% more robust against jailbreaks (and measured what it costs) — r/huggingface
  2. PSA: Upgrade Flash Next to DFlash2 if you haven't! +17% on average — r/LocalLLaMA
  3. Janas: a C inference engine that runs MoE models bigger than your RAM by streaming experts from NVMe, plus an almost complete OpenAI-compatible server, MCP tools, vision and speech (GPL-3.0) — r/LocalLLM
  4. I spent a year making old Tesla P100/V100 cards fast for local LLMs. PXA 4.0 is out today: up to 3x the decode and 8x the prompt speed of mainline llama.cpp on the same box, same files. Numbers, method and the losses inside. — r/LocalLLM
  5. Arc Pro B60 on WSL2 (Vulkan via Mesa Dozen) is 8 to 40 times slower than native Windows Vulkan, and Qwen3.8-27B segfaults inside Intel's LLVM. Anyone seen this? — r/LocalLLM
  6. Why does my local LLM keep reverting to generic prose despite extensive author-style examples and prompt engineering? Am I overengineering this? — r/LocalLLM
  7. Which coding agent gets the most out of a local Qwen 3.8 27B? I lined up 10 and logged tokens, cache and sandbox blocks — r/AI_Agents
  8. I tested a 12B open-source AI Humanizer locally. Here's what I found. — r/learnmachinelearning

Get the daily brief of stories like this at 6:30 every morning →