AINewsnow

A 120B Model Ran About 4x Faster Than a 27B One: 8 Local LLMs on a Surface Laptop Ultra

Same llama.cpp build, same commands, one Surface Laptop Ultra (Windows on Arm, RTX Spark): generation speed lined up by active parameters, not total size, and the fastest model couldn't fix a one-character config error. This is an English adaptation of an article I originally published in Japanese…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-11-14 00:28 · DEV Community — AI
    A 120B Model Ran About 4x Faster Than a 27B One: 8 Local LLMs on a Surface Laptop Ultra

More stories

  1. Bengali costs 6.3x the tokens English does — I counted — DEV Community — AI
  2. llama.cpp ships v1.0.0 and promises API breaks only in majors — DEV Community — AI
  3. ggml v1.0.0: What the New Stable API Means for Local ML Developers — DEV Community — Machine Learning
  4. Clover-35B-A3B on llama.cpp: what "AR mode only" means, and a GGUF that answers in Gs — DEV Community — AI
  5. RTX 5090 32GB + 64GB RAM — What local LLM would should I run? — r/LocalLLM
  6. DeepSeek API Expansions, Local 284B MoE Runs, and New Developer Tooling — DEV Community — Machine Learning
  7. Can First-Person Word Frequency Track Models’ Stance Maintenance Under Pressure? — DEV Community — AI
  8. MACaQ 🐒: Open-source quantizer with a "refinement" mode for existing GGUFs + custom llama.cpp & vLLM kernels — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →