AINewsnow

[Discussion] A 5KB pure x86-64 assembly engine for Gemma-2B (FP16, 4.6 tok/s on CPU)

Hi everyone, Sharing a personal project exploring the minimal bare-metal footprint required to run an autoregressive LLM. Instead of relying on large runtimes or compiler abstractions, I wrote an inference engine for Gemma-2B entirely in flat x86-64 assembly (FASM): - **Binary footprint**: Total 5.…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-04 03:48 · r/LocalLLaMA
    [Discussion] A 5KB pure x86-64 assembly engine for Gemma-2B (FP16, 4.6 tok/s on CPU)

More stories

  1. NVIDIA DGX Spark 64GB Gives Developers More Ways to Build and Scale Local AI — NVIDIA Blog
  2. Guided Vision in Gemini Live: built for accessibility — Google Gemini Blog
  3. Google tests its plan for AI data centers in space with Project Suncatcher — Scientific American
  4. OpenAI DevDay 2026 Keynote (FULL) — OpenAI YouTube
  5. A model guide for the GPT-6 family — OpenAI News
  6. The latest AI news we announced in September 2026 — Google AI Blog
  7. Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs — Allen Institute for AI (Ai2)
  8. OpenAI Fires Researchers for Allegedly Sharing Information with AI Safety Group — Wall Street Journal Technology

Get the daily brief of stories like this at 6:30 every morning →