AINewsnow

4B model, 6 GB laptop GPU, 32M tokens of context. Fully local.

We built VLS, a local LLM app: any GGUF model, OpenAI API + MCP, Windows and Linux. 8K window, no vector DB, no embeddings. Median answer at 32M tokens: 653 ms. RULER numbers and the full report are in the repo. It's a preview, so expect bugs: https://github.com/Veloresearch/velocity-local-services…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-12 15:17 · r/LocalLLM
    4B model, 6 GB laptop GPU, 32M tokens of context. Fully local.

More stories

  1. Meta releases Muse Wonder models, claiming parity with top AI competitors — Meta Newsroom
  2. AWS enables global cross-Region inference for OpenAI GPT models on Bedrock — AWS Machine Learning Blog
  3. Meta launches new AI models Muse Wonder and Wonder Full — Business Insider AI
  4. Meta Unveils New Advanced AI Models to Rival Anthropic and OpenAI — New York Times AI
  5. OpenAI Releases Guide on Reviewing Code with Codex Before Merge — OpenAI YouTube
  6. OpenAI introduces dot setup feature for ChatGPT mobile app — OpenAI YouTube
  7. OpenAI launches initiative to build Codex developer community — OpenAI YouTube
  8. Sophos reduces threat response time by 96% using OpenAI Daybreak — OpenAI YouTube

Get the daily brief of stories like this at 6:30 every morning →