AINewsnow

I wrote an LLM server for Macs in C++/Metal (no Python). 2x mlx-lm with 8 users on Qwen3.8-27B, Flash-Next 125B on a 64 GB MacBook

I've been building this for a while and 0.1.2 is out today: Espetero, an inference server for Apple silicon written from scratch in C++20 and Metal. It loads your existing MLX and GGUF files (or pulls them from HF) and speaks OpenAI, Anthropic and Ollama APIs, so Claude Code and the usual clients j…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-29 01:09 · r/LocalLLM
    I wrote an LLM server for Macs in C++/Metal (no Python). 2x mlx-lm with 8 users on Qwen3.8-27B, Flash-Next 125B on a 64 GB MacBook

More stories

  1. DailyAI Briefing: AI breaks a computing rule, plus 4 more — DailyAI
  2. 8 examples of Gemini 4 Argon in action — Google Gemini Blog
  3. Anthropic reveals plans for blockbuster IPO — Sky News Technology
  4. As AI agents reshape the web, Google opens Gemini and Search to more apps — TechCrunch AI
  5. People are using AI to make expensive computer programs free. This could change everything — The Conversation AI (US)
  6. Frontier AI labs say their models refuted the Exponential Time Hypothesis. What does that mean? — TechCrunch AI
  7. I tested LFM2.5-24B-A2B vs Qwen3.6-35B-A3B on 75 fresh multi-step tool tasks. Qwen solved 91%, LFM2.5 49%, and LFM2.5 said "done" on most of its failures — r/LocalLLM
  8. What do you use to draft and refine your prompts for Claude? — r/ClaudeAI

Get the daily brief of stories like this at 6:30 every morning →