AINewsnow

Run an LLM in the browser: WebGPU did 63 tokens/s, WASM did 1.6

This story is from 2026-10-17. It is preserved in the archive; the latest stories are on the live feed.

Originally published at tensorust.com . TL;DR: You can run a small language model entirely inside a web page with Transformers.js , a module Web Worker and WebGPU. We do it in BEINGS, a chatroom where each person's AI creatures think on that person's own laptop, so the platform pays $0 for inferenc…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-17 06:43 · DEV Community — AI
    Run an LLM in the browser: WebGPU did 63 tokens/s, WASM did 1.6

More stories

  1. Meta releases Muse Spark Open, an 816B-parameter open-weight AI model — AWS Machine Learning Blog
  2. NVIDIA RTX Spark Laptops Launch Globally With AI Agent Support — NVIDIA Blog
  3. Scarlet and Reach Security each raise $50M Series B for AI expansion — Techmeme
  4. Anthropic pitches AI safety bill to limit government model blocks — Politico Technology
  5. Google releases Gemini 4 Argon to Pro subscribers amid usage limit complaints — InfoWorld AI
  6. Replit CEO Says Company No Longer Works With Anthropic — TechCrunch AI
  7. Community debates Qwen Flash Next performance and quantization options — r/LocalLLaMA
  8. Anthropic offers Blackstone double-digit yield in $60B chip financing deal — Financial Times AI

Get the daily brief of stories like this at 6:30 every morning →