AINewsnow

Probably old news, but any website you have open can reach your local LLM server while you browse

Maybe this is obvious to everyone but me, but it only clicked yesterday. If you run llama.cpp / vLLM / or whatever on localhost with the default config, a random website you have open in another tab can send requests to it. It can make your model generate, and on some servers it can read the answer…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-08 12:00 · r/LocalLLM
    Probably old news, but any website you have open can reach your local LLM server while you browse

More stories

  1. The Open-Source Paradox: Giving Away AI Makes It Safer (and More Dangerous) — DEV Community — AI
  2. Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU — Hacker News Front Page
  3. CyberTiel35BA3B working on Blender Rigging via MCP. 8GB VRAM, 16GB RAM. llama.cpp. — r/LocalLLaMA
  4. Zero-Downtime LLM Inference on Kubernetes Spot Instances (~70% GPU Cost Savings) — DEV Community — Machine Learning
  5. The inference engine flood.. but where's the quality? — r/LocalLLM
  6. moe-cache : LRFU/MQ-like hybrid cache, ClassLRU by sanmai · Pull Request #31233 · ggml-org/llama.cpp — r/LocalLLaMA
  7. Opus 5.5 wrote its own quantiser for Qwen3.5-0.8B, no llama-quantize, no imatrix. 5.9× better than Unsloth's same-size file. — r/LocalLLM
  8. Does 2-Bit Quantization Break On-Device Safety? What an EMNLP 2026 Study Found, and a GGUF Release Gate — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →