AINewsnow

RadianceMemory + RadianceSwap: KV cache paged to host RAM by sparse attention (byte-identical output), and in-process multi-model serving that moves VRAM between models at runtime — 2× Radeon AI PRO R9700

Hi r/LocalLLaMA . I've spent the last week on KV-cache memory for Qwen3.8-Flash-Next running on 2× AMD Radeon AI PRO R9700 (gfx1201, TP=2) , and wrote it up as a 23-page paper with all measurements. Code is in two forks of the radiance inference engine (by Deadcode and contributors — the engine is…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-06 06:38 · r/LocalLLM
    RadianceMemory + RadianceSwap: KV cache paged to host RAM by sparse attention (byte-identical output), and in-process multi-model serving that moves VRAM between models at runtime — 2× Radeon AI PRO R9700

More stories

  1. Nvidia opens investigation after CEO Jensen Huang admits affair with alleged Chinese spy — Axios AI+
  2. Hydra-PSIE expands 'Coeziune OM–IA' DOI registry to 39 published works — DEV Community — AI
  3. STATERA Library publishes Korean-language series on memory and knowledge systems for LLMs — DEV Community — AI
  4. STATERA Library expands open AI curriculum with reasoning and mathematics chapters — DEV Community — AI
  5. US AI Safety Center CAISSI Asked to Report to White House, Raising Independence Concerns — AP News
  6. Earnings Calls Highlight AI Adoption Across Telecom, Software and Health Firms — The Globe and Mail
  7. Under fire over AI, effective altruism seeks to tell its own story — Barron's
  8. Anthropic agrees $3.4 billion deal for gas-fired generators to power AI data centres — Financial Times AI

Get the daily brief of stories like this at 6:30 every morning →