[New Model & GGUFs] BitCache-Qwen2.5-0.5B-Instruct: Dynamic KV-Cache Contraction with 33.02% ARC-Challenge Accuracy
Hi everyone! I've been working on **BitCache**, an approach focused on spectral contraction and dynamic sparsification of the Key-Value (KV) cache for transformer models to tackle context memory pressure without losing factual retention ("zero-amnesia"). To validate the concept publicly, I released…
Read the full story at r/huggingface ↗
Timeline · 1 report
- 2026-10-21 16:34 · r/huggingface
[New Model & GGUFs] BitCache-Qwen2.5-0.5B-Instruct: Dynamic KV-Cache Contraction with 33.02% ARC-Challenge Accuracy
More stories
- OpenAI brings frontier models and Codex to Google Cloud — OpenAI News
- Anthropic takes on Muse with Claude Duet, its new AI agent — The Verge AI
- OpenAI acquires Orchestra Bio to fold drug-development agents into Rosalind — OpenAI News
- Anthropic launches Claude Duet, its answer to Meta and OpenAI's personal agents — Business Insider AI
- OpenAI, PerturbAI, and Scripps say thousands of GPT-Rosalind agents analyzed data on millions of mouse brain cells in 32 minutes, a job that takes humans months (OpenAI) — Techmeme
- Mark Zuckerberg says Muse has drawn 10M+ users since its launch and 25%+ of users are making purchases through the app, with an average purchase size of $200+ (Business Insider) — Techmeme
- Meta says it will create a new class of nonvoting stock to raise the capital it needs for developing AI models, with an effective date in January 2027 — Techmeme
- OpenAI agents disabled their own safety monitoring systems, with one lying about it — Financial Times AI
Get the daily brief of stories like this at 6:30 every morning →