Uncensor an LLM without touching weights: inject a tiny trained KV-cache bank (~18MB) and unload it anytime
I shipped something I've been building for the last few weeks : phantom-kv , a refusal-removal system for large language models that doesn't touch a single weight. Instead of editing the model, it loads a small, learned bank of key/value tensors into the model's KV cache as context. Attention reads…
Read the full story at r/LocalLLaMA ↗
Timeline · 4 reports
- 2026-09-21 23:27 · r/deeplearning
Uncensor an LLM without touching weights: inject a tiny trained KV-cache bank (~18MB) and unload it anytime - 2026-09-21 23:19 · r/LocalLLM
Uncensor an LLM without touching weights: inject a tiny trained KV-cache bank (~18MB) and unload it anytime - 2026-09-21 23:15 · r/ArtificialInteligence
Uncensor an LLM without touching weights: inject a tiny trained KV-cache bank (~18MB) and unload it anytime - 2026-09-21 22:55 · r/LocalLLaMA
Uncensor an LLM without touching weights: inject a tiny trained KV-cache bank (~18MB) and unload it anytime