AINewsnow

AbliteratedOutTheBox Strata Announcement

I’ve been working on an inference-time abliteration engine as a fork of llama.cpp, and I’ve now ported the hook to Strata. It acts as an easy way to use abliterated models without huge amounts of vram or finetuning. For the Strata Branch https://github.com/heterodoxin/AbliteratedOutTheBox/tree/stra…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-24 13:38 · r/LocalLLaMA
    AbliteratedOutTheBox Strata Announcement

More stories

  1. Tried running 748B DeepSeek-V4.1-Flash on a €2k PC — r/LocalLLaMA
  2. NVIDIA's Dory 1.0 4B (looped reasoning model) on Apple Silicon with MLX: 101 tok/s at 1 loop, 69 at 2, on an M5 Max (4.2 GB 8-bit build) — r/LocalLLM
  3. llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp — r/LocalLLaMA
  4. 2× Arc Pro B70 on Windows: Qwen3.8-27B Q8_0 at 51 t/s average over 1,030 real agent requests (15K–193K context, temp 1.0). Recipe, patches, and a oneAPI leak fix — r/LocalLLM
  5. Benchmark: Recursive's Flint 40B A2.5B Q4 achieves 128 tok/s on MacBook Pro M4 Pro 48GB using Kapitsa, an open-source Apple Silicon optimized engine, Claude/Codex/Pi/OpenCode compatible. — r/LocalLLaMA
  6. Locality of reference helped 94GB Qwen3.8-Flash-Next runs at 68 tok/s on one RTX 5090 — r/ArtificialInteligence
  7. Offline manga translation on Android: bubble detection + OCR + a local LLM on llama.cpp, ~15 s/page on a Galaxy S23 (open source) — r/LocalLLM
  8. The irony of jev/decision models... — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →