Fine-tuning Cactus Needle 2 can match DeepSeek v4 on the specific task
This story is from 2026-08-20. It is preserved in the archive; the latest stories are on the live feed.
Hey LocalLlama, Henry from Cactus here! When we trained Needle 2, I had a strict rule to not expose the model to any data sample that remotely felt like these benchmarks. It seemed over-the-top, but benchmarks are easy to overfit around, yet struggle in the wild, especially since we quantize to 2-b…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-08-20 20:15 · r/LocalLLaMA
Fine-tuning Cactus Needle 2 can match DeepSeek v4 on the specific task