[Discussion] Fine-tuning vs. inheriting base model behavior — a case study with an abliterated Qwen base
Sharing this because the eval writeup raised a question I haven't seen discussed much: when you LoRA fine-tune on top of an already-modified base model (in this case, one with its refusal mechanism removed via ablation), how much of the resulting behavior is actually yours versus inherited? Context…
Read the full story at r/artificial ↗
Timeline · 1 report
- 2026-09-18 12:37 · r/artificial
[Discussion] Fine-tuning vs. inheriting base model behavior — a case study with an abliterated Qwen base