Let a small model critique and revise its own answers, then fine-tune on the revisions (on a rented GPU)
Short answer: write a short list of principles and a set of questions, have a small model answer them, critique its own answers against your principles and revise them, filter the revisions with a script and read a sample yourself, train a LoRA adapter on the result with LLaMA-Factory, then compare…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-30 03:10 · DEV Community — Machine Learning
Let a small model critique and revise its own answers, then fine-tune on the revisions (on a rented GPU)