I built an open-source tool on top of Hugging Face TRL: GRPO, DPO or SFT from one YAML file

I kept rewriting the same train.py every time I switched between SFT, DPO and GRPO. So I built Trloom, an open-source tool built on top of Hugging Face TRL. The whole run lives in one YAML file: model, LoRA, dataset, reward functions, W&B and an optional Modal GPU. Here is GRPO on Qwen2.5-0.5B with…

Read the full story at r/huggingface ↗

Timeline · 2 reports

1. 2026-10-16 13:14 · r/learnmachinelearning
   I built an open-source tool on top of Hugging Face TRL: GRPO, DPO or SFT from one YAML file
2. 2026-10-16 13:14 · r/huggingface
   I built an open-source tool on top of Hugging Face TRL: GRPO, DPO or SFT from one YAML file