AINewsnow

I built an open-source tool on top of Hugging Face TRL: GRPO, DPO or SFT from one YAML file

I kept rewriting the same train.py every time I switched between SFT, DPO and GRPO. So I built Trloom, an open-source tool built on top of Hugging Face TRL. The whole run lives in one YAML file: model, LoRA, dataset, reward functions, W&B and an optional Modal GPU. Here is GRPO on Qwen2.5-0.5B with…

Read the full story at r/learnmachinelearning ↗

Timeline · 1 report

  1. 2026-10-16 13:14 · r/learnmachinelearning
    I built an open-source tool on top of Hugging Face TRL: GRPO, DPO or SFT from one YAML file

More stories

  1. Reflection AI releases Beam, a 501B open-weight model for agentic coding — AWS Machine Learning Blog
  2. Hugging Face details 2.8 trillion token Indic pretraining pipeline — Hugging Face Blog
  3. Granite Switch 4.1 offers chat, decisions, and speech in one endpoint — Hugging Face Blog
  4. Reflection Releases Beam's Open Weights Under Apache 2.0 License — Unite.AI
  5. What Laptop do you use for your daily work in AI and ML? — r/learnmachinelearning
  6. Business school teaching case study: Balancing AI capability and control in cyber defence — Financial Times AI
  7. Best model for NSFW img to videos with sound? — r/huggingface
  8. tencent/Hy-Memory-30B-A3B · Hugging Face — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →