Fully asynchronous multi-turn RL while keeping the training side in Transformers
i work on Halo at White Circle. one problem we wanted to solve was running environment rollouts without turning the training stack into a second serving framework. in Halo, multi-turn rollouts run as Ray actors against vLLM or SGLang while optimization stays in a normal Transformers/TRL trainer. ge…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-09-21 17:43 · r/reinforcementlearning
Fully asynchronous multi-turn RL while keeping the training side in Transformers