I turned a looped transformer into a decision model that scores answer option
Hello! I just released wyat-2, a fine-tune of Ouro-1.4B (a looped transformer) trained on a single RTX 4070 Ti. The link is the report. As far as I know it’s the first decision model built on a looped transformer: not the best, but the first. I realized I would need heavy data work to make it the b…
Read the full story at r/huggingface ↗
Timeline · 1 report
- 2026-10-28 14:32 · r/huggingface
I turned a looped transformer into a decision model that scores answer option