I trained a small transformer to fly a boids flock just by watching, then checked where it keeps the three rules

i wrote a small boid simulator (12 birds), recorded it flying then saved it, and trained a transformer to predict each bird's next move without it knowing about any boid rules. (built in Python and PyTorch: a transformer written from scratch, one token per bird, two attention layers, about 414k wei…

Read the full story at r/learnmachinelearning ↗

Timeline · 1 report

1. 2026-10-10 23:17 · r/learnmachinelearning
   I trained a small transformer to fly a boids flock just by watching, then checked where it keeps the three rules