I built a browser tool to visualize how a small LLM picks its next word and see what it's attending to [P]
I made a little thing that visualizes attention. It runs SmolLM2-135M fully in the browser (onnxruntime-web, int8, no server, works on my phone). You give it a prompt, it generates one token at a time, and for each step you get the next-token candidates with probabilities, plus the attention from t…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-10-11 22:30 · r/MachineLearning
I built a browser tool to visualize how a small LLM picks its next word and see what it's attending to [P]