llama2.c on a 2006 iPod @ 80 MHz w/ 64 MB ram and no FPU
hardware: PortalPlayer PP5022, ARM7TDMI @ 80 MHz, 64 MB ram wrote a fun rockbox plugin that runs Karpathy's llama2.c TinyStories models on an ipod video 5.5G. since there's no FPU, I ported llama2.c's int8 runq.c to use only integer math. it uses lookup tables -> exp/softmax + an integer square roo…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-01 19:15 · r/LocalLLaMA
llama2.c on a 2006 iPod @ 80 MHz w/ 64 MB ram and no FPU