Evo 2 7B GPU memory at 8 kb, 33 kb and 131 kb: a practical genomic-model guide
A DNA model’s advertised context length does not tell you whether the input will fit on your GPU. The attached chart shows recorded Evo 2 7B runs: 16.8 GiB peak memory at 8,192 bases and 30.4 GiB at 32,768 bases. At 131,072 bases, the run failed on both an 80 GB H100 and a 48 GB L40S. These are res…
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-10-13 14:04 · r/deeplearning
Evo 2 7B GPU memory at 8 kb, 33 kb and 131 kb: a practical genomic-model guide