Distributed training with Ray Train DLCs and EFA on EKS
The Ray Train Deep Learning Container ships the full CUDA-through-EFA stack, so you build no image. This post walks through a reproducible sample that fine-tunes Qwen2.5-1.5B with PyTorch FSDP across eight GPUs on two EFA-enabled g6.12xlarge instances on Amazon EKS, using the container exactly as p…
Read the full story at AWS Machine Learning Blog ↗
Timeline · 1 report
- 2026-10-28 18:19 · AWS Machine Learning Blog
Distributed training with Ray Train DLCs and EFA on EKS