Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium
Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon. It’s open to cont…
Read the full story at Hacker News — LLM (50+ points) ↗
Timeline · 1 report
- 2026-11-17 16:01 · Hacker News — LLM (50+ points)
Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium