AINewsnow

Strata Optimized for 64GB AGX Orin

Hey guys, hope all is well. I've spent the last few days working on a fork of Strata v0.1.45 for the Jetson AGX Orin 64GB , mainly running Qwen3.6-35B-A3B . I was getting around 21 tok/s decode with MTP-3 in llama.cpp, versus around 30 tok/s in my earlier Strata runs. With sampled MTP-2 enabled, my…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-25 19:35 · r/LocalLLaMA
    Strata Optimized for 64GB AGX Orin

More stories

  1. Maya-XS runs DeepSeek-V4.1-Flash in 120.6 GB, with all 384 experts resident in GPU memory on a 128 GB Ryzen AI Max. — r/LocalLLaMA
  2. qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp — r/LocalLLaMA
  3. Qwen 3.8 Flash Next (129 GB) is better than 2.6 bpw DeepSeek V4.1 Flash 1017 (187 GB + 203 GB Engram) — r/LocalLLaMA
  4. Qwen3.8-27B at 262k context on a 16 GB RX 9070 on Windows: ~80 t/s with achyudh's ROCm KV-streaming fork — r/LocalLLM
  5. Backup your quants! — r/LocalLLaMA
  6. I ran local AI inference (AMD GPU) for 30 days and measured every watt — here's the real cost vs cloud APIs — r/LocalLLM
  7. LLM on Android Phone updates — r/LocalLLM
  8. I built an offline manga translator for Android that users local AI models — r/ClaudeAI

Get the daily brief of stories like this at 6:30 every morning →