AINewsnow

Basalt for Qwen3.8-FN

For those of us lucky enough to have Nvidia RTX 50-Series GPUs (Blackwell), I encourage you to try Basalt as the inference engine. The performance compared to Strata is impressive. This is a Zabbix dashboard I built for my inference servers. https://preview.redd.it/7ftzegh2ygyh1.jpeg?width=2576&for…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-29 20:52 · r/LocalLLM
    Basalt for Qwen3.8-FN

More stories

  1. US investigated Chinese spy plot aimed at Nvidia CEO — TechCrunch AI
  2. Accelerate agentic AI with NVIDIA Nemotron models on Amazon EKS and SageMaker HyperPod EKS — AWS Machine Learning Blog
  3. Into the Omniverse: How Developers Turn Ideas Into Simulations With Frontier AI Agents — NVIDIA Blog
  4. Could Nvidia control how AI models reach developers? Why DOJ is worried about the $12.93 billion Hugging Face deal — Mint AI
  5. Do GX10s / DGX Sparks Dream of Throttling? Temps across 6 cooling setups running DeepSeek V4.1-Flash (spoiler: no) — r/LocalLLaMA
  6. NVIDIA Releases Nemotron 3.5 Transcribe: An Open 30B MoE Model for 40-Language Transcription with ~4B Active Parameters — MarkTechPost
  7. NVIDIA Nemotron 3.5 Transcribe and Granary v2: Intelligent Multilingual Transcription You Can Prompt and Adapt — Hugging Face Blog
  8. Memory-Enforced GPU Sharing in Kubernetes with NVIDIA CUDA 13.4 — NVIDIA Technical Blog

Get the daily brief of stories like this at 6:30 every morning →