AINewsnow

struggling with llama.cpp 2 x dgx spark mtp files start command (unsloth)

Hi all, having searched google and asked several AIs without success, maybe s.o. can help. I have 2 x dgx spark in a cluster. deepseek-flash is running successful. Now I want to test qwen3.8-flash-next from unsloth in the mtp version. Following start-command runs into a dgx-stall: ./llama-server -h…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-08 07:58 · r/LocalLLaMA
    struggling with llama.cpp 2 x dgx spark mtp files start command (unsloth)

More stories

  1. I trust Anthropic with my data. I didn't agree to share it with Meta, TikTok and Google. (IMDEA study) — r/ClaudeAI
  2. Opus 5.5 vs. GPT-6 Astra vs. DeepSeek V4.1 Flash vs. Gemini 3.8 Flash ✈️ — r/ClaudeAI
  3. Sarvam Bets On A Google And Microsoft Veteran To Sell Sovereign AI — Forbes AI
  4. I Tested Haiku 5.5 vs Luna vs DeepSeek Flash vs Gemini 3.8 Flash on real-ish work stuff. Basically a tie on quality, big differences in speed — r/ClaudeAI
  5. The Dialogical Workflow: Red-Teaming, Scaffolding, and Paper Notes — r/PromptEngineering
  6. I Hid Four Traps in a Forecasting Task. Here Is What Four AI Assistants Did. — Towards Data Science
  7. I built an open-source real-time Japanese anime subtitle & translation engine powered by Whisper-Large-v3 + Groq / DeepSeek — r/LocalLLaMA
  8. What to know about Mistral's ML4 as it bets on EU sovereignty in the US-China open-weight AI race — Euronews Next

Get the daily brief of stories like this at 6:30 every morning →