AINewsnow

datapoint: 2x M5U cluster (GLM/Qwen)

Caveats: IDK how to set anything up and I asked Deepseek to handle it - not enough training data so without specific guides the set up doesn't work well. I'm not a programmer. My previous model was Qwen 3.8 27B q4 using ninfer. Was getting around 1.4k prefill and 100-120 tokens decode. Just want to…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-26 14:26 · r/LocalLLaMA
    datapoint: 2x M5U cluster (GLM/Qwen)

More stories

  1. Context Bombs: Making attacking agents pay — r/ArtificialInteligence
  2. qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp — r/LocalLLaMA
  3. I need to fine tune Qwen3.5-9B with QLora on about 500 GB of raw data (images/scanned documents/pdfs/word/excel) - what is the best way forward? — r/LocalLLaMA
  4. Meet Groot — four smaller models for reasoning, coding and tool use — r/huggingface
  5. OpenAI and Anthropic support OSS maintainers. Do Chinese AI companies offer similar programs? — r/artificial
  6. What's the best front-end for LLM assisted studying? — r/LocalLLM
  7. Weapon or armour? The contentious debate over China’s open-weight AI — South China Morning Post Tech
  8. Moonshot AI launches Kimi K3.1 Pro with better coding skills, reduced cyber risks — Mint AI

Get the daily brief of stories like this at 6:30 every morning →