AINewsnow

llama.cpp splits Hindi and Thai differently for Nemotron 3 because its GGUF says pixtral

This story is from 2026-10-21. It is preserved in the archive; the latest stories are on the live feed.

TL;DR : NVIDIA's Nemotron-3-Nano-4B GGUF says tokenizer.ggml.pre = "pixtral" . In llama.cpp, pixtral selects the Llama 3 pre-tokenizer, but Nemotron's own tokenizer uses the Tekken split rules. The result: on llama.cpp master (339f324), English, Japanese, Arabic and code tokenized exactly as Huggin…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-21 04:59 · DEV Community — AI
    llama.cpp splits Hindi and Thai differently for Nemotron 3 because its GGUF says pixtral

More stories

  1. DeepSeek V4.1 Flash is now available in Token Pass — Vercel Blog
  2. Qwen3.8-Flash-Next 125B Q2_0 on a 24GB M4 Mac mini: ~8.1 tok/s with Strata — r/LocalLLM
  3. How to squeeze the Max Token from M1 Max 64gb? — r/LocalLLaMA
  4. Installing qwen model on my smartphone — r/LocalLLM
  5. Eagle-4 Released: Faster than DFlash2 & DSpark — r/LocalLLaMA
  6. Intel Arc B580 now beats an RTX 5060 Ti on llama.cpp prompt processing (Llama 2 7B), plus 1.5x faster long chats — r/LocalLLM
  7. Qwen3.6-35B-A3B (22 GB, 4-bit) on a 16 GB Mac mini M4 through stock llama.cpp: speed, a 4-agent crew, and executed code scores — r/LocalLLM
  8. Geezuz kernel: Qwen3.8-27B at 190 tok/s (620~ tok/s at 8 requests) on two 3090s — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →