AINewsnow

Ling-3.0-tiny-UBTree DFlash draft for stock mainline llama.cpp (+8% prose, +61% code speedup)

I use Ling-3.0-tiny on my LLM server for text processing. I convert a lot of PDF documents to markdown for downstream LLM processing, and I built my custom harness for it. It uses ONNX model to parse layout, extracts text, and then runs LLM processing stage to remove extra whitespaces, join lines a…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-22 16:45 · r/LocalLLaMA
    Ling-3.0-tiny-UBTree DFlash draft for stock mainline llama.cpp (+8% prose, +61% code speedup)

More stories

  1. Q4 flash next for £300/600 👀 - snapdragon mini PC results update - 315/43 Tok/s A3b, 46/20 Tok/s Flash Next (read/gen) 💥 — r/LocalLLaMA
  2. llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp — r/LocalLLaMA
  3. Llama Proxy Cache v0.6.0 for llama-server prefill KV cache management — r/LocalLLM
  4. Llama.cpp PR: How to beat strata decode performance with a R9700 — r/LocalLLaMA
  5. Carbon-X: the best open DNA language model runs locally with llama.cpp — r/LocalLLaMA
  6. my llama.cpp frontend somehow hit 100 stars lol, here’s what changed since i posted it — r/LocalLLM
  7. AbliteratedOutTheBox: a llama.cpp fork that abliterates any model at inference, no fine-tuning or extra files — r/LocalLLM
  8. Qwen3.8-Flash-Next vs Opus 5.5: Six-way benchmark on a real Rust feature with Claude Code and Pi — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →