AINewsnow

Built a quick, sub-15ms Rust CLI/TUI to pack repos into prompts without burning 40k tokens on lockfiles and junk

This story is from 2026-10-04. It is preserved in the archive; the latest stories are on the live feed.

Whenever I feed codebases into local models (Qwen, DeepSeek R1) or API models, the biggest annoyance is prompt pollution: - Lockfiles (`Cargo.lock`, `package-lock.json`) burning 30,000+ tokens for zero reason. - SVGs, binary files, or build artifacts slipping into the context. - Existing packers ta…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-04 17:18 · r/LocalLLaMA
    Built a quick, sub-15ms Rust CLI/TUI to pack repos into prompts without burning 40k tokens on lockfiles and junk

More stories

  1. Run Mobilerun with local and cheap models Ollama, DeepSeek, Qwen, OpenRouter — DEV Community — Machine Learning
  2. Create a 3D kitchen using Qwen 3.8 Flash Next — r/LocalLLM
  3. Exact VRAM & Memory Bandwidth Math for Running DeepSeek-R1, Qwen-2.5-Coder-32B & Llama-3.3-70B Locally — DEV Community — AI
  4. Tencent launches Hy4 Flash at $0.07 per million tokens as AI price war intensifies — Business Insider AI
  5. Alibaba's QwenWork Adds Third-Party Models From Kimi, GLM and DeepSeek — Pandaily
  6. Sarvam Launches India-Hosted Token Factory, Faces Backlash Over Chinese Model Offerings — Bloomberg AI
  7. AI Models Regularly Identify Civilians as Military Targets in Simulated Warfare Tests — Bloomberg AI
  8. OpenRouter Routed Some Chatbot Prompts to a Hacked Server for 18 Days. Were Your Passwords in Them? — DEV Community — AI

Read the Daily Brief: the day's most important AI stories →