AINewsnow

What I learned making a local 8B model answer questions from contracts, with every claim checked against the source

Disclosure: I'm the developer of the Mac app this is about (Citenook). Mostly sharing what worked and what didn't, since I hit the same problems many of you describe. The goal: ask questions across folders of confidential files (contracts, invoices, notes) with a model on the Mac, no cloud, and be…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-11 16:55 · r/LocalLLM
    What I learned making a local 8B model answer questions from contracts, with every claim checked against the source

More stories

  1. An Anthropic AI model sent a false homicide tip to Philadelphia police — TechCrunch AI
  2. Microsoft's Nadella says AI needs an ‘emergency brake’ that humans control — CNBC Technology
  3. Qwen Image 2.1 Turbo Released -- Hugging Face — r/StableDiffusion
  4. Microsoft unveils Microsoft-Decision-1, a fast decision-scoring model trained on Qwen3.5-9B, and says it will soon rebase it on MAI, OpenAI, and other models (Achint Srivastava/Command Line) — Techmeme
  5. Daily Driving Qwen 3.8 Flash-Next MoE (NVFP4) on RTX 5090 + 128GB RAM — Telemetry & Impressions — r/LocalLLM
  6. Philadelphia police receive false homicide tip from Anthropic AI model — The Hill Technology
  7. Nvidia in talks to acquire US ‘open’ model start-up Reflection AI — Financial Times AI
  8. How Oracle Uses Codex to Help Business Users Get Answers — OpenAI YouTube

Get the daily brief of stories like this at 6:30 every morning →