AINewsnow

Jeff-Qwen3.5-0.8B v1.2 + 9 LoRA adapters: put it in front of Qwen3.8-27B for 38× faster decisions and +8.7 points accuracy, for under 2 GB extra memory

This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.

A few days ago I released Jeff-Qwen3.5-0.8B, a small "System 1" model that picks between options you define and returns a calibrated probability for each, in one forward pass. Speed was great on my M4 Max and RTX PRO 6000, but as a general zero-shot classifier it trailed the big models. Then it occ…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-01 13:59 · r/huggingface
    Jeff-Qwen3.5-0.8B v1.2 + 9 LoRA adapters: put it in front of Qwen3.8-27B for 38× faster decisions and +8.7 points accuracy, for under 2 GB extra memory
  2. 2026-10-01 13:58 · r/LocalLLaMA
    Jeff-Qwen3.5-0.8B v1.2 + 9 LoRA adapters: put it in front of Qwen3.8-27B for 38× faster decisions and +8.7 points accuracy, for under 2 GB extra memory

More stories

  1. Jensen Huang resigns as Nvidia CEO amid calls for reinstatement and possible comeback — Hard Fork (NYT)
  2. Researchers allege Chinese AI models were trained on export-banned Nvidia Blackwell chips — Bloomberg AI
  3. Anthropic IPO oversubscribed nearly six times; can AI firm become new NVIDIA amid stock crash? Experts' views — Mint AI
  4. Apple to unveil Siri AI smart glasses at WWDC, with Face ID coming to iPhone Duo 2 — Tom's Guide AI
  5. A step toward defining the Standard Model on a lattice — OpenAI News
  6. Bharat Semi raises $24M seed round to bring AI image sensors to market — TechCrunch AI
  7. Grounded flights, Microsoft outage and AI turmoil fuel fears of wider tech breakdown — Washington Post AI
  8. Earnings Calls Point to AI-Led Growth and Stronger Margins — The Globe and Mail

Get the daily brief of stories like this at 6:30 every morning →