AINewsnow

Quantization livestream with goats of inference

This story is from 2026-11-05. It is preserved in the archive; the latest stories are on the live feed.

Hey folks, it's Merve from Hugging Face. Title of this post is super self explanatory, we are doing a quantization workshop livestream with Michael Goin (lead maintainer of vLLM at RedHat), Colin Kealty (aka bartowski at RedHat), Maxime Labonne and Aditya Tadimeti. I will shortly teach you how quan…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-05 11:46 · r/LocalLLaMA
    Quantization livestream with goats of inference

More stories

  1. Hinton Warns AI Could Disrupt Power and Finance: He Calls for Independent Testing Before Release — DEV Community — AI
  2. Moonshot Just Put a 2.8-Trillion-Parameter Model on Hugging Face — Kimi K3.1 Pro's Open Weights Are Real, and the Fine Print Matters — DEV Community — AI
  3. Proposal: uncensoring LoRAs — r/LocalLLaMA
  4. olmOCR-bench on Hugging Face: Three Rows Use a Different Average, and One Moves From 13th to 7th or 19th — DEV Community — Machine Learning
  5. The Open-Source Paradox: Giving Away AI Makes It Safer (and More Dangerous) — DEV Community — AI
  6. Huggingface - WOW.. 2 ZeroGPU Spaces for all free accounts? — r/LocalLLaMA
  7. [Release] Qwen3.8-Flash-Next DR-V2-Q2_0 GGUF - Fits in 48GB VRAM (38.4 GB Backbone), 83.3% AIME 2025, 74.7% Aider Polyglot — r/LocalLLM
  8. Serving Sage-A1.5 on an RTX 4090: one broken flag, one queue, and a self-check mode to measure — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →