AINewsnow

why does batchnorm behave differently at train vs eval time

i get that in training it uses the batch mean and variance and at eval it uses running averages. what i don't get is why that doesn't change the outputs a lot, since a single batch's stats can be pretty noisy. also if you eval with batch size 1 does it still work fine because it's just using the st…

Read the full story at r/MLQuestions ↗

Timeline · 1 report

  1. 2026-10-26 12:04 · r/MLQuestions
    why does batchnorm behave differently at train vs eval time

More stories

  1. Meta Seeks Up to $95 Billion in Equity to Fund AI Spending — Bloomberg AI
  2. Anthropic's Claude bypassed a paywall to access Georgia voter data without authorization — Axios AI+
  3. How Black-Box Distillation Works — CSET Georgetown
  4. Beyond Collaboration: CRM and Slack Are Slaying Sales Goals — Salesforce AI Blog
  5. Anthropic files to go public — Engadget
  6. Anthropic reveals plans for blockbuster IPO — Sky News Technology
  7. Anthropic IPO: S-1 Filing Offers First Look at Claude Maker’s Finances — Bloomberg AI
  8. Anthropic's S-1 lists 94 pages of risk factors and warns that the "scale of harm" from a "catastrophic" AI incident might mean it is unable to obtain insurance (Wall Street Journal) — Techmeme

Get the daily brief of stories like this at 6:30 every morning →