AINewsnow

PBT doesn’t make grokking faster, but it can escape a hyperparameter range where nothing groks [P]

I ran Population Based Training over learning rate and weight decay on grokking (modular addition mod 97, 35% train split, small MLP, 20 members, 20k steps, full batch). Results vs a grid (equal compute, 3 seeds): the best fixed cell reached 95% val acc in 317 ± 29 steps; PBT took 2667 ± 2244. PBT…

Read the full story at r/MachineLearning ↗

Timeline · 1 report

  1. 2026-10-26 07:48 · r/MachineLearning
    PBT doesn’t make grokking faster, but it can escape a hyperparameter range where nothing groks [P]

More stories

  1. Meta Seeks Up to $95 Billion in Equity to Fund AI Spending — Bloomberg AI
  2. Anthropic's Claude bypassed a paywall to access Georgia voter data without authorization — Axios AI+
  3. Beyond Collaboration: CRM and Slack Are Slaying Sales Goals — Salesforce AI Blog
  4. Elvis Presley's rightsholders sue Anthropic over 274 songs allegedly used to train its models, seeking $41M+; Anthropic says it disagrees and will defend itself — Techmeme
  5. Owners of Elvis Presley’s Music Sue Anthropic for Copyright Infringement — New York Times AI
  6. Qwen 3.8 Flash Next Gyro Coder is out! — r/LocalLLaMA
  7. Anthropic sued for allegedly using 274 Elvis Presley songs to train AI models — The Guardian AI
  8. Nanbeige releases Nanbeige4.3-33B, an Apache 2.0 teacher model for smaller agents [N] — r/MachineLearning

Get the daily brief of stories like this at 6:30 every morning →