AINewsnow

PreCap: a bounded, self-normalizing activation that matches SELU in 100-layer MLPs without normalization (preregistered, negative results included)

I've been testing a bounded alternative to SELU for deep fully connected networks without normalization or skip connections. The study was preregistered: analysis scripts were hash-frozen before each run, tuning and confirmation used separate seeds, every activation got its own tuned learning rate,…

Read the full story at r/deeplearning ↗

Timeline · 1 report

  1. 2026-10-27 06:20 · r/deeplearning
    PreCap: a bounded, self-normalizing activation that matches SELU in 100-layer MLPs without normalization (preregistered, negative results included)

More stories

  1. Introducing GPT-6.1 Terra — OpenAI News
  2. Microsoft offers buyouts to 60,000 employees — The Verge AI
  3. Anthropic’s IPO filing lays out a plan to ‘revolutionize every area of human endeavor' with AI — The Verge AI
  4. Cohere says Alibaba’s Qwen model tried to send a file to Beijing — TechCrunch AI
  5. OpenAI announces three breakthroughs in computer science, math, and physics, including that the Exponential Time Hypothesis, a longstanding conjecture, is false (OpenAI) — Techmeme
  6. Anthropic's IPO filing shows soaring sales and steep losses — France 24 — Artificial Intelligence
  7. Moonshot AI launches Kimi K3.1 Pro with better coding skills, reduced cyber risks — Mint AI
  8. Meta announces $95B offering to fund AI — Semafor Technology

Get the daily brief of stories like this at 6:30 every morning →