How much of the weight-space perception gap is actually symmetry? Evidence from ~1.8M fitted SIRENs [R]
This story is from 2026-08-19. It is preserved in the archive; the latest stories are on the live feed.
I’ve been looking at a fairly basic question in weight-space learning that I don’t think gets separated cleanly enough: Why does reading semantics directly from neural network weights work pretty well when the networks share an initialization, but collapse when the networks are fitted independently…
Read the full story at r/deeplearning ↗
Timeline · 2 reports
- 2026-08-19 19:38 · r/deeplearning
How much of the weight-space perception gap is actually symmetry? Evidence from ~1.8M fitted SIRENs [R] - 2026-08-19 19:24 · r/MachineLearning
How much of the weight-space perception gap is actually symmetry? Evidence from ~1.8M fitted SIRENs [R]