Experimenting with hypersurface-constrained dynamic weight updating [P]
Hey everyone! I want to share the results of a small language model architecture experiment I’ve been running as a side project. The ultimate goal is to test an approach to reduce the number of the model's training parameters, since the main bottleneck in training is VRAM. The core idea is very sim…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-09-19 17:34 · r/MachineLearning
Experimenting with hypersurface-constrained dynamic weight updating [P]