I built SpectralBERT — an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?

This story is from 2026-09-09. It is preserved in the archive; the latest stories are on the live feed.

​ Hi everyone, I want to share a project I've been working on: SpectralBERT a novel architecture that replaces traditional self-attention with a frequency-domain memory mechanism. The Core Idea: Instead of computing O(N²) pairwise token interactions, I transform the sequence into the frequen…

Read the full story at r/deeplearning ↗

Timeline · 3 reports

1. 2026-09-09 14:13 · r/learnmachinelearning
   I built SpectralBERT — an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?
2. 2026-09-09 14:13 · r/computervision
   I built SpectralBERT an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?
3. 2026-09-09 14:12 · r/deeplearning
   I built SpectralBERT — an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?