We built a 2.3B AI model architecture based on Kuramoto oscillators, Liquid LTC, and Swarms (currently called the ResoNet Architecture). Thinking of open-sourcing.
We just finished pre-training a new foundation model. Specs: Triad Resonance Core 12 Swarm Factions (1,632 Kuramoto Oscillators) Liquid Time Controller (LTC) Triton Flash-Kuramoto Kernel 155k Orthogonal Tokenizer (Full-Word Mining) 160K Context Window We are debating our release strategy for the 0.…
Read the full story at r/machinelearningnews ↗