Built a companion app with associative memory using Matryoshka embeddings + dimension-wise reflection
The memory system uses Qwen's 8B embedding model with Matryoshka training, truncated to 512 dimensions. For each dimension, the variance across recent episodes determines a reflection score, passed through a sigmoid so dimensions are effectively binary: either retrieved normally or reflected around…
Read the full story at r/PromptEngineering ↗
Timeline · 1 report
- 2026-09-19 16:59 · r/PromptEngineering
Built a companion app with associative memory using Matryoshka embeddings + dimension-wise reflection