AINewsnow

I took EmbeddingGemma-2 (577M) from Rank #26 to #1 on the MTEB Audio leaderboard (MAEB), beating 9B models by adding a 2.4 MB PCA head with zero training

Model & weights: BrunoHays/embeddinggemma-2-nullspace-audio MAEB (Massive Audio Embedding Benchmark) is the main MTEB leaderboard benchmark for audio and text-to-audio embeddings, currently dominated by 8B-9B multimodal models. I took Google's edge-sized google/embeddinggemma-2 (577M params, 768d v…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-28 13:34 · r/MachineLearning
    [R] Taking EmbeddingGemma-2 (577M) from Rank #26 to #1 on the MAEB audio benchmark by filling its 256d null space with PCA-reduced intermediate Conformer layers (zero training) [R]
  2. 2026-10-28 13:23 · r/LocalLLaMA
    I took EmbeddingGemma-2 (577M) from Rank #26 to #1 on the MTEB Audio leaderboard (MAEB), beating 9B models by adding a 2.4 MB PCA head with zero training

More stories

  1. DeepMind unveils Genie 4 world model promising more realistic physics and humans — Ars Technica AI
  2. Microsoft and Alphabet Earnings Put Focus on AI Cash Flow Drain — Bloomberg AI
  3. Google unveils Google Multi-Party Compute (MPC), a digital-asset custody and security service in private preview, set for commercial availability in early 2027 — Techmeme
  4. 8 examples of Gemini 4 Argon in action — Google Gemini Blog
  5. The sleep framework: A new way for LLMs to retain knowledge in continual learning — Google Research Blog
  6. Our newest AI Quest: Mapping the human brain — Google AI Blog
  7. 15 college students share their favorite Gemini features — Google Gemini Blog
  8. Humans can coexist with AI. Here’s how. — Vox Artificial Intelligence

Get the daily brief of stories like this at 6:30 every morning →