AINewsnow

Agens Volundr 32B Preview: our small team's first model on our own hybrid architecture. Only 18 of 72 layers keep a KV cache (Apache-2.0)

This story is from 2026-10-05. It is preserved in the archive; the latest stories are on the live feed.

Hi r/LocalLLaMA . I'm on the team at Blockway, a small team in Hong Kong (disclosure: this is our model). Today we released Agens Volundr 32B Preview, the first model built on our own hybrid architecture. We trained it on limited compute, it isn't perfect, and we'd rather tell you where it falls sh…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-05 13:01 · r/LocalLLM
    New Model: Agens Volundr 32B Preview: our small team's first model on our own hybrid architecture. Only 18 of 72 layers keep a KV cache (Apache-2.0)
  2. 2026-10-05 12:58 · r/LocalLLaMA
    Agens Volundr 32B Preview: our small team's first model on our own hybrid architecture. Only 18 of 72 layers keep a KV cache (Apache-2.0)

More stories

  1. Anthropic debuts on Wall Street in record $81.3 billion IPO, briefly hitting $2 trillion value — Anthropic (X)
  2. OpenAI launches GPT-6.2 Astra and Sol as Google ships Gemini 4 Neon and Microsoft unveils MAI Code 2 — OpenAI News
  3. Google launches Gemini 4 Neon and opens Genie 4 world model to Gemini API developers — Google DeepMind YouTube
  4. AWS expands SageMaker AI with data preparation tools and cross-Region inference routing — AWS Machine Learning Blog
  5. An early rally for Wall Street evaporates as the market waits for Anthropic's stock to begin trading — The Globe and Mail
  6. Google books Blue Origin's New Glenn for 2029 launch of AI server satellites — Google: The Keyword
  7. AWS expands SageMaker JumpStart with OpenTSLM, model leaderboard, and PolyAI Dialog-RSN-1 — AWS Machine Learning Blog
  8. AWS expands Amazon Bedrock AgentCore with cost, networking, identity, and tooling updates — AWS Machine Learning Blog

Read the Daily Brief: the day's most important AI stories →