New Model: Agens Volundr 32B Preview: our small team's first model on our own hybrid architecture. Only 18 of 72 layers keep a KV cache (Apache-2.0)

This story is from 2026-10-05. It is preserved in the archive; the latest stories are on the live feed.

Hi all. I'm on the team at Blockway, a small team in Hong Kong (disclosure: this is our model). Today we released Agens Volundr 32B Preview, the first model built on our own hybrid architecture. We trained it on limited compute, it isn't perfect, and we'd rather tell you where it falls short up fro…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

1. 2026-10-05 13:01 · r/LocalLLM
   New Model: Agens Volundr 32B Preview: our small team's first model on our own hybrid architecture. Only 18 of 72 layers keep a KV cache (Apache-2.0)