Reddit · r/LocalLLaMA· /u/ComfortableKindly507·· 3 天前AI 评分46
Agens Volundr 32B Preview 发布：Blockway 自研混合架构，72 层仅 18 层保留 KV cache
Agens Volundr 32B Preview: our small team's first model on our own hybrid architecture. Only 18 of 72 layers keep a KV cache (Apache-2.0)
AI 导读
Blockway 团队发布 Agens Volundr 32B Preview，这是其首款基于自研混合架构的模型，72 层中仅 18 层保留 KV cache，上下文窗口 262K，采用 Apache-2.0 开源。
来源：Reddit · r/LocalLLaMA · reddit.com