kda

Sep 12, 2026

• attention
• linear-attention
• delta-rule
• kda
• kimi
• moonshot
• channel-wise-decay
• hybrid
• mla
• long-context
• kv-cache

Sep 12, 2026

• kimi
• moonshot
• kda
• mla
• delta-rule
• linear-attention
• hybrid
• moe
• long-context
• nope
• vision