moonshot

Sep 14, 2026

• attention
• sparse-attention
• moba
• moonshot
• kimi
• block-sparse
• top-k
• mixture-of-experts
• long-context
• trainable-sparse

Sep 12, 2026

• attention
• linear-attention
• delta-rule
• kda
• kimi
• moonshot
• channel-wise-decay
• hybrid
• mla
• long-context
• kv-cache

Sep 12, 2026

• kimi
• moonshot
• kda
• mla
• delta-rule
• linear-attention
• hybrid
• moe
• long-context
• nope
• vision