Gunjan Dhanuka — Learning Notes

top-k

2 items with this tag.

  • Sep 14, 2026

    DSA (DeepSeek Sparse Attention)

    • attention
    • sparse-attention
    • dsa
    • csa
    • deepseek
    • trainable-sparse
    • lightning-indexer
    • top-k
    • mla
    • long-context
    • kv-cache
  • Sep 14, 2026

    MoBA (Mixture of Block Attention)

    • attention
    • sparse-attention
    • moba
    • moonshot
    • kimi
    • block-sparse
    • top-k
    • mixture-of-experts
    • long-context
    • trainable-sparse

Created with Quartz v5.0.0 © 2026

  • Personal site
  • Research
  • Field notes
  • Source