Gunjan Dhanuka — Learning Notes
Search
Search
Dark mode
Light mode
Reader mode
Explorer
Home
❯
learn
❯
gpu
gpu
7 items under this folder.
Sep 02, 2026
Learn: GPU Architecture & SIMT
gpu
cuda
simt
tensor-cores
occupancy
hardware
llm-systems
Sep 02, 2026
Learn: The GPU Memory Hierarchy
gpu
memory-hierarchy
hbm
shared-memory
coalescing
bank-conflicts
memory-wall
performance
Sep 02, 2026
Learn: Performance Modeling & Roofline
gpu
roofline
arithmetic-intensity
mfu
mixed-precision
fp8
tensor-cores
profiling
performance-modeling
Sep 02, 2026
Learn: Your First CUDA Kernels
gpu
cuda
kernels
vector-add
matmul
grid-stride
cuda-events
arithmetic-intensity
llm-systems
Sep 02, 2026
Learn: Optimizing GEMM
gpu
cuda
gemm
matmul
tiling
coalescing
shared-memory
register-blocking
bank-conflicts
warptiling
cublas
cutlass
performance
Sep 02, 2026
Learn: The Memory Wall & FlashAttention
gpu
flashattention
kernel-fusion
online-softmax
memory-wall
io-aware
attention
arithmetic-intensity
hopper
blackwell
Sep 02, 2026
Learn: Triton & Modern Kernel Authoring
gpu
triton
torch-compile
kernels
cuda
autotuning
llm-systems