Gunjan Dhanuka — Learning Notes
Search
Search
Dark mode
Light mode
Reader mode
Explorer
simpo
2 items with this tag.
Sep 02, 2026
Preference Optimization (RL-free family)
preference-optimization
dpo
ipo
kto
orpo
simpo
cpo
alignment
rl-for-llms
Sep 02, 2026
07 · DPO & RL-Free Preference Optimization
dpo
preference-optimization
rlhf
bradley-terry
kl-regularization
ipo
kto
orpo
simpo
cpo
alignment
likelihood-displacement