GAPO — Geometric Anchor Preference Optimization
Replaces DPO's frozen reference with a dynamic adversarial anchor — a worst-case local perturbation of the current policy — and reweights each preference pair by its geometric brittleness. Robust to noisy labels without an explicit noise model.