How Sampling Shapes LLM Alignment: From One-Shot Optima to Iterative Dynamics
Standard methods for aligning large language models with human preferences learn from pairwise comparisons among sampled candidate responses and regularize toward a reference …
yurong-chen