Logo image
Offline Constrained RLHF with Multiple Preference Oracles
Preprint   Open access

Offline Constrained RLHF with Multiple Preference Oracles

Brenden Latham and Mehrdad Moharrami
ArXiv.org
Cornell University
03/31/2026
DOI: 10.48550/arxiv.2604.00200
url
https://doi.org/10.48550/arxiv.2604.00200View
Preprint (Author's original)This preprint has not been evaluated by subject experts through peer review. Preprints may undergo extensive changes and/or become peer-reviewed journal articles. Open Access

Abstract

We study offline constrained reinforcement learning from human feedback with multiple preference oracles. Motivated by applications that trade off performance with safety or fairness, we aim to maximize target population utility subject to a minimum protected group welfare constraint. From pairwise comparisons collected under a reference policy, we estimate oracle-specific rewards via maximum likelihood and analyze how statistical uncertainty propagates through the dual program. We cast the constrained objective as a KL-regularized Lagrangian whose primal optimizer is a Gibbs policy, reducing learning to a convex dual problem. We propose a dual-only algorithm that ensures high-probability constraint satisfaction and provide the first finite-sample performance guarantees for offline constrained preference learning. Finally, we extend our theoretical analysis to accommodate multiple constraints and general f-divergence regularization.
Computer Science - Learning

Details

Metrics

1 Record Views
Logo image