This repository contains a Colab notebook for reproducing experiments presented in the paper.

Open the notebook in Colab using this direct link.

You can cite this work as

@article{dumoulin2023density,
    title={A density estimation perspective on learning from pairwise human preferences},
    author={
      Vincent Dumoulin and Daniel D. Johnson and Pablo Samuel Castro and
      Hugo Larochelle and Yann Dauphin
    },
    year={2023},
    journal={arXiv preprint arXiv:2311.14115},
    url={https://arxiv.org/abs/2311.14115},
}

Copyright 2023 DeepMind Technologies Limited

All software is licensed under the Apache License, Version 2.0 (Apache 2.0); you may not use this file except in compliance with the Apache 2.0 license. You may obtain a copy of the Apache 2.0 license at: https://www.apache.org/licenses/LICENSE-2.0

All other materials are licensed under the Creative Commons Attribution 4.0 International License (CC-BY). You may obtain a copy of the CC-BY license at: https://creativecommons.org/licenses/by/4.0/legalcode

Unless required by applicable law or agreed to in writing, all software and materials distributed here under the Apache 2.0 or CC-BY licenses are distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the licenses for the specific language governing permissions and limitations under those licenses.

This is not an official Google product.