Announcement_8

Our preprint on preference optimization under domain shift is uploaded in arxiv!