Code and model checkpoints for SyncDPO will be released soon.

GitHub repository: https://github.com/syncdpo/syncdpo_code

Please check this page for updates.