Can one use DPO of GPT via CLI or Python on Azure?
Update: As of late August 2025, Azure allows DPO (direct preference optimization) of GPT, see https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/fine-tuning-direct-preference-optimization
It is currently not possible to use DPO of GPT via CLI or Python on Azure. Source: private correspondence with Microsoft.