pythonazurecommand-line-interfacefine-tuninggpt-4

Can one use DPO (direct preference optimization) of GPT via CLI or Python on Azure?


Can one use DPO of GPT via CLI or Python on Azure?


Solution

  • Update: As of late August 2025, Azure allows DPO (direct preference optimization) of GPT, see https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/fine-tuning-direct-preference-optimization


    It is currently not possible to use DPO of GPT via CLI or Python on Azure. Source: private correspondence with Microsoft.