pythonazurecommand-line-interfacefine-tuninggpt-4

Can one use DPO (direct preference optimization) of GPT via CLI or Python on Azure?


Can one use DPO of GPT via CLI or Python on Azure?


Solution

  • It is currently not possible to use DPO (direct preference optimization) of GPT via CLI or Python on Azure. Source: private correspondence with Microsoft.