cntkadambrainscript

Adam Optimizer in CNTK BrainScript

This seems to be possible using the Python and C# APIs as per the documentation.

The BrainScript documentation doesn't have Adam as one of the options for gradUpdateType.

Is it possible to use the Adam optimizer in BrainScript?

Solution

  • Sorry Adam optimizer is implemented in V2 CNTK only. In BS, you can use FsAdagrad which is close to Adam.

    Thanks,
    Emad