[SOLVED] Does SageMaker built-in LightGBM algorithm support distributed training?

Does SageMaker built-in LightGBM algorithm support distributed training?

Does Amazon SageMaker built-in LightGBM algorithm support distributed training?

I use Databricks for distributed training of LightGBM today. If SageMaker built-in LightGBM supports distributed training, I would consider migrating to SageMaker. It is not clear in the Amazon SageMaker's built-in LightGBM's documentation on whether it supports distributed training.

Thanks very much for any suggestion or clarification on this.

Solution

I went through the LightGBM section of SageMaker documentation and there are no references that it supports distributed training. One of the example here uses single instance type. Also looked at lightGBM documentation here . Here are the parameters that you need to specify

tree_learner=your_parallel_algorithm,

num_machines=your_num_machines,

Given I couldnt find any reference of above in SageMaker documentation, I assume its not supported.