We are running scheduled databricks jobs on a daily basis in Azure databricks and it runs successfully on all days. But today (29th Sept 2020), the job is failing within few seconds with Internal Error. The error message is given below:
Error while fetching notebook snapshot: HTTP request failed with status: HTTP/1.1 403 Forbidden
Has anyone else faced this issue and knows how to solve this?
We were able to identify and fix the issue. The jobs were setup under a person's user id who left the organization last weekend. Since his id was not active, it didn't have access to run the job and it was failing. After changing the job owner to another user id, it ran fine