azure-blob-storagedatabricksazure-storageazure-databricksdatabricks-workflows

Where is the root Azure Storage instance?

I am trying to access logs from my Databricks notebook which is run as a job. I would like to see these logs in an azure storage account.

From the documentation: https://learn.microsoft.com/en-us/azure/databricks/administration-guide/workspace/storage#notebook-results

enter image description here

According to this, my results are stored in the workspace's root Azure Storage instance. However, I can't find any reference to this elsewhere online. How would I access this?

Solution

  • The documentation says:

    Notebook results are stored in workspace system data storage, which is not accessible by users.

    But you can retrieve these results via UI, or via get-output command of Jobs REST API, or via runs get-output command of databricks-cli.