pythongoogle-cloud-platformgoogle-bucket

read google bucket files using python


I have to read google bucket files which are in xlsx format. The file structure in the bucket look like

bucket_name
       folder_name_1
               file_name_1
       folder_name_2
       folder_name_3
                file_name_3

The python snippet looks like

def main():
    storage_client = storage.Client.from_service_account_json(
        Constants.GCP_CRENDENTIALS)
    bucket = storage_client.bucket(Constants.GCP_BUCKET_NAME)

    blob = bucket.blob(folder_name_2 + '/' + Constants.GCP_FILE_NAME)

    data_bytes = blob.download_as_bytes()

    df = pd.read_excel(data_bytes, engine='openpyxl')
    print(df)

def function1():
     print("no file in the folder") # sample error

In the above snippet, I'm trying to open folder_name_2, it returns an error because there's no file to read.

Instead of throwing an error, I need to use function1 to print the error whenever there's no file in any folder.

Any ideas of doing this?


Solution

  • I'm not familiar with the GCP API, but you're going to want to do something along the lines of this:

    try:
        blob = bucket.blob(folder_name_2 + '/' + Constants.GCP_FILE_NAME)
        data_bytes = blob.download_as_bytes()
    except Exception as e:
        print(e)
    

    https://docs.python.org/3/tutorial/errors.html#handling-exceptions