For training models on the colab TPUs, the data needs to be on GCP buckets. However, for small amounts of data, I am wondering if it's possible to directly inference data directly from the local colab enviroment.
Unfortunately, it isn't possible to load local data into the TPU with Colab currently. You will need to continue using the GCS bucket for any data loading into the TPU.