google-cloud-platformapache-flinkgoogle-cloud-dataprocgoogle-cloud-bigtable

Flink-BigTable - Any connector?


I would like to use BigTable as a sink for a Flink job:

  1. Is there a connector out-of-the-box ?
  2. Can I use Datastream API ?
  3. How can I optimally pass a sparse object (99% sparsity), i.e. ensure no key/value are created in BigTable for nulls ?

I have searched the documentation for the above topics but couldn't answer those questions.

Thanks for your support !


Solution

  • There is a Flink-Bigtable connector now https://github.com/google/flink-connector-gcp/tree/main/connectors/bigtable