pysparkdelta-lakedelta

Writing on Delta Table with Change Data Feed enabled


I'm trying to update with a merge statement a Delta table that has the property delta.enableChangeDataFeed=true, but I get the exception AnalysisException: Cannot write to table with delta.enableChangeDataFeed set. Change data feed from Delta is not yet available. Doing a bit of research I found some old issues on Github that explained that writing on CDF enabled Delta tables was possible only inside Databricks platform, that runs (I believe) a different/proprietary version of Delta. Is it really possible only inside Databricks?


Solution

  • Change Data Feed is available in Delta 2.0 and above. Make sure to use the proper version that works with your version of Apache Spark.