apache-sparkapache-spark-sqldatabricksazure-databricksazure-notebooks

Spark SQL databricks Create Table using CSV Options Documentation

Do you know where is the proper documentation for Spark SQL using databricks?

For example I wish to know the full options list for creating a table using csv in Azure databricks notebook.

Thanks for your help.

Solution

  • There are many options available to read CSV file in databricks but there are no specific documents for that which options are supported for which file.

    Property Name Values
    Header true/false
    Inferschema true/false
    delimiter ,
    quote "
    nullValue

    These options are similar to the features given in this document and similar to those documented in the pyspark CSV files.