liftazure-databrickslift-json

Can't install net.liftweb:lift-json_2.13 in Databricks


I am trying to install net.liftweb:lift-json_2.13:3.4.1 into a Databricks cluster (Apache Spark 2.4.4, Scala 2.11)

However I am getting the following error:

java.lang.RuntimeException: unresolved dependency: net.liftweb:lift:1.2.1: not found

When I try to install the net.liftweb:lift:1.2.1 I am getting the following error:

Maven Dependencies not found: unresolved dependency: net.liftweb:lift:1.2.1: not found Please try again by excluding these dependencies.

I also had no success with other versions.


Solution

  • To make third-party or locally-built code available to notebooks and jobs running on your clusters, you can install a library. Libraries can be written in Python, Java, Scala, and R. You can upload Java, Scala, and Python libraries and point to external packages in PyPI, Maven, and CRAN repositories.

    Steps to install third party libraries:

    Step1: Create Databricks Cluster.

    Step2: Select the cluster created.

    Step3: Select Libraries => Install New => Select Library Source = "Maven" => Coordinates => Search Packages => Select Maven Central => Search for the package required. Example: (lift json) => Select the version ( net.liftweb » lift-json_2.13 » 3.4.1) required => Install

    enter image description here

    Successfully installed ( net.liftweb » lift-json_2.13 » 3.4.1) library.

    enter image description here

    For more details, refer "Azure Databricks - libraries".

    Hope this helps. Do let us know if you any further queries.