https://community.databricks.com/t5/data-engineering/how-can-i-add-jars-quot-spark-jars-quot-to-pyspark-notebook/m-p/27683#M19544 <P></P> <P>I want to add a few custom jars to the spark conf. Typically they would be submitted along with the spark-submit command but in Databricks notebook, the spark session is already initialized. So, I want to set the jars in "spark.jars" property in the conf. Even if I'm able to create a new session with the new conf, it seems to be not picking up the jars. Is there any better way to add jars?</P> <P></P> Mon, 14 Oct 2019 19:29:00 GMT dbansal 2019-10-14T19:29:00Z https://community.databricks.com/t5/data-engineering/how-can-i-add-jars-quot-spark-jars-quot-to-pyspark-notebook/m-p/27683#M19544 <P></P> <P>I want to add a few custom jars to the spark conf. Typically they would be submitted along with the spark-submit command but in Databricks notebook, the spark session is already initialized. So, I want to set the jars in "spark.jars" property in the conf. Even if I'm able to create a new session with the new conf, it seems to be not picking up the jars. Is there any better way to add jars?</P> <P></P> Mon, 14 Oct 2019 19:29:00 GMT https://community.databricks.com/t5/data-engineering/how-can-i-add-jars-quot-spark-jars-quot-to-pyspark-notebook/m-p/27683#M19544 dbansal 2019-10-14T19:29:00Z https://community.databricks.com/t5/data-engineering/how-can-i-add-jars-quot-spark-jars-quot-to-pyspark-notebook/m-p/27684#M19545 <P></P><P>Hi @dbansal, Install the libraries/jars while initialising the cluster.</P><P>Please go through the documentation on the same below,</P><P><A href="https://docs.databricks.com/libraries.html#upload-a-jar-python-egg-or-python-wheel" target="_blank">https://docs.databricks.com/libraries.html#upload-a-jar-python-egg-or-python-wheel</A> </P> Tue, 15 Oct 2019 06:05:00 GMT https://community.databricks.com/t5/data-engineering/how-can-i-add-jars-quot-spark-jars-quot-to-pyspark-notebook/m-p/27684#M19545 shyam_9 2019-10-15T06:05:00Z