https://community.databricks.com/t5/data-engineering/installing-python-modules-on-databricks-job-clusters/m-p/32404#M23605 <P>Different than all-purpose clusters, the databricks job new cluster configuration window does not have a "Libraries" tab, in which specific python modules could be installed. </P><P>What's the best practice for installing python modules on such clusters? </P> Thu, 30 Dec 2021 11:59:12 GMT barashe 2021-12-30T11:59:12Z https://community.databricks.com/t5/data-engineering/installing-python-modules-on-databricks-job-clusters/m-p/32404#M23605 <P>Different than all-purpose clusters, the databricks job new cluster configuration window does not have a "Libraries" tab, in which specific python modules could be installed. </P><P>What's the best practice for installing python modules on such clusters? </P> Thu, 30 Dec 2021 11:59:12 GMT https://community.databricks.com/t5/data-engineering/installing-python-modules-on-databricks-job-clusters/m-p/32404#M23605 barashe 2021-12-30T11:59:12Z https://community.databricks.com/t5/data-engineering/installing-python-modules-on-databricks-job-clusters/m-p/32405#M23606 <P>It turns out that the option exists outside of the cluster configuration scope, in the task configuration window itself - under "Advanced options" -&gt; "Add dependent libraries". </P> Sun, 02 Jan 2022 09:35:45 GMT https://community.databricks.com/t5/data-engineering/installing-python-modules-on-databricks-job-clusters/m-p/32405#M23606 barashe 2022-01-02T09:35:45Z