topic Re: How to NOT install or disable or uninstall Databricks Delta Live Tables dlt module on jobs clust in Administration & Architecture

How to NOT install or disable or uninstall Databricks Delta Live Tables dlt module on jobs cluster?

matthiasjg — Wed, 02 Oct 2024 12:54:39 GMT

I need to NOT have the Databricks Delta Live Tables (DLT) Python stub installed on job cluster b/c of naming conflict w/ pip library dlt (and I also don't need delta live tables).

There is no "simple" way of uninstalling. It's not installed via pip as databricks-dlt but as

Also this doesn't do the trick.

Thx in advance!

Re: How to NOT install or disable or uninstall Databricks Delta Live Tables dlt module on jobs clust

matthiasjg — Fri, 04 Oct 2024 13:31:10 GMT

For anyone facing a similar problem: I've addressed the issue of the dlt module conflict on my job cluster, by using an init script to remove the dlt module from the cluster's Python environment.

Simply by doing:

%bash #!/bin/bash rm -rf /databricks/spark/python/dlt

hth