cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks Connect Vscode. Cannot find package installed on cluster

brady_tyson
New Contributor

I am using Databricks Connect v2 to connect to a UC enabled cluster. I have a package I have made and installed in a wheel file on the cluster. 

When using vscode to import the package and use it I get a module not found error when running cell by cell or debugging.

How can I use the package in my local development environment with databricks connect?

1 REPLY 1

VZLA
Databricks Employee
Databricks Employee

Hi @brady_tyson just checking—are you still facing this issue with using your custom package and Databricks Connect? If so, here are a few questions to collect some data points about your setup:

 

  • Is Databricks Connect properly installed and configured in your local environment?
  • Is the package also installed locally?
  • Is the Python path in your local environment updated to include the package's directory?
  • Are you using the Databricks extension in Visual Studio Code for built-in support with Databricks Connect?
  • When running or debugging in VS Code, is the Databricks Connect configuration active to execute code on the cluster?

For now I would say install the same wheel file locally so that your development environment can import the package. Then Databricks Connect will find and use it when you run or debug code in VS Code. I couldn't find this explicitly mentioned, more like implicit. If you have solve this already, could you please share your solution? Greatly appreciated.