cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Databricks Connect Vscode. Cannot find package installed on cluster

brady_tyson
New Contributor

I am using Databricks Connect v2 to connect to a UC enabled cluster. I have a package I have made and installed in a wheel file on the cluster. 

When using vscode to import the package and use it I get a module not found error when running cell by cell or debugging.

How can I use the package in my local development environment with databricks connect?

1 REPLY 1

VZLA
Databricks Employee
Databricks Employee

Hi @brady_tyson just checkingโ€”are you still facing this issue with using your custom package and Databricks Connect? If so, here are a few questions to collect some data points about your setup:

 

  • Is Databricks Connect properly installed and configured in your local environment?
  • Is the package also installed locally?
  • Is the Python path in your local environment updated to include the package's directory?
  • Are you using the Databricks extension in Visual Studio Code for built-in support with Databricks Connect?
  • When running or debugging in VS Code, is the Databricks Connect configuration active to execute code on the cluster?

For now I would say install the same wheel file locally so that your development environment can import the package. Then Databricks Connect will find and use it when you run or debug code in VS Code. I couldn't find this explicitly mentioned, more like implicit. If you have solve this already, could you please share your solution? Greatly appreciated.

 

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group