How to Develop Locally on Databricks with your Favorite IDE

dbx is a Databricks Labs project that allows you to develop code locally and then submit against Databricks interactive and job compute clusters from your favorite local IDE (AWS | Azure | GCP) such as VS Code, PyCharm, IntelliJ, or Eclipse.

dbx is an extension of the Databricks CLI and also makes it easy to manage multiple execution environments and deployment configurations as well as pre-built templates for integration with popular CI tools such as GitHub Actions, Azure DevOps, and GitLab.

Databricks has an official extension for VS Code to be able to execute code written locally against jobs or all purpose clusters. In addition, there is an official Databricks Driver for SQLTools in VS Code to browse SQL objects and run SQL queries in Databricks workspaces from VS Code.

Let us know in the comments if you have had a chance to test out dbx or our VS Code plugins for local IDE development!