topic Re: How can I integrate DataBricks into PyCharm? in Data Engineering

How can I integrate DataBricks into PyCharm?

AdamArold — Thu, 29 Mar 2018 12:05:26 GMT

Editing notebooks on DataBricks is rather cumbersome because it lacks a lot of features IDEs like PyCharm have.

Another problem is that a DataBricks notebook comes with some local state which are not present on my computer.

How can I edit notebooks using PyCharm on my computer?

I know there is an sbt plugin but I don't want to bother with Scala.

Re: How can I integrate DataBricks into PyCharm?

George_Qiao — Thu, 14 Jun 2018 22:44:45 GMT

Same question here.

Re: How can I integrate DataBricks into PyCharm?

patrickcostello — Fri, 20 Jul 2018 05:54:12 GMT

Same question here

Re: How can I integrate DataBricks into PyCharm?

JaswanthGarudac — Fri, 22 Feb 2019 21:58:41 GMT

Hello @Adam Arold @Jonathansmith @patrickhcostello @Adam Arold to integrate PyCharm with databricks you need to use " pip install databricks-connect " in command line and configure it with your cluster details. test command "databricks-connect test"

Re: How can I integrate DataBricks into PyCharm?

SimonD_Morias — Thu, 21 Mar 2019 08:47:41 GMT

The documents are out for databricks-connect: https://docs.azuredatabricks.net/user-guide/dev-tools/db-connect.html

I've also written up about a few limitations I have found - some with workarounds: https://datathirst.net/blog/2019/3/7/databricks-connect-limitations