- 1441 Views
- 1 replies
- 0 kudos
The below code gives different result when executed using DB Connect and a Notebooksc = spark.sparkContext
a = sc.accumulator(0)
rdd = sc.parallelize([1, 2, 3])
def f(x):
global a
a.add(x)
rdd.foreach(f)
rdd.count()
print(a.value)
- 1441 Views
- 1 replies
- 0 kudos
Latest Reply
This is a known limitation that accumulators do not work with DB Connect.
- 1910 Views
- 1 replies
- 1 kudos
I'd like to edit Databricks notebooks locally using my favorite editor, and then use Databricks Connect to run the notebook remotely on a Databricks cluster that I usually access via the web interface.I run "databricks-connect configure" , as suggest...
- 1910 Views
- 1 replies
- 1 kudos
Latest Reply
Here is the link to the configuration properties https://docs.databricks.com/dev-tools/databricks-connect.html#step-2-configure-connection-properties
- 2822 Views
- 1 replies
- 0 kudos
Im getting some weird messages when trying to run my Dbconnect. I would like to know if there is a troubleshooting guide to solve Python version mismatch errors.
- 2822 Views
- 1 replies
- 0 kudos
Latest Reply
We have a troubleshooting section in our docs that could help you to solve this issue. Please check the docs here https://docs.databricks.com/dev-tools/databricks-connect.html#python-version-mismatch
- 2313 Views
- 1 replies
- 0 kudos
I would like to know if I can use Dbconnect to run all my structured streaming jobs.
- 2313 Views
- 1 replies
- 0 kudos
Latest Reply
Unfortunately, no. You cannot use Dbconnect for your streaming jobs. This is one of Dbconnect's limitations. For more details please check the docs: https://docs.databricks.com/dev-tools/databricks-connect.html#limitations
- 3020 Views
- 1 replies
- 0 kudos
I would like to know if I can connect using to DBconnect to any DBR version or if only the supported version will work?
- 3020 Views
- 1 replies
- 0 kudos
Latest Reply
Only the following Databricks Runtime versions are supported:Databricks Runtime 8.1 ML, Databricks Runtime 8.1Databricks Runtime 7.3 LTS ML, Databricks Runtime 7.3 LTSDatabricks Runtime 6.4 ML, Databricks Runtime 6.4Databricks Runtime 5.5 LTS ML, Dat...
- 1451 Views
- 1 replies
- 0 kudos
I would like to know if there is a way to connect to Databricks cluster using my IDE
- 1451 Views
- 1 replies
- 0 kudos
Latest Reply
Databricks connect allows you to connect your favorite IDE to Databricks clusters. You can find more details on how to set it up and install all the libraries https://docs.databricks.com/dev-tools/databricks-connect.html
