Databricks

Oliver_Floyd · 10-17-2022

Hello ,For a support request, Microsoft support ask me to add spark.databricks.driver.strace.enabled trueto my cluster configuration.MS was not able to send me a link to the documentation and I did not find it on the databricks website.Can someone he...

Oliver_Floyd · 02-03-2022

Hello,In my use case, my data is pushed to an adls gen2 container called ingestAfter some data processing on a databricks cluster of the ingest workspace, I declare the associated table in an external metastore for this workspaceAt the end of this pr...

Oliver_Floyd · 03-10-2023

For information, upgrading python libraries does not resolve all problems.This code works fine on databricks in a notebook :import mlflow model = mlflow.spark.load_model('runs:/cb6ff62587a0404cabeadd47e4c9408a/model')Whereas it failed on intelliJ wit...

Oliver_Floyd · 03-10-2023

It looks like there are other issues. I saved the model generated with the code above in mlflowWhen I try to reload it with this code:import mlflow model = mlflow.spark.load_model('runs:/cb6ff62587a0404cabeadd47e4c9408a/model') It works in a notebook...

Oliver_Floyd · 03-09-2023

Good morning, For information the error is not at all related to the limitations of databricks connect. After various tests, in my case, it turns out that it is necessary to update the libraries of the venv used with databricks connect. Here are the ...

Oliver_Floyd · 03-08-2023

Hello,Same problem, here in France. @Kaniz Fatma Can we have some answers?

Oliver_Floyd · 11-16-2022

Hello @Kaniz Fatma ,We also have just learned that databricks-connect is deprecated and will be replaced by dbx.This is problematic for us because dbx does not allow to run/debug the code locally.Can you tell us if it is planned in the near future t...

Databricks

User Stats

User Activity

Where to find documentation about : spark.databricks.driver.strace.enabled

How to update external metastore cluster configuration on the fly ?

Re: databricks-connect error when executing sparkml

Re: databricks-connect 11.3

Re: databricks-connect error when executing sparkml

Re: databricks-connect error when executing sparkml

Re: How to use dbx for local development.