Databricks Community

MaximeGendre

Hello,I massively deployed SQL Warehouses in our data Platform.Right now, most of them are running every hour (with some inactivity phasis) because of Power BI report/jobs schedules.To limit cost, I would like to stop/disable some on them on Friday e...

MaximeGendre · 08-11-2025

Hello :),I have noticed a regression in one of my job and I don't understand why.%python print("Hello 1") def toto(df, _): print("Hello 2") spark.readStream\ .format("delta")\ .load("/databricks-datasets/nyctaxi/tables/nyctaxi_yellow...

MaximeGendre · 02-19-2025

Hello,I'm trying to read data from Unity Catalog and insert it into an Oracle Database using an "On Premise" Dataiku.It works well for a small dataset ~600Kb/~150 000 rows.[14:51:20] [INFO] [dku.datasets.sql] - Read 2000 records from DB [14:51:20] [I...

MaximeGendre · 02-12-2025

Hello all, I'm designing a function to implement RLS on Unity Catalog for multiple tables of different size (1k to 10G rows).RLS will be applied on two columns and 150+ groups.I wonder what would be more performant :Solution 1: exhaustive (boring) li...

MaximeGendre · 09-09-2024

Hello, one my teammate is trying to put some obversability on our Databricks flows.When he tries to contact our Open Telemetry server, he gets a timeout.I had a look, and the same command (on the same Databricks workspace) works well with runtime 12....

MaximeGendre

Thank you @szymon_dybczak,Let's go with API option then.Can you please share with me the "best way" to submit an improvement idea ?

MaximeGendre · 08-12-2025

Hi @szymon_dybczak,thanks a lot for the quick and accurate answer I forgot that there was this limitation.

MaximeGendre · 10-31-2024

Hello,workspace files are not stored in the DBFS.If you want to use the CLI : first :%pip install -U -qqqq databricks-sdkthen :from databricks.sdk import WorkspaceClientclient = WorkspaceClient()for i in client.workspace.list(f'/<your_path>', recursi...

MaximeGendre · 09-10-2024

Hello,thank you for your answer.I tried to update library version and it was almost the solution.It realized it neither works in 12.2 but the output was pretty different and it misled me.Probably a network config to set up in the target server.

MaximeGendre · 09-09-2024

Hello,it would be interesting to test with the same runtime version.Does it work with a job running on a 13.3 ?

Databricks Community

User Stats

User Activity

Disable SQL Warehouse during week-ends

Structure stream : difference Unity Catalog vs Legacy

Dataiku connector limitation

RLS function : concat vs list

Curl command working in 12.2 but not in 13.3

Re: Disable SQL Warehouse during week-ends

Re: Structure stream : difference Unity Catalog vs Legacy

Re: List files in Databricks Workspace with Databricks CLI

Re: Curl command working in 12.2 but not in 13.3

Re: spark config not working in job cluster