Databricks Community

MaximeGendre · 08-11-2025

Hello :),I have noticed a regression in one of my job and I don't understand why.%python print("Hello 1") def toto(df, _): print("Hello 2") spark.readStream\ .format("delta")\ .load("/databricks-datasets/nyctaxi/tables/nyctaxi_yellow...

MaximeGendre · 02-19-2025

Hello,I'm trying to read data from Unity Catalog and insert it into an Oracle Database using an "On Premise" Dataiku.It works well for a small dataset ~600Kb/~150 000 rows.[14:51:20] [INFO] [dku.datasets.sql] - Read 2000 records from DB [14:51:20] [I...

MaximeGendre · 02-12-2025

Hello all, I'm designing a function to implement RLS on Unity Catalog for multiple tables of different size (1k to 10G rows).RLS will be applied on two columns and 150+ groups.I wonder what would be more performant :Solution 1: exhaustive (boring) li...

MaximeGendre · 09-09-2024

Hello, one my teammate is trying to put some obversability on our Databricks flows.When he tries to contact our Open Telemetry server, he gets a timeout.I had a look, and the same command (on the same Databricks workspace) works well with runtime 12....

MaximeGendre · 06-12-2024

Hello,I administer a self-service oriented Databricks workspace and I notice that more and more users are storing their data in DBFS due to lack of knowledge.They are not specifying a location when creating their schema or they are not specifying a s...

MaximeGendre · 08-12-2025

Hi @szymon_dybczak,thanks a lot for the quick and accurate answer I forgot that there was this limitation.

MaximeGendre · 10-31-2024

Hello,workspace files are not stored in the DBFS.If you want to use the CLI : first :%pip install -U -qqqq databricks-sdkthen :from databricks.sdk import WorkspaceClientclient = WorkspaceClient()for i in client.workspace.list(f'/<your_path>', recursi...

MaximeGendre · 09-10-2024

Hello,thank you for your answer.I tried to update library version and it was almost the solution.It realized it neither works in 12.2 but the output was pretty different and it misled me.Probably a network config to set up in the target server.

MaximeGendre · 09-09-2024

Hello,it would be interesting to test with the same runtime version.Does it work with a job running on a 13.3 ?

MaximeGendre · 09-09-2024

Hello, Databricks admin account console is not linked to your Azure subscriptions.If you are owner of your sub, you will be admin of the workspaces instanciated in the sub. That's all.You need to find the identified Databricks admin for your company ...

Databricks Community

User Stats

User Activity

Structure stream : difference Unity Catalog vs Legacy

Dataiku connector limitation

RLS function : concat vs list

Curl command working in 12.2 but not in 13.3

How to disable DBFS storage

Re: Structure stream : difference Unity Catalog vs Legacy

Re: List files in Databricks Workspace with Databricks CLI

Re: Curl command working in 12.2 but not in 13.3

Re: spark config not working in job cluster

Re: Question regarding permission of azure databricks account console