Databricks Community

pavlos_skev · 10-26-2023

Hello,We have encountered a weird issue in our (old) set-up that looks like a bug in the Unity Catalog. The storage account which we are trying to persist is configured via External Volumes.We have a pipeline that gets XML data and stores it in an RD...

pavlos_skev · 08-17-2023

Hello,We are migrating to Unity Catalog (UC), and for very few of our tables, we get the below error when trying to write or even display them. We are using UC enabled clusters, usually with runtime versions 12.2 LTS. The below error, when it happens...

pavlos_skev · 07-25-2024

I had the same issue with a similar JSON structure as yours. Adding the option "multiLine" set to true fixed it for me.df = (spark.readStream.format("cloudFiles") .option("multiLine", "true") .option("cloudFiles.schemaLocation", schemaLocation) ...

pavlos_skev · 10-31-2023

I will post here what worked resolving this error for us, in case someone else in the future encounters this.It turns out that this error appears in this case, when we were using the below command while the directory 'staging2' already exists. To avo...

pavlos_skev · 10-31-2023

Hello Kaniz,Something that I forgot to mention in the OP, is that we are using Unity Catalog volumes to connect to the storage account, that are tested and work properly. I found the solution which seems like a major bug, unless I am missing somethin...

Databricks Community

User Stats

User Activity

Invalid configuration value detected for fs.azure.account.key only when trying to save RDD

Potential Unity Catalog Bug: Invalid configuration value detected for fs.azure.account.keyInvalid

Re: Delta Live Table autoloader's inferColumnTypes does not work

Re: Invalid configuration value detected for fs.azure.account.key only when trying to save RDD

Re: Invalid configuration value detected for fs.azure.account.key only when trying to save RDD