Databricks Community

thains · 12-08-2023

I’ve run into an error that I can't figure out how to debug. We're trying to use terraform through a service account. I don’t know if it’s a permissions issue on Databricks, in our account, or in AWS, but it seems that something is being blocked some...

thains · 12-27-2022

I'm getting an error when I try to create a DLT Pipeline from a bunch of third-party app-usage data we have. Here's the error message:Found invalid character(s) among ' ,;{}()\n\t=' in the column names of your schema. Please upgrade your Delta table ...

thains · 12-08-2023

Ok. I found the issue here. We had a *second* place where we were setting up the databricks provider, which I had not updated with the proper client credentials.

thains · 02-13-2023

I found this other forum thread that looks potentially useful, but I can’t figure out either how to translate it to SQL to handle JSON, nor how to get the pipeline I’m working with to interpret the Python. When I switch to Python, it complains about ...

thains · 02-07-2023

That did not help, sadly. However, I think I've identified the actual issue... See my comment from Feb 3rd.

thains · 02-03-2023

It appears the problem is that the json files have keys with spaces in the names, like this:"CT App Version":"3.5.6.6"I've checked and that is supposedly a valid json key, even though it's not standard. Unfortunately, these files are generated by a t...

thains · 01-03-2023

I added that version to my table definition, yes. Did I do it right? My table definition is in the OP.

Databricks Community

User Stats

User Activity

Error: cannot create mws storage configurations: default auth: cannot configure default credentials.

Setting up my first DLT Pipeline with 3rd party JSON data

Re: Error: cannot create mws storage configurations: default auth: cannot configure default credenti

Re: Setting up my first DLT Pipeline with 3rd party JSON data

Re: Setting up my first DLT Pipeline with 3rd party JSON data

Re: Setting up my first DLT Pipeline with 3rd party JSON data

Re: Setting up my first DLT Pipeline with 3rd party JSON data