- 4650 Views
- 3 replies
- 2 kudos
MetadataChangedException Exception in databricks
Reading around 20 text files from ADLS, doing some transformations, and after that these files are written back to ADLS as a single delta file (all operations are in parallel through the thread pool). Here from 20 threads, it is writing to a single f...
- 4650 Views
- 3 replies
- 2 kudos
- 2 kudos
I have seen this problem with Identity column causing concurrency issues. But you seem to be getting similar error when writing to files. I don't know completely know your use case completely here, but would advice retrying this operation by managing...
- 2 kudos
- 1743 Views
- 1 replies
- 2 kudos
Mapping Control data - Maintained by Business User
We are ingesting our data from ADLS into databricks as delta table. After raw layer we need to refer to a control\mapping layer which defines certain logic\measure definition. This would be incorporated in the subsequent silver or gold layer. This co...
- 1743 Views
- 1 replies
- 2 kudos
- 2 kudos
Thanks for your response. Can business user without the help of any script modify any rows in the table after loading it onetime from CSV fiels?
- 2 kudos