Databricks Community

Hi @Dhruv-22 ,  Based on the information you shared above, the "CREATE OR REPLACE" and "CREATE" commands in Databricks do have different behaviours, particularly when it comes to handling tables with specific target locations. The "CREATE OR REPLACE"...

I had the same issue, and my usage was similar to OP:base64(aes_encrypt(<clear_text>, unbase64(secret(<scope>, <key>))))Databricks support suggested to not call secret within the insert/update operation that writes to the table. After updating the py...

came across this matrix while reading about DLT what is read from complete and write to Incremental means ?

trial

I created a new schema and volume specifically for this testing and the names are all distinct from any other objects in the catalog.I did a quick double check just in case I somehow missed a duplicate and there were none.

Hey @jcoggs The problem looks legit though never occurred to me as I try to keep my mounts manually fed to the pipeline using a parameters or a variable by doing this you will have more control over your pipelines see if you could do the same in your...

There may be more information in the log. Look for "Cannot parse the zip archive."

It seems like a permission error.  Can you check if the managed identity has correct permissions to write to the volume?DLT should be supported to write into volumes.

Hey @param_sen Given your concerns about expensive joins and prioritizing analytics with flat raw data, here are some suggestions:Analyze the most common queries and reports you anticipate. Do they heavily rely on joins across dimensions? If not, the...