Hi @Erik_L,
As my colleague mentioned, to ensure continuous operation of the Delta Live Tables pipeline compute during Workflow runs, choosing a prolonged Databricks Job over a triggered Databricks Workflow is a reliable strategy. This extended job w...
Hi @dbx_deltaSharin,
When querying the individual partitions, the files are being read by using an S3 access point location while it is using the actual S3 name when reading the table as a whole. This information is fetched from the table metadata it...
Hi @dowdark, What is the error that you get when the pipeline tries to update the rows instead of performing an insert? That should give us more info about the problem
Please raise an SF case with us with this error and its complete stack trace.
Hi @dowdark Just a friendly follow-up. Have you had the opportunity to go through my colleague's response to your inquiry? Was it beneficial, or do you still require further assistance? Your response would be highly valued.
Hi @Graham Can you please try Low Shuffle Merge [LSM] and see if it helps? LSM is a new MERGE algorithm that aims to maintain the existing data organization (including z-order clustering) for unmodified data, while simultaneously improving performan...
