While materialised view doc says MVs support columns comments, this does not seem like the case for MVs created by DLT. For example, when trying to add a comment to a MV created by DLT, it errors:Any ideas on when this will be fixed/supported?
I created an Azure Databricks workspace with my Visual Studio Subsciption, so far everything has been working as expected although I have requested to increase CPU core limit once.I am now getting this "DataPlaneException" error in the DTL during "Wa...
When you use Workflows to orchestrate standard notebooks, they can share a single cluster. It will be awesome if we can achieve the same for DLT pipelines orchestrated in a Workflows Job.I understand DLT pipelines utilising their own special clusters...
Is "setting taskValues in DLT workbooks" supported?I tried setting a task value in a DLT workbook, but it does not seem supported, so downstream workbooks within the same workflows job cannot consume this task value.
Our SQL Warehouse Serverless Endpoint started failing from this morning (2022-08-23 18:00:00 UTC):“org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:Unable to build AWSGlueClient: com.amazonaws.SdkClientException: Unable to find...
Set taskValues as in https://docs.databricks.com/dev-tools/databricks-utils.html?_ga=2.245861126.342496647.1666732059-1594663795.1666643296#dbutils-jobs-taskvalues
According to both SQL and Python DLT documentations, "pivot" is not supported in DLT.So I wonder what are the complications of using "pivot" in such an unsupported way?
It was resolved by itself the next day, and apparently it was related to some bugs which hopefully Databricks would crush them soon and improve the whole serverless service
