topic Re: Unable to load data in DLT tables from Federated data sources in Data Engineering

Unable to load data in DLT tables from Federated data sources

Databricks-acn — Sat, 06 Jan 2024 11:21:49 GMT

I tried to run this query and failing to load the data .What do I need to do load from federated data sources using DLT if this is not correct

CREATE OR REPLACE LIVE TABLE bulkuploadhistory COMMENT 'Table generated for bulkuploadhistory.' TBLPROPERTIES ('quality' = 'bronze') AS SELECT * FROM `master_data_dev`.dbo.bulkuploadhistory

But I get the error below

org.apache.spark.sql.AnalysisException: Unable to process statement for Table 'bulkuploadhistory'. org.apache.spark.SparkException: [INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack trace. java.lang.AssertionError: assertion failed: Hive table should not be stored in Unity Catalog

#DLT

#UC

Re: Unable to load data in DLT tables from Federated data sources

Databricks-acn — Tue, 09 Jan 2024 01:33:13 GMT

When will be the Unity catalogue will be generally available for production workloads in DLT. I can currently see its in preview while trying to create the pipeline

Re: Unable to load data in DLT tables from Federated data sources

Databricks-acn — Tue, 09 Jan 2024 08:07:56 GMT

Considering the databricks release cycles , is there any tenative dates that I can be aware of so that I can plan for my production releases