โ01-06-2024 03:21 AM
I tried to run this query and failing to load the data .What do I need to do load from federated data sources using DLT if this is not correct
CREATE OR REPLACE LIVE TABLE bulkuploadhistory
COMMENT 'Table generated for bulkuploadhistory.'
TBLPROPERTIES ('quality' = 'bronze')
AS
SELECT * FROM `master_data_dev`.dbo.bulkuploadhistory
But I get the error below
org.apache.spark.sql.AnalysisException: Unable to process statement for Table 'bulkuploadhistory'.
org.apache.spark.SparkException: [INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack trace.
java.lang.AssertionError: assertion failed: Hive table should not be stored in Unity Catalog
#DLT
#UC
โ01-07-2024 10:23 PM
Hi @Databricks-acn, One possible solution could be to set the Spark configuration spark.sql.hive.convertMetastoreOrc to ....
To load data from federated data sources using DLT, you can follow these steps:
โ01-08-2024 05:33 PM
When will be the Unity catalogue will be generally available for production workloads in DLT. I can currently see its in preview while trying to create the pipeline
โ01-09-2024 12:04 AM
Hi @Databricks-acn, I donโt have a specific date for when the Unity Catalog will be generally available for production workloads in Delta Live Tables (DLT). As you mentioned, it is currently in public preview.
โ01-09-2024 12:07 AM
Considering the databricks release cycles , is there any tenative dates that I can be aware of so that I can plan for my production releases
โ01-18-2024 02:51 AM
Thank you for posting your question in our community! We are happy to assist you.
To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?
This will also help other community members who may have similar questions in the future. Thank you for your participation and let us know if you need any further assistance!
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group