Databricks Community

QueryingQuail · 03-05-2026

We are having some difficulties working with Onelake connections.What we have done:Set up a Databricks connection to OnelakeCreated a foreign catalogWe try to read using:import dlt @dlt.table def fabric_test(): return spark.read.table("fabric.db...

QueryingQuail · 02-10-2026

Hello all,We are currently working with ingestion of data from source systems using a mix of custom code and managed connectors (e.g. the Dynamics 365 (Synapse Link) connector) in conjunction with Auto CDC / Auto CDC from snapshot. I’m trying to unde...

QueryingQuail

Thank you.One of the constraints is that I cannot change any objects on the source. I was hoping that UC and the federation engine could handle any internal constraints automatically by creating the needed mapping layer. I guess this is not easily ha...

QueryingQuail · 03-31-2026

Hello all,We have a good amount of tables from an external ERP system that are being replicated to an existing dwh in an Azure SQL Server database.We have set up a foreign connection for this database and we can connect to the server and database. Sa...

QueryingQuail · 03-16-2026

Thank you all for the reply and please excuse the delay on my part - I've been away.I've read all three replies and this clarified all my questions and widened my understanding of foreign catalog handling within Unity.

QueryingQuail · 02-19-2026

Hello @saurabh18cs,Please excuse the late reply.I like the idea of instantiating metadata about the data itself and management of the data - into the data itself. Think e.g., about:__DATAPLATFORM_row_hash_id containing a md5 hash for each row__DATAPL...

QueryingQuail · 02-10-2026

Thank you, but I got so much by prompting an AI myself. Do you have real world experience of implementing this in a robust way across both managed connectors and custom ingestion?

Databricks Community

User Stats

User Activity

DLT pipeline cannot read from a Unity Catalog foreign catalog

Best practice for adding fixed metadata columns at point of ingestion

Re: Lakehouse federation for SQL server: database name with spaces

Re: Lakehouse federation for SQL server: database name with spaces

Re: DLT pipeline cannot read from a Unity Catalog foreign catalog

Re: Best practice for adding fixed metadata columns at point of ingestion

Re: Best practice for adding fixed metadata columns at point of ingestion