Can DLT be used to ingest from JDBC and/or and on-prem database?

User16752244127 — Tue, 30 May 2023 13:44:01 GMT

Re: Can DLT be used to ingest from JDBC and/or and on-prem database?

lucasrocha — Thu, 06 Jun 2024 20:27:17 GMT

Hello @User16752244127 , I hope this message finds you well.

Delta Live Tables supports loading data from any data source supported by Databricks. You can find the datasources supported here Connect to data sources, and JDBC is one of them. You can also load external data using Lakehouse Federation for supported data sources. Because Lakehouse Federation requires Databricks Runtime 13.3 LTS or above, to use Lakehouse Federation your pipeline must be configured to use the preview channel.

Lakehouse Federation: https://docs.databricks.com/en/query-federation/index.html#what-is-lakehouse-federation
Load data from External Systems: https://docs.databricks.com/en/delta-live-tables/load.html#load-data-from-external-systems
What data sources connect to Databricks with JDBC? https://docs.databricks.com/en/connect/external-systems/index.html#what-data-sources-connect-to-databricks-with-jdbc

Best reagards,
Lucas Rocha

topic Re: Can DLT be used to ingest from JDBC and/or and on-prem database? in Data Engineering

Can DLT be used to ingest from JDBC and/or and on-prem database?

Re: Can DLT be used to ingest from JDBC and/or and on-prem database?