Can DLT be used to ingest from JDBC and/or and on-prem database?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-30-2023 06:44 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-06-2024 01:27 PM
Hello @User16752244127 , I hope this message finds you well.
Delta Live Tables supports loading data from any data source supported by Databricks. You can find the datasources supported here Connect to data sources, and JDBC is one of them. You can also load external data using Lakehouse Federation for supported data sources. Because Lakehouse Federation requires Databricks Runtime 13.3 LTS or above, to use Lakehouse Federation your pipeline must be configured to use the preview channel.
Lakehouse Federation: https://docs.databricks.com/en/query-federation/index.html#what-is-lakehouse-federation
Load data from External Systems: https://docs.databricks.com/en/delta-live-tables/load.html#load-data-from-external-systems
What data sources connect to Databricks with JDBC? https://docs.databricks.com/en/connect/external-systems/index.html#what-data-sources-connect-to-data...
Best reagards,
Lucas Rocha