Is Autoloader an option to load data to Databricks from Azure SQL?
Anonymous
Not applicable
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-24-2021 10:12 PM
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2021 03:12 AM
The autoloader cannot work with JDBC connection, it is a file-based on cloud storage
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2021 12:01 PM
If you are looking for incrementally loading data from Azure SQL, checkout one of our technology partners that support change-data-capture or setup debezium for sql-server.
These solutions could land data in a streaming fashion to kafka/kinesis/eventhub etc or to adls/s3/gcs. In the latter case, autoloader would come very handy to load data to delta tables.