https://community.databricks.com/t5/data-engineering/is-autoloader-an-option-to-load-data-to-databricks-from-azure/m-p/20049#M13528 <P>If you are looking for incrementally loading data from Azure SQL, checkout <A href="https://databricks.com/company/partners/technology" alt="https://databricks.com/company/partners/technology" target="_blank">one of our technology partners</A> that support change-data-capture or <A href="https://debezium.io/documentation/reference/connectors/sqlserver.html" alt="https://debezium.io/documentation/reference/connectors/sqlserver.html" target="_blank">setup debezium for sql-server</A>. </P><P></P><P>These solutions could land data in a streaming fashion to kafka/kinesis/eventhub etc or to adls/s3/gcs. In the latter case, <A href="https://docs.databricks.com/spark/latest/structured-streaming/auto-loader.html" alt="https://docs.databricks.com/spark/latest/structured-streaming/auto-loader.html" target="_blank">autoloader</A> would come very handy to load data to delta tables. </P><P></P><P></P> Fri, 25 Jun 2021 19:01:55 GMT sajith_appukutt 2021-06-25T19:01:55Z https://community.databricks.com/t5/data-engineering/is-autoloader-an-option-to-load-data-to-databricks-from-azure/m-p/20047#M13526 Fri, 25 Jun 2021 05:12:44 GMT https://community.databricks.com/t5/data-engineering/is-autoloader-an-option-to-load-data-to-databricks-from-azure/m-p/20047#M13526 Anonymous 2021-06-25T05:12:44Z https://community.databricks.com/t5/data-engineering/is-autoloader-an-option-to-load-data-to-databricks-from-azure/m-p/20048#M13527 <P>The autoloader cannot work with JDBC connection, it is a file-based on cloud storage </P> Fri, 25 Jun 2021 10:12:57 GMT https://community.databricks.com/t5/data-engineering/is-autoloader-an-option-to-load-data-to-databricks-from-azure/m-p/20048#M13527 User16826994223 2021-06-25T10:12:57Z https://community.databricks.com/t5/data-engineering/is-autoloader-an-option-to-load-data-to-databricks-from-azure/m-p/20049#M13528 <P>If you are looking for incrementally loading data from Azure SQL, checkout <A href="https://databricks.com/company/partners/technology" alt="https://databricks.com/company/partners/technology" target="_blank">one of our technology partners</A> that support change-data-capture or <A href="https://debezium.io/documentation/reference/connectors/sqlserver.html" alt="https://debezium.io/documentation/reference/connectors/sqlserver.html" target="_blank">setup debezium for sql-server</A>. </P><P></P><P>These solutions could land data in a streaming fashion to kafka/kinesis/eventhub etc or to adls/s3/gcs. In the latter case, <A href="https://docs.databricks.com/spark/latest/structured-streaming/auto-loader.html" alt="https://docs.databricks.com/spark/latest/structured-streaming/auto-loader.html" target="_blank">autoloader</A> would come very handy to load data to delta tables. </P><P></P><P></P> Fri, 25 Jun 2021 19:01:55 GMT https://community.databricks.com/t5/data-engineering/is-autoloader-an-option-to-load-data-to-databricks-from-azure/m-p/20049#M13528 sajith_appukutt 2021-06-25T19:01:55Z