- To add to @werners point, I would use ADF to load SQL server data into ADLS Gen 2 as json.
- Then Load these Raw Json files from your ADLS base location into a Delta table using Autoloader.
- Delta Live Tables can be used in this scenario.
- You can also register for this workshop that walks you through the code and explains how to get your data from source to databricks using autoloader. https://pages.databricks.com/202210-AMER-FE-102022-St-Louis-Lakehouse-Hands-On-Lab-_01-Registration-...
