ilir_nuredini
Honored Contributor

Hello @Nick_Pacey ,

Databricks has recently introduced Lakeflow Connect and it supports ingesting data from SQL Server. I have done some small experimentation which went all well but not at scale. It looks like a very promising option. To note that it is still in public preview.

You can refer to the documentation here: Managed connectors in Lakeflow Connect | Databricks Documentation
And if you wanna look into a more detailed doc for SQL Server you can check this article:
Efficient Data Ingestion from SQL Server with Lake... - Databricks Community - 122597

Hope that helps and I would definitely give it a shot to Lakeflow Connect.

Best, Ilir