Databricks SQL endpoint as Linked Service in Azure Data Factory

[shadowinc]

We have a special endpoint that grants access to delta tables and we want to know if we can use SQL endpoints as a linked service in ADF.

If yes then which ADF-linked service would be suitable for this?

Appreciate your support on this.

[Kaniz_Fatma]

Hi @shadowinc, You can use private endpoints in Azure Data Factory (ADF) to securely access Delta tables. These private endpoints allow communication between ADF and services like Azure Blob storage and Azu...¹.

Here are the steps to set it up:

1. Create a Data Factory:

   • If you haven’t already, create an Azure Data Factory instance.
   • You can use the Azure Data Factory user interface (UI) to create a pipeline.

2. Prepare Your Blob Storage and SQL Database:

   • Create a source blob in Azure Blob storage.
   • Upload data (e.g., an emp.txt file) to the blob storage.
   • Create a sink SQL table in your Azure SQL Database (e.g., dbo.emp).

3. Configure Linked Services:

   • Go to the Manage tab in ADF.
   • Under Linked services, select + New.
   • Choose the SQL Server tile and input the FQDN of your on-premises SQL Server, along with the username and password. Test the connection².

4. Or Use Azure SQL Managed Instance:

   • Alternatively, you can create a linked service for Azure SQL Database Managed Instance.
   • Input the host of your SQL Managed Instance, along with the username and password³.

Let me know if you need further assistance! 😊