topic Re: Copying delta to Azure SQL DB. in Data Engineering

Copying delta to Azure SQL DB.

KVNARK — Thu, 22 Dec 2022 13:22:25 GMT

How to copy DELTA to AZURE SQL DB using ADF?

Earlier we are using parquet format. Now, We have converted parquet to Delta by using below command:

CONVERT TO DELTA parquet.path (Azure Blob Path)

daniel_sahal — Thu, 22 Dec 2022 13:44:53 GMT

You can use Azure Databricks Delta Lake linked service

(https://learn.microsoft.com/en-us/azure/data-factory/connector-azure-databricks-delta-lake?tabs=data-factory)

or source directly from Blob using Mapping data flow (https://learn.microsoft.com/en-us/azure/data-factory/format-delta)

Aviral-Bhardwaj — Fri, 23 Dec 2022 03:38:47 GMT

this is good details

Ajay-Pandey — Fri, 23 Dec 2022 04:08:54 GMT

Hi @Aviral Bhardwaj in ADF there is an option of a delta lake file you can directly save your file in delta lake format.

Aviral-Bhardwaj — Fri, 23 Dec 2022 04:25:57 GMT

amazing , never seen this before,thanks

KVNARK — Fri, 23 Dec 2022 04:37:06 GMT

@Ajay Pandey is this recently introduced in Azure?

Ajay-Pandey — Fri, 23 Dec 2022 04:50:44 GMT

Yes,

Now you directly write data using azure databricks delta lake connector.

KVNARK — Fri, 23 Dec 2022 04:53:56 GMT

wow. great feature. Thanks a lot for letting the group know!!!