topic Databricks ADLS vs Azure Sql ? which is better for datawarehousing ? and why in Data Engineering

Databricks ADLS vs Azure Sql ? which is better for datawarehousing ? and why

Ak3 — Sat, 31 Dec 2022 09:18:03 GMT

Databricks ADLS vs Azure Sql ? which is better for datawarehousing ? and why

Re: Databricks ADLS vs Azure Sql ? which is better for datawarehousing ? and why

Rishabh-Pandey — Sat, 31 Dec 2022 16:30:54 GMT

hey @Arunkumar Shanmugasamy

A database stores the current data required to power an application. A data lake stores current and historical data for one or more systems in its raw form for the purpose of analyzing the data.

so for Datawarehousing according to me datalake will be the best option so i will go with Databricks ADLS as it has current + historical data also .

Re: Databricks ADLS vs Azure Sql ? which is better for datawarehousing ? and why

Aviral-Bhardwaj — Sun, 01 Jan 2023 08:02:46 GMT

Rishabh is right

Re: Databricks ADLS vs Azure Sql ? which is better for datawarehousing ? and why

Rishabh-Pandey — Sun, 01 Jan 2023 13:47:36 GMT

Thanks @Aviral Bhardwaj

Re: Databricks ADLS vs Azure Sql ? which is better for datawarehousing ? and why

Hubert-Dudek — Mon, 02 Jan 2023 15:35:14 GMT

Databricks is the data lake / lakehouse and Azure SQL is the database.

Re: Databricks ADLS vs Azure Sql ? which is better for datawarehousing ? and why

Ak3 — Sat, 28 Jan 2023 16:59:22 GMT

Hi Rishabh, thanks for your comment.

As we store data historically that means it might incur storage cost right..!! any comparison of 'storage cost' of Databricks ADLS compared to Azure sql ?

Also, lets say If I am running a query on top of 100GB data with some index set on the table properly. how much computing cost between Databricks compared to Azure Sql ?

Regards, Ak