- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-17-2023 08:07 AM - edited 10-17-2023 08:26 AM
Hi All,,
quick question:
Is this correct data flow pattern: Databricks -> Az SQL -> Tableau??
Or does it have to go through ADLS: Databricks -> ADLS -> Az SQL - > Tableau?
Also, is it better to leverage databricks lakehouse sql warehouse capability as it has native tableau connector?
Thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-17-2023 08:26 AM
Both are possible,
but I prefer saving data on a data lake first before putting it in a database (option 2).
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-17-2023 08:30 AM
Also, is it better to leverage databricks lakehouse sql warehouse capability as it has native tableau connector?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-17-2023 10:23 PM
I would not call it 'better' per se. A lakehouse is a more modern approach to a classic datawarehouse, using flexible distributed cloud compute, cheap storage and open file formats.
If you have an existing environment, which works well, that is heavily tied to a certain vendor (like MS f.e.) a lakehouse might not be for you (although it is perfectly possible to do so).
But if you need to reengineer an existing warehouse, or start over,... I would definitely consider a lakehouse.