Tableau Prep Save Output to Databricks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-01-2024 10:38 AM
Has anyone run into use cases where your data scientist/data engineer end users build Tableau Prep Flows and steps in Tableau Prep Flow require saving output back into Databricks? There appears to be no native support for this in Tableau Prep if the target is Databricks (see screenshot attached). We are running Databricks on Azure. May be able to leverage other tools to ingest the output back into Databricks...but
I was wondering if anyone could share creative ways for a workaround solution, suggestions are much appreciated!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-05-2024 10:45 PM
These are awesome suggestions. To expand on our setup, we also have Informatica Cloud - IICS (CMI, CDI, etc.) connected to the entire setup generally used for bringing data from a source (PaaS, SaaS, On-prem SQL, Flat Files or streaming devices) to Databricks zones and were thinking to have a similar workaround whereby Tableau Prep outputs to a CSV storage location and have our Informatica Cloud toolset pick up the files for ingestion at a 5mins frequency. We are also wondering if it may be best to stand up a dedicated Azure SQL or a standard MS SQL server for these types of workflows and native Tableau Prep support, then connect the Azure SQL or MS SQL Server tables to Databricks zones for ingestion. Essentially going back and forth on which workaround approach may be the most self-service and with fewer toolsets in between for this data movement.

