Databricks Looker Studio connector

[Noortje]

Hi all! 

The Databricks Looker Studio connector has now been available for a few weeks. Tested the connector but running into several issues: 

• I am used to working with dynamic queries, so I am able to use date parameters (similar to BigQuery Looker Studio connector). This feature is not available at this moment. 
• Numbers are incorrect / missing when creating charts. Examples are: (1) tables with “no data”, (2) incomplete line graphs and (3) wrong pivot tables. 

My questions are: 

1. Are people running into similar issues? 
2. Does anyone know an alternative (third party) connector/tool between Databricks and Looker Studio? The ability to use date parameters is a requirement. 

Thanks! 😁 

[Kaniz]

Hi @Noortje, It’s unfortunate that you’re encountering issues with the Databricks Looker Studio connector. Let’s address your questions:

1. Dynamic Queries and Date Parameters:

   • I understand that you’re accustomed to using dynamic queries with date parameters, similar to what’s available in the BigQuery Looker Studio connector.
   • As of now, the Databricks Looker Studio connector does not support this feature directly.
   • However, there might be workarounds or alternative approaches to achieve similar functionality. You could explore using Looker’s native features for dynamic filtering or consider customizing your queries within Looker itself.

2. Incorrect or Missing Numbers in Charts:

   • It’s frustrating when charts don’t display accurate data. Here are some steps to troubleshoot:
     • Check Data Sources: Ensure that your data sources are correctly configured in Looker Studio.
     • Refresh Data Source Fields: Sometimes refreshing the data source fields can resolve discrepancies.
     • Reconnect Data Sources: Try reconnecting the data sources to see if that resolves the issue.
     • Remove and Re-add Data Sources: Remove the data sources from your reports and then add them back.
     • Create a New Data Source: Create a new data source to see if it works correctly.
     • Review Underlying Data Changes: Verify if there have been any changes in the underlying data that might affect the charts.

3. Alternative Connectors or Tools:

   • While the Databricks Looker Studio connector is the official integration, you might explore third-party connectors or custom solutions.
   • One potential avenue is leveraging Databricks’ REST API. Although it’s not a direct connector, you could build a custom solution using this API to bridge the gap between Databricks and Looker Studio.
   • Additionally, consider reaching out to the Looker community or exploring other BI tools that integrate well with Databricks.

[Noortje]

Hi Kaniz, 

Thanks for your message! 

1. Dynamic Queries and Date Parameters: The goal is to create a date filter based on 2 date fields instead of 1, so different start_date & end_date fields. Do you have an example of how to fix this via dynamic filtering or customizing a queries within Looker itself? Did not manage to fix this yet. 
2. Incorrect or Missing Numbers in Charts: tried everything before and multiple charts are still not working. Do you receive similar messages about this? 
3. Alternative Connectors or Tools: thanks will dive into this option!

[Noortje]

Hi @Kaniz 

Hope you're doing well! I am very curious about the following thing: 

• However, there might be workarounds or alternative approaches to achieve similar functionality. You could explore using Looker’s native features for dynamic filtering or consider customizing your queries within Looker Studio itself.

Do you have an example and do you have experience with this? Looking for a way to use different date fields as start_date and end_date for the date filter. Tried everything + can’t find anything online. 

Thanks! ☺️