Databricks Connector for Looker Studio – No Aggregation Pushdown + 1M Row Limit

ahid
Databricks Employee
Databricks Employee

Hi Databricks Community,

I'm trying to understand which team is responsible for maintaining the Databricks Connector for Looker Studio . We’re currently facing a major performance bottleneck with how this connector operates.

Specifically:

  • The connector does not push down aggregate functions (e.g., SUM, AVG, COUNT) to Databricks.

  • Instead, it pulls all the raw data into Looker Studio and performs transformations there.

  • This is highly inefficient and quickly leads to hitting the 1 million row limit in Looker Studio.

  • Additionally, the lack of aggregation pushdown is severely impacting performance and usability for larger datasets.

We’re looking for:

  1. Clarity on which team (Databricks, Google, or another) is responsible for the development and maintenance of this connector.

  2. Any known workarounds, settings, or upcoming updates that support query pushdown or server-side aggregations.

  3. Any alternative approaches to integrate Databricks with Looker Studio that bypass this limitation.

Appreciate any guidance, especially from those who’ve run into similar challenges or from the Databricks team.

Thanks in advance!