Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-31-2026 09:30 PM
In DBR 16.1+ Databricks switched the BigQuery federation connector from JDBC to the BigQuery Storage API,
which parallelizes reads (more jobs) and transfers data directly from BigQuery to Databricks compute—so cross‑cloud queries (Azure → GCP) can incur BigQuery Storage API egress charges; maximize pushdown (filters, projections, limits, joins), reduce selected columns, and consider co‑locating compute (Databricks on GCP) to mitigate network costs.
Thank You
Pradeep Singh - https://www.linkedin.com/in/dbxdev
Pradeep Singh - https://www.linkedin.com/in/dbxdev