Databricks Community

pdiamond · 01-22-2025

Connecting Pentaho Ctools dashboards to Databricks using JDBC to a serverless dbSQL Warehouse, it works fine on the initial load, but then if we leave it idle for awhile and come back we get this error:[Databricks][JDBCDriver](500593) Communication l...

pdiamond · 12-20-2024

Is there any way to specify optional JDBC parameters like batchSize through the External Connections created in Unity Catalog? (specifically I'm trying to speed up data retrieval from a SQL Server database)

pdiamond · 12-19-2024

Outside of running jobs with different users, is there any way for me to run a notebook (or even better a cell within a notebook) as either a different user or a specific role that is not my user default?I'm trying to find an easy way to test data ma...

pdiamond

I figured it out this morning. You have to use an underscore in the yaml file instead of a dash. This works for me: - name: "DATABRICKS_WAREHOUSE_ID" valueFrom: "sql_warehouse"

pdiamond

I'm running into the same problem. Did you ever figure it out?

pdiamond · 02-11-2025

I've found the JDBC query to be faster than the federated query because in our testing, the federated query does not pass down the full query to the source database. Instead, it's running "select * from table", pulling all of the data into Databricks...

pdiamond · 01-30-2025

I should have mentioned that we're using AuthMech=3 and in the JDBC docs (Databricks JDBC Driver Installation and Configuration Guide) I don't see any relevant timeout settings that would apply in that scenario. Am I missing something?

pdiamond · 01-21-2025

Is this still being investigated by Databricks? I'm seeing similar behavior that's costing us a lot of money.

Databricks Community

User Stats

User Activity

JDBC Invalid SessionHandle with dbSQL Warehouse

Optional JDBC Parameters in external connection

Run a notebook as a different user or role

Re: Streamlit app on Databricks doesn't recognise the DATABRICKS_WAREHOUSE_ID in the yaml file

Re: Streamlit app on Databricks doesn't recognise the DATABRICKS_WAREHOUSE_ID in the yaml file

Re: Performance Issue with UC Read from Federated SQL Table vs JDBC Read from SQL Server

Re: JDBC Invalid SessionHandle with dbSQL Warehouse

Re: (Big) Problem with SQL Warehouse Auto stop