cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
JTBS
Visitor
since yesterday
yesterday

User Stats

  • 2 Posts
  • 0 Solutions
  • 0 Kudos given
  • 0 Kudos received

User Activity

Databricks Connect - Will I ever have to Stop clean up Spark session when creating new per request

yesterday
I have API that triggers Spark calculations - with API hosted by Python 3.12 pod in AKS and connects to Databricks cluster using Databricks 18.1.1.Initially I was using getOrCreate call on my API requests and all works.But problem is - as Spark sessi...

DatabricksConnect from Python/AKS environment calling Databricks Cluster: Spark Query Call Hangs

yesterday
I have Python 3.12 Pod in AKS using DatabricksConnect 18.1.1 connecting to Databricks cluster 18.1.All works great and normally I see no issues running series of Spark queries But once a while, even without any load on dedicated cluster we have, quer...