Showing results for 
Search instead for 
Did you mean: 
New Contributor III
since ‎02-21-2024

User Stats

  • 12 Posts
  • 0 Solutions
  • 5 Kudos given
  • 1 Kudos received

User Activity

Hello,I'm using a local Docker Spark 3.5 runtime to test my Databricks Connect code. However I've come across a couple of cases where my code would work in one environment, but not the other.Concrete example, I'm reading data from BigQuery via spark....
Hi there,what's the best way to differentiate in what environment my Spark session is running? Locally I develop with databricks-connect's DatabricksSession, but that doesn't work when running a workflow job which requires SparkSession.getOrCreate()....
Hi,I'm using Databricks Connect to run Scala code from IntelliJ on a Databricks single node cluster.Even with the simplest code, I'm experiencing this error:org.apache.spark.SparkException: INTERNAL: org.ap...
Kudos from