cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
dollyb
Contributor II
since ‎02-21-2024
3 weeks ago

User Stats

  • 26 Posts
  • 1 Solutions
  • 7 Kudos given
  • 2 Kudos received

User Activity

Databricks Connect and DBR 16.4 LTS @ Scala 2.13

3 weeks ago
Hi there,we're running Scala jobs on Databricks and I was eager to finally upgrade to Scala 2.13. However, Databricks Connect 16.4.x doesn't handle Scala versioning, so all dependencies are tied to Scala 2.13. It's rather tedious to exclude all 2.12 ...

Accessing Workspace / Repo file works in notebook, but not from job

12-19-2024
In a notebook attached to.a normal personal cluster I can successfully do this:%fs ls file:/Workspace/Repos/$userName/$repoName/$folderNameWhen I run an init-script on a UC volume that the does the same thing, I'm getting this error:ls: cannot access...

Logging to an external location via UC volume

12-12-2024
The way I understand it, mount points are deprecated in UC. db.fs.mount() doesn't even seem to work in newer DB runtimes.But what is the solution when Databricks features don't allow using UC volumes? E.g. specifying a compute's logging path won't wo...

Differences between Spark SQL and Databricks

04-15-2024
Hello,I'm using a local Docker Spark 3.5 runtime to test my Databricks Connect code. However I've come across a couple of cases where my code would work in one environment, but not the other.Concrete example, I'm reading data from BigQuery via spark....

How to detect if running in a workflow job?

03-03-2024
Hi there,what's the best way to differentiate in what environment my Spark session is running? Locally I develop with databricks-connect's DatabricksSession, but that doesn't work when running a workflow job which requires SparkSession.getOrCreate()....
View more
Kudos from