cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
JordanYaker
Contributor
since ‎09-23-2022
‎12-11-2023

User Stats

  • 20 Posts
  • 0 Solutions
  • 2 Kudos given
  • 11 Kudos received

User Activity

DAB "bundle deploy" Dry Run

12-11-2023
Is there a way to perform a dry-run with "bundle deploy" in order to see the job configuration changes for an environment without actually deploying the changes?

Has anyone else seen state files disappear in low-volume delta tables?

06-04-2023
I have some Delta tables in our dev environment that started popping up with the following error today:py4j.protocol.Py4JJavaError: An error occurred while calling o670.execute. : org.apache.spark.SparkException: Job aborted due to stage failure: Tas...

Integration options for Databricks Jobs and DataDog?

05-30-2023
I know that there is already the Databricks (technically Spark) integration for DataDog. Unfortunately, that integration only covers the cluster execution itself and that means only Cluster Metrics and Spark Jobs and Tasks. I'm looking for somethin...

Batch Doesn't Exist Failure

05-20-2023
I have a job that's been working perfectly fine since I deployed it earlier this month. Last night, however, one of the tasks within the job started failing with the following error:java.lang.IllegalStateException: batch 4 doesn't exist at org.apac...

Why is Delta Lake creating a 238.0TiB shuffle on merge?

02-24-2023
I'm frankly at a loss here. I have a task that is consistently performing just awfully. I took some time this morning to try and debug it and the physical plan is showing a 238TiB shuffle:== Physical Plan == AdaptiveSparkPlan (40) +- == Current Plan...
View more
Kudos from
Kudos given to