cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
djfliu
New Contributor III
since ‎10-03-2022
‎06-26-2023

User Stats

  • 3 Posts
  • 0 Solutions
  • 0 Kudos given
  • 6 Kudos received

User Activity

Help optimizing large empty gaps where no executors are running jobs in Spark UI. Structured streaming writing.

10-03-2022
Hi, I'm running a structured streaming job on a pipeline with a medallion architecture. In my silver layer, we are reading from the bronze layer using structured streaming, and writing the stream to the silver layer w/ a foreachbatch function doing s...

Getting a com.databricks.s3commit.S3CommitRejectException exception error when using structured streaming to write to a delta table on s3.

10-03-2022
The full error is below: An error occurred while calling o95098.execute.: com.databricks.s3commit.S3CommitRejectException: rejected by server26 times at com.databricks.s3commit.S3CommitClientImpl.commit(S3CommitClient.scala:303)It was a one-off inci...