cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
MarsSu
New Contributor II
since ‎04-20-2023
‎06-26-2023

User Stats

  • 6 Posts
  • 0 Solutions
  • 1 Kudos given
  • 0 Kudos received

User Activity

How to implement merge multiple rows in single row with array and do not result in OOM?

06-22-2023
Hi, Everyone.Currently I try to implement spark structured streaming with Pyspark. And I would like to merge multiple rows in single row with array and sink to downstream message queue for another service to use. Related example can follow as:* Befor...

Does driver node of job compute have HA?

05-11-2023
I would like to confirm and discuss HA mechanism about driver node of job compute. Because we can image driver node just like master node of cluster. In AWS EMR, we can setup 2 master node so that one of master node failed, another master node can re...

Databricks job about spark structured streaming zero downtime deployment in terraform.

04-20-2023
I would like to ask how to implement zero downtime deployment of spark structured streaming in databricks job compute with terraform. Because we will upgrade spark application code version. But currently we found every deployment will cancel original...