@letsflykite If you go to Databricks Guide -> Spark -> Configuring Spark you'll see a guide on how to change some of the Spark configuration settings using init scripts. On the near term roadmap will also be the ability to do these through the UI in...
@Xinh Huynh
Comments were temporarily disabled for version 1.3.4 as we worked on rolling out a new and enhanced version. Those will be available as of Databricks 1.4, which customers are gradually be upgraded to (and all should be upgraded by end of...
@kruhly Unfortunately right now you can't pass specific variable names, only constants. It's on our roadmap to improve/overhaul parameter passing, which would include this capability.
@Mohan Kolli
The simple way to terminate execution based on a condition is to throw an exception; doing so will cause the run to terminate immediately. However, doing so will also cause the job to have a 'Failed' status.
In order to to maintain corre...
