- 2764 Views
- 2 replies
- 5 kudos
Share information between tasks in a Databricks job  You can use task values to pass arbitrary parameters between tasks in a Databricks job. You pass ...
Share information between tasks in a Databricks jobYou can use task values to pass arbitrary parameters between tasks in a Databricks job. You pass task values using the taskValues subutility in Databricks Utilities. The taskValues subutility provide...
- 2764 Views
- 2 replies
- 5 kudos
- 5 kudos
We urgently hope for this feature, but to date, we have found that it is only available in Python. Do you have any plans to support Scala?
- 5 kudos
- 1802 Views
- 0 replies
- 1 kudos
parallel run in job pipeline
I am trying to build a pipeline which deploys a ML model, and I want to build the pipeline in Workflow/jobs. In task of prediction of the model, I have hundreds of groups of input features, I use a for loop to get one group of input features and do ...
- 1802 Views
- 0 replies
- 1 kudos
- 3241 Views
- 4 replies
- 4 kudos
Catch-up Structured Stream hangs on last step of write job to delta sync using toTable
I'm running databricks version 10.4 on gcp. I'm running a structured stream trying to process historical files in a delta table on gcp cloud storage. This source delta table is big but maintained with OPTIMIZE.The stream repartitions which seems to b...
- 3241 Views
- 4 replies
- 4 kudos
- 4 kudos
Hi @Dwight Branscombe​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you....
- 4 kudos
- 5946 Views
- 5 replies
- 0 kudos
Error when running job in databricks
Hello, I am very new with databricks and MLflow. I faced with the problem about running job. When the job is run, it usually failed and retried itself, so it incasesed running time, i.e., from normally 6 hrs to 12-18 hrs. From the error log, it shows...
- 5946 Views
- 5 replies
- 0 kudos
- 0 kudos
Hey there @Tanawat Benchasirirot​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hea...
- 0 kudos