cancel
Showing results for 
Search instead for 
Did you mean: 
User16789201666
Databricks Employee
Databricks Employee
since ‎08-21-2021
Saturday

User Stats

  • 37 Posts
  • 3 Solutions
  • 0 Kudos given
  • 6 Kudos received

User Activity

You can use change data feed feature of delta tables as described here: https://docs.databricks.com/delta/delta-change-data-feed.html
A common option is to use AWS DMS, https://databricks.com/blog/2019/07/15/migrating-transactional-data-to-a-delta-lake-using-aws-dms.html
Using Ganglia you can monitor how busy is the GPU(s). Increasing the batch size would increase that utilization. Bigger batches improve how well each batch updates the model (up to a point) with more accurate gradients. That in turn can allow traini...
It’s advantageous to stop running trials if progress has stopped. Hyperopt offers an early_stop_fn parameter, which specifies a function that decides when to stop trials before max_evals has been reached. Hyperopt provides a function no_progress_loss...
This means that no trial completed successfully. This almost always means that there is a bug in the objective function, and every invocation is resulting in an error. See the error output in the logs for details. In Databricks, the underlying error ...
Kudos from