I have to 2 questions about elapsed job runtimes. The same Scoring notebook is run 3 times as 3 Jobs. The jobs are identical, same PetaStorm code, CPU cluster config ( not Spot cluster) and data but have varying elapsed runtimes. Elapsed runtimes...
The Azure Create Workspace function, configures the Managed Resource Group Storage Account as GRS. How can I create the workspace with the Storage Account as Local Redundant Storage (LRS)? What is the downside if code is stored in GitHub and the...
We are converting Pyspark dataframe to Tensorflow using PetaStorm and have encountered a “data adapter” error. What do you recommend for diagnosing and fixing this error?https://docs.microsoft.com/en-us/azure/databricks/applications/machine-learning/...
Hi,From the Petastorm example: # Make sure the number of partitions is at least the number of workers which is required for distributed training.I am testing an recommendation to not use Autoscaling. I'll report back with findings.Nathan
