Welcome to the Nashville Databricks Community! This is a forum for Databricks users in Tennessee to share questions, ideas and interests. We are based in the Nashville area / Middle Tennessee,, but are open to all Tennessans.
With Databricks MLR, HorovodRunner is provided which supports distributed training and inference with PyTorch. Here's an example notebook for your reference: PyTorchDistributedDeepLearningTraining - Databricks.