Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
From my experience spark functionality generally don't have breaking changes, regarding other libraries it is so much that it doesn't make sense to go through it. Maybe just test your notebooks under 10.1 and compare results with 8.0
From my experience spark functionality generally don't have breaking changes, regarding other libraries it is so much that it doesn't make sense to go through it. Maybe just test your notebooks under 10.1 and compare results with 8.0
If you want to know the version of Databricks runtime in Azure after creation: Go to Azure Data bricks portal => Clusters => Interactive Clusters => here you can find the run time version. For more details, refer "Azure Databricks Runtime versions".