Hi @Angus-Dawson 

• Use  Databricks Connect for local development/testing against a remote Databricks cluster—this ensures your code runs in the actual Databricks environment and databricks managed dbrs which are different from open-source versions((DBR) versions often include custom builds and backports of Spark and Delta Lake).
• Always validate and test on a real Databricks cluster before deploying to production.