As an alternative environment for Serverless could be set in asset bundle job configuration.https://learn.microsoft.com/en-us/azure/databricks/dev-tools/bundles/jobs-tutorial#configure-a-job-that-uses-serverless-compute
Usually this problem is solved with autooptimize property.https://docs.databricks.com/en/delta/tune-file-size.html#auto-compaction-for-delta-lake-on-databricksFor Managed tables this option is enabled by default
