No, the Databricks S3 commit service is not guaranteed to be enabled by default in the AWS classic compute plane. The configuration may vary based on your specific workspace setup.
How can it be enabled?
To enable the Databricks S3 commit service, follow these steps:
- Ensure proper instance profiles are configured to grant clusters appropriate access to S3 buckets.
- Configure Spark parameters to explicitly enable the service and disable conflicting optimizations like direct uploads.
https://docs.databricks.com/en/security/network/classic/s3-commit-service.html
