I have a pipeline that has given me no problems up until today with the following error message:

com.databricks.pipelines.common.errors.deployment.DeploymentException: Failed to launch pipeline cluster 0307-134831-tgq587us: Attempt to launch cluster with invalid arguments. databricks_error_message: Spark failed to start: Driver unresponsive. Possible reasons: library conflicts, incorrect metastore configuration, and i...
This error is likely due to a misconfiguration in the pipeline.
Check the pipeline cluster configuration and associated cluster policy.

I ran the exact pipeline multiple times previously with the exact pipeline config and no issues have occurred until now.