topic Re: Error message when editing schedule cron expression on job in Data Engineering

Error message when editing schedule cron expression on job

165036 — Mon, 01 Aug 2022 03:43:40 GMT

When attempting to edit the schedule cron expression on one of our jobs we receive the following error message:

Cluster validation error: Validation failed for spark_conf, spark.databricks.acl.dfAclsEnabled must be false (is "true")

The spark.databricks.acl.dfAclsEnabled property on the jobs cluster is currently set to false. Therefore the error message if misleading and there must be some other reason the update is failing.

Any change to the schedule cron expression fails with this error. E.g. changing the cron expression from 35 0 1/3 * * ? to 34 0 1/3 * * ?.

Update

We get the same error even when creating a new job. So this seems to be a major and more widespread issue.

Re: Error message when editing schedule cron expression on job

Vivian_Wilfred — Mon, 01 Aug 2022 22:36:20 GMT

Hi @michael.voet michael.voet , do you, by any chance have a cluster policy attached to the job cluster? Please check if the cluster policy has any restrictions on spark_conf - spark.databricks.acl.dfAclsEnabled.

Re: Error message when editing schedule cron expression on job

165036 — Mon, 01 Aug 2022 23:50:36 GMT

Yes we do. However we tried again this morning and despite still having that restriction in place, we're no longer getting that error message. It seems like this was a temporary bug that's now been resolved.

Re: Error message when editing schedule cron expression on job

165036 — Thu, 04 Aug 2022 00:23:09 GMT

FYI this was a temporary Databricks bug. Seems to be resolved now.