Hubert-Dudek
Databricks MVP

 

SET legacy_time_parser_policy = legacy;

https://docs.databricks.com/aws/en/sql/language-manual/parameters/legacy_time_parser_policy 

https://docs.getdbt.com/docs/core/connect-data-platform/databricks-setup

your_profile_name:
  target: dev
  outputs:
    dev:
      type: databricks
      host: YOURORG.databrickshost.com
      http_path: /sql/1.0/warehouses/XXXX
      schema: YOUR_SCHEMA
      token: "{{ env_var('DATABRICKS_TOKEN') }}"
      session_properties:
        legacy_time_parser_policy: legacy

After that remove any other spark.sql.legacy.timeParserPolicy from your code


My blog: https://databrickster.medium.com/