Hi @SriramMohanty ,

I encountered a few issues while configuring Overwatch based on the official documentation, and I wanted to highlight some of them for your reference:

1. Overwatch Configuration Changes: The documentation does not reflect recent changes in the Overwatch config file. For example, the column previously named etl_storage_prefix is now required as storage_prefix, but this update is not mentioned.

2. Databricks Runtime (DBR) Version Requirements: The documentation does not specify the required DBR version for the latest Overwatch JAR. I found that Overwatch version 0.8.1.2 works without errors only on DBR 13.3 LTS. The document linked in your previous replies does not clearly state this compatibility. Using DBR 11.3, which is mentioned, leads to issues with the latest JAR. Thanks to the Databricks team, I was able to resolve this by using the correct DBR version.

3. SQL Query History Gold Deployment Error: There is an error in the deployment of sql_query_history_gold (Gold View: Create view failed, column name error_message cannot be resolved), which is resolved in Overwatch version 0.8.1.2. This information is not covered in the documentation.

4. I had to install some of the missing libraries on the cluster:
   

   - org.scalaj:scalaj-http_2.12:2.4.2

   - dataframe_rules_engine_2.12:0.2.0

These are some of the points I noticed were missing from the documentation. While the documentation has been a valuable resource, it could be even more effective with proper updates. Please correct me if I’m wrong.

The contacts you provided were extremely helpful, and thanks to you and them, I was able to figure things out.