Allow non-admin users to view the driver logs from a Unity Catalog-enabled pipeline

[saravjeet]

We are trying to enable the option to allow log reading to the non-admin users in  the databricks wokspace but we are not able to see the obvious way to check them. The documentation is not showing after enabling the below property where to check the driver logs for a DLT pipeline. 

{
"configuration": {
"spark.databricks.acl.needAdminPermissionToViewLogs": "false"
}
}

Reference link:

https://docs.databricks.com/en/delta-live-tables/settings.html#driver-log-permissions

[gchandra]

Do they see these links in the pipeline?

[saravjeet]

I can see it in development environment where I have the admin privilege, the issue is - when my pipelines are deployed to QA or UAT environment (higher environments) then this code will be deployed by the technical user due to this no one in my team is able to see the running pipelines or any associated logs. So I am trying to access the these DLT logs as non-admin user in QA workspace as per the shared article in the original post. I hope this is clear. Thanks.