- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2024 10:10 AM - edited 12-30-2024 10:11 AM
@jeremy98 just asking to get clarity on the use case and provide a more accurate assistance.
In UC I believe that being these internal table's with ids, you would have to grant yourself access on the __dlt_materialization_schema_<pipeline_id>, please give it a try and let me know.
So, assuming your pipeline_id is "1234_6f26_454c_8e0d_12342134" and your usename username@domain, then:
%sql
GRANT use schema ON catalog __databricks_internal TO `username@domain`;
GRANT use catalog ON catalog __databricks_internal TO `username@domain`;
GRANT use schema ON SCHEMA __databricks_internal.__dlt_materialization_schema_1234_6f26_454c_8e0d_12342134 TO `username@domain`;
GRANT SELECT ON SCHEMA __databricks_internal.__dlt_materialization_schema_1234_6f26_454c_8e0d_12341234 TO `username@domain`;
And then I hope you should be able to query the __event_log:
%sql
select * from __databricks_internal.__dlt_materialization_schema_1234_6f26_454c_8e0d_12342134.`__event_log` where message like "%main%"
This access is typically granted temporarily and should be revoked after the debugging session to maintain security. So by default, users, including metastore admins, do not have access to these tables to maintain security and prevent accidental data corruption.
Please try and be very cautious in handling/granting access to it, and as much as possible preserve the access restricted.