- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-06-2025 06:09 AM
Hi Ankit, Thanks for your follow-up. The pipeline_events table you're referring to is part of the system tables for Delta Live Tables (DLT), and if it’s not showing up in your workspace, it’s likely because system tables haven't been enabled yet in your environment. They’re not region-restricted, but they do need to be explicitly turned on in each workspace through the admin settings or API. You can check with your workspace admin to enable system tables if you're not seeing them.
As for the naming—no, it’s not guaranteed that all DLT jobs or tasks will have “DLT” in the name. That depends on how the pipeline was named during creation. However, many teams do include "DLT" or some identifier in the job name or task names for clarity, so if your team follows that convention, it can help you filter them. If not, you might need to identify DLT jobs by their structure—for example, they often run on PIPELINE-type clusters and might show patterns in the job_cluster_type or job_type fields. Let me know if you'd like help writing a query to narrow them down based on those hints!
Regards,
Brahma