- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-08-2025 02:01 PM
Hi Chitrar,
How are you doing today?, As per my understanding, It looks like Unity Catalog's LakeFlow schema is focused on capturing audit logs and monitoring runs, but it doesn't include all metadata related to jobs and tasks. For a job, key details like job parameters, notifications, and schedules seem to be limited in the available attributes. Similarly, for a task, information such as task name, source, type, notebook, parameters, and dependent libraries appears to be incomplete.
Regarding the jobs filter search, it currently allows searching by name, tag, or task but doesn't support multiple search conditions, such as filtering by cluster or trigger. Expanding the search functionality could make it more useful for detailed job tracking. It would be great if more metadata and advanced filtering options were available to provide a more comprehensive view.
Regards,
Brahma