Hi, I see with unity catalog we have the workflow and now the lakeflow schema. I guess the intention is to capture audit logs of changes/ monitor runs but I wonder why we don't have all the metadata info on the jobs /tasks too for a given job =...
@Sujitha Thank you. Given the great features of Databricks some of the basic functionalities that are needed for maintaining seems primitive in an an env with multiple teams and many many jobs, with constant change, i should be able to get metada...
Hi,Thanks for your reply and agreeing with my ask to have more metadata info in these tables. Guess my question/ask needs to be directed to Databricks product team and not sure how to go about it. any ideas?
