topic tracing the history of a workflow in Data Engineering

tracing the history of a workflow

dev_puli — Fri, 03 Nov 2023 09:23:20 GMT

Hi!

I use Databricks in Azure and I find it inconvenient not knowing the last modified user and modified time. How can I trace the history of modified time and user details? Would it be possible to deploy the workflows into higher environments?

Thanks!

Re: tracing the history of a workflow

dev_puli — Tue, 21 Nov 2023 07:38:25 GMT

Thanks for your response! I used "describe history table_name" before as you specified above. I am fairly new to Databricks. Can you provide more insights about the workflow? How to trace the history of a workflow like tracing the history of a table(using a command like describe) or a notebook (using git options)? I am not sure of the possibilities of deploying the workflows from lower environments to higher environments. I had challenges in changing the owner of a workflow when I created a workflow. I ended up in seeking the help from another user with admin privileges to change the owner.

Re: tracing the history of a workflow

dev_puli — Tue, 21 Nov 2023 07:43:28 GMT

Sorry! I added another issue at the end without mentioning it was a new issue I encountered. I had challenges in changing the owner of a workflow when I created a workflow. I ended up seeking help from another user with admin privileges to change the owner. Is there a way to choose a service principle as the default owner every time a workflow gets created by any user?