โ08-11-2023 01:12 AM
How to run a delta live tables pipeline in production? It uses the owner's (creator's) permissions for writing to tables, and I can't change the owner of a UC-enabled pipeline after creation. I don't want regular users to have write access to prod tables, but run as a service principal instead.
I can find no example in the documentation, but it seems like such a glaring shortcoming that I am sure I must have missed something.
โ08-11-2023 04:21 AM
Thank you.
However, like you say the owner of the pipeline cannot be changed once set for a UC pipeline. Yet I am unable to choose pipeline owner when creating the pipeline in the first place, which is where I would have to set the service principal. I am also unable to create a pipeline as a service principal.
โ11-14-2023 03:38 PM - edited โ11-14-2023 03:41 PM
@knutasm wrote:Thank you.
However, like you say the owner of the pipeline cannot be changed once set for a UC pipeline. Yet I am unable to choose pipeline owner when creating the pipeline in the first place, which is where I would have to set the service principal. I am also unable to create a pipeline as a service principal.
Hmm. I wonder if creating the pipeline could it be done with the API? I've not seen anything about that in my browsing around. Even if it that's an option, I wouldn't say that's an ideal option.
I'm going to assume that DLT with UC is simply not finished baking yet and that this will change sometime... In the meantime, I might not jump in to DLT with both feet just yet.
โ09-06-2023 08:13 AM
Have the same issue.
โ09-12-2023 02:58 AM
Same here
โ11-01-2023 08:26 AM
same!
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group