Databricks

drag7ter

I'm trying to run: databricks bundle deploy -t prod --profile PROD_Service_Principal My bundle looks: bundle: name: myproject include: - resources/jobs/bundles/*.yml targets: # The 'dev' target, for development purposes. This target is the de...

drag7ter

I'm facing an issue while trying to run my job in db and my notebooks located in Git Lab. When I run job under my personal user_Id it works fine, because I added Git Lab token to my user_Id profile and job able to pull branch from repository. But whe...

drag7ter

I'm running this code in databricks notebook and I want the table from dataframe in catalog were created with CDF enables. When I run the code table hasn't exited yet.This code doesn't create a table with enables CDF. It doesn't add:delta.enableChang...

drag7ter

In my case I replaced alias PROD_Service_Principal with id c250831b-5a2a-4461-a855-83b9102f797e and it works. Not intuitive, probably this is a bug in CLI ot bundles service_principal_name: c250831b-5a2a-4461-a855-83b9102f797e

drag7ter

I want to add that even if I specify: run_as: user_name: c250831b-5a2a-4461-a855-83b9102f797eIt doesn't work:Error: cannot create job: 'c250831b-5a2a-4461-a855-83b9102f797e' cannot be set as run_as, either because the user does not exist or ...

drag7ter

Hi @raphaelblg in your screenshot cdcTest table already exists in unity catalog, or it will be created for the first time, running your code? It is really strange as I'm not able to enable from the pyspark code, only after tables created ALTER TABLES...

Databricks

User Stats

User Activity

Not able to set run_as service_principal_name

Configure Service Principle access to GiLab

How to enable CDF when saveAsTable from pyspark code?

Re: Not able to set run_as service_principal_name

Re: Not able to set run_as service_principal_name

Re: How to enable CDF when saveAsTable from pyspark code?