cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

giuseppegrieco
by New Contributor III
  • 21304 Views
  • 5 replies
  • 6 kudos

Workflow service principle owned can't checkout git repository

I am trying to deploy a workflow where the owner is a service principal and I am using git integration (backend with azure devops), when I run the workflow it says that it doesn't have permissions to checkout the repo.run failed with error message F...

  • 21304 Views
  • 5 replies
  • 6 kudos
Latest Reply
Anonymous
Not applicable
  • 6 kudos

Hi @Giuseppe Grieco​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us ...

  • 6 kudos
4 More Replies
js54123875
by New Contributor III
  • 12565 Views
  • 2 replies
  • 0 kudos

Power BI - Databricks Connection using Service Principal PAT Refresh

What is best practice for automatically refreshing service princpal PAT in Power BI for a connection to a Databricks dataset? Ideally when the PAT is updated it will automatically be stored in Azure Key Vault, is there a way that Power BI can pick it...

Data Engineering
Azure Key Vault
Personal Access Token
Power BI
Service Principal
  • 12565 Views
  • 2 replies
  • 0 kudos
Latest Reply
SSundaram
Contributor
  • 0 kudos

May be not the recommended way, but try to create a token that do not expire for such use cases. Ideally you will need like a custom powershell type of solution to get it automated completely. 

  • 0 kudos
1 More Replies
Alexc01
by New Contributor
  • 1082 Views
  • 0 replies
  • 0 kudos

Buy Trustpilot Account

Buy Trustpilot AccountDo you want to buy Trustpilot account? Our store is the best place where you can buy Trustpilot accounts. Only fully verified Trustpilot accounts on our storeBuy Trustpilot Account

trustpilot.jpg
  • 1082 Views
  • 0 replies
  • 0 kudos
Alexrc
by New Contributor
  • 461 Views
  • 0 replies
  • 0 kudos

Buy Amazon Account

Buy Amazon AccountDo you want to buy Amazon account? Our store is the best place where you can buy Amazon accounts. Only fully verified Amazon accounts on our storeBuy Amazon Account

amazon.jpg
  • 461 Views
  • 0 replies
  • 0 kudos
AlexR
by New Contributor
  • 1527 Views
  • 0 replies
  • 0 kudos

Buy Tripadvisor Account

Buy Tripadvisor AccountDo you want to buy Tripadvisor account? Our store is the best place where you can buy Tripadvisor accounts. Only fully verified Tripadvisor accounts on our storeBuy Tripadvisor Account

tripadvisor.jpg
  • 1527 Views
  • 0 replies
  • 0 kudos
alex97
by New Contributor
  • 737 Views
  • 0 replies
  • 0 kudos

Buy Facebook account

Buy Facebook accountDo you want to buy Upwork account? Our store is the best place where you can buy Upwork accounts. Only fully verified Upwork accounts on our storeBuy Facebook account

facebook.jpg
  • 737 Views
  • 0 replies
  • 0 kudos
alexc96
by New Contributor
  • 483 Views
  • 0 replies
  • 0 kudos

Buy Match Account

Buy Match AccountDo you want to buy Match Match account? Our store is the best place where you can buy Match accounts. Only fully verified Match accounts on our storeBuy Match Account

Match.jpg
  • 483 Views
  • 0 replies
  • 0 kudos
alexc95
by New Contributor
  • 2600 Views
  • 0 replies
  • 0 kudos

Buy Badoo account

Buy Badoo accountDo you want to buy Badoo account? Our store is the best place where you can buy Badoo accounts. Only fully verified Badoo accounts on our storeBuy Badoo account

Badoo.jpg
  • 2600 Views
  • 0 replies
  • 0 kudos
BhargaviKapu13
by New Contributor
  • 877 Views
  • 0 replies
  • 0 kudos

Error 403

Unable to access the page while attempting the quiz for basics of the Databricks Lakehouse Platform

  • 877 Views
  • 0 replies
  • 0 kudos
alj_a
by New Contributor III
  • 3560 Views
  • 2 replies
  • 2 kudos

Resolved! Delta Live Table - not reading the changed record from cloud file

Hi,I am trying to ingest the data from cloudfile to bronze table. DLT is working fist time and loading the data into Bronze table. but when i add new record and change a filed in existing record the DLT pipeline goes success but it should be inserted...

Data Engineering
Databricks Delta Live Table
  • 3560 Views
  • 2 replies
  • 2 kudos
Latest Reply
alj_a
New Contributor III
  • 2 kudos

Thank you Emil. I tried all the suggestions. .read works fine it picks up the new data or changed data. but my problem is it is bronze table  as target. in this case my bronze table has duplicate records. However, let me look at the other options to ...

  • 2 kudos
1 More Replies
sumit2jha
by New Contributor III
  • 7258 Views
  • 6 replies
  • 4 kudos

Resolved! ADE 2.1 Unable to run Classroom-Setup-3.1

%run ../Includes/Classroom-Setup-3.1After running the above command, getting this error message, attached error screenshot.AnalysisException: You are trying to read a Delta table `spark_catalog`.`dbacademy_sumit_s_jha_hk_ey_com_adewd_3_1`.`date_looku...

  • 7258 Views
  • 6 replies
  • 4 kudos
Latest Reply
sumit2jha
New Contributor III
  • 4 kudos

First run this file before starting. Problem will be solved 

  • 4 kudos
5 More Replies
chevichenk
by New Contributor III
  • 2114 Views
  • 1 replies
  • 1 kudos

Resolved! Why I still see delta history if I made a vacuum with just 5 hours retention

Hi, everyone!I execute a vacuum with 5 hours retention but I can see all the history of versions, even I can query those older version of the table.Plus, when I see the history version, it doesn't start with zero (supposed to be the creation of the t...

chevichenk_1-1699661687787.png
  • 2114 Views
  • 1 replies
  • 1 kudos
Latest Reply
Rom
New Contributor III
  • 1 kudos

Hi,When disk caching is enabled, a cluster might contain data from Parquet files that have been deleted with VACUUM. Therefore, it may be possible to query the data of previous table versions whose files have been deleted. Restarting the cluster will...

  • 1 kudos
MikeK_
by New Contributor II
  • 44184 Views
  • 6 replies
  • 0 kudos

Resolved! SQL Update Join

  Hi, I'm importing some data and stored procedures from SQL Server into databricks, I noticed that updates with joins are not supported in Spark SQL, what's the alternative I can use? Here's what I'm trying to do: update t1 set t1.colB=CASE WHEN t2....

  • 44184 Views
  • 6 replies
  • 0 kudos
Latest Reply
LyderIversen
New Contributor II
  • 0 kudos

Hi! This is way late, but did you ever find a solution to the CROSS APPLY-part of your question? Is it possible to do CROSS APPLY in Spark SQL, or is there something you can use instead?

  • 0 kudos
5 More Replies
boyarkaandre
by New Contributor
  • 1310 Views
  • 0 replies
  • 0 kudos

Buy ByBit Account

Buy ByBit Accounthello! Are you looking for a bybit account? You can go to our store and buy bybit account here. You can see crypto account in our store!Buy ByBit Account hereBuy ByBit Account here

bybit.jpg
  • 1310 Views
  • 0 replies
  • 0 kudos
andyh
by New Contributor
  • 3028 Views
  • 2 replies
  • 0 kudos

Resolved! Job queue for pool limit

I have a cluster pool with a max capacity limit, to make sure we're not burning too extra silicon. We use this for some of our less critical workflow/jobs. They still spend a lot of time idle, but sometimes hit this max capacity limit. Is there a way...

  • 3028 Views
  • 2 replies
  • 0 kudos
Latest Reply
SSundaram
Contributor
  • 0 kudos

Try increasing your max capacity limit and might want to bring down the min number of nodes the job uses.At the job level try configuring retry and time interval between retries. 

  • 0 kudos
1 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels