Databricks Community

ShreevaniRao

Hello,I am learning to create DLT pipelines using different graphs using a 14 day trial version of the premium Databricks. I have currently one graph Mat view -> Streaming Table -> Mat view. When i ran this pipeline(serverless compute) 1st time, ran...

ShreevaniRao

Ah! Thank You Brahma! for pointing it out. I will try it out. Thanks for your guidance.

ShreevaniRao

Hello Brahma,Hope you are having a good day.I took your suggestion to rewrite my logic to use MERGE to simulate SCD 2 in my DLT pipeline, and need your help. I am keeping it simple as far as what changes I am testing in my customers table. Which has ...

ShreevaniRao

Hello Riyaz,Sorry, for late response. I was learning about DLT pipeline building thru online videos, and one of them showed breaking of the pipeline in 2nd run for Mat View -> Streaming Table -> Mat View, and it made sense because "source of streamin...

ShreevaniRao

Thank you Brahma, for your response. I tried requesting quota increase - but not granted (for my subscription type). It is very frustrating and a hassle with this situation - I tried googling, and came across others in the same situation. Azure could...

ShreevaniRao

Hello Brahma,I wanted to check if what I am encountering as an error is really due to use of Serverless computing for my compute setup of DLT pipeline. I am trying to work with - Apply changes API code in a pipeline and seem to invariably run into co...

Databricks Community

User Stats

User Activity

Newbie learning DLT pipelines

Re: Newbie learning DLT pipelines

Re: Newbie learning DLT pipelines

Re: Newbie learning DLT pipelines

Re: Newbie learning DLT pipelines

Re: Newbie learning DLT pipelines