Hi team,I am trying to create a slack webhook notification in a DLT pipeline leveraging jobs.yml. targets: dev: # The default target uses 'mode: development' to create a development copy. # - Deployed resources get prefixed with '[dev my_user_...
@szymon_dybczak , I gone through the Databricks docs.. I have added the webhook notifications in DLT pipeline. it works fine for me . # The job that triggers api_data_pipeline.resources: jobs: api_data_job: name: api_data_job schedule:...
So, I am using DLT declarative framework to work with MV in the gold layer. I am sharing code for the sample. So, can someone tell me that how we can do only the incremental refresh, as this code is doing a full refresh daily. I don't to want do agai...
So, I am using DLT declarative framework to work with MV in the gold layer. I am sharing code for the sample. So, can someone tell me that how we can do only the incremental refresh, as this code is doing a full refresh daily. I don't to want do agai...
how to reduce the data size, like API will going to give the data in onetime. can you give with some example.res = request.get("api")this above code is taking is lot of time
