Databricks Community

BobCat62

Hi all,I am able to deploy Databricks assets to the target workspace. Jobs and workflows can also be created successfully.But I have aspecial requirement, that I copy the note books to the target folder on databricks workspace.Example:on Local I have...

BobCat62

Hi experts,I have defined my DLT Pipeline as follows:-- Define a streaming table to ingest data from a volume CREATE OR REFRESH STREAMING TABLE pumpdata_bronze TBLPROPERTIES ("myCompanyPipeline.quality" = "bronze") AS SELECT * FROM cloud_files("abfss...

BobCat62 · 02-19-2025

Hi experts,I defined my delta table in an external location as following:%sqlCREATE OR REFRESH STREAMING TABLE pumpdata (Body string,EnqueuedTimeUtc string,SystemProperties string,_rescued_data string,Properties string)USING DELTALOCATION 'abfss://md...

BobCat62

@ashraf1395 Thank you so much...You mean, if I could put the databricks.yml file inside the databricks folder and relocate my emob folders then I can achieve my aim As I understand it is not possible to reloacte the databricks.yml because it should b...

BobCat62

Hello @ashraf1395 ,Nice to hear you and thank you for your hints.Actually with your idea, I could reach half of my aim you can see here the folder structure in my VS code:and here is part of my `databrick.yml` file:targets: dev: # The default ta...

BobCat62

Yes it is. All code is in one notebook. But the code of sample-DLT-pipeline-notebook is also in one notebook, but the run is sequential:

Databricks Community

User Stats

User Activity

How to copy notebooks from local to the tarrget folder via asset bundles

Delta Live Tables are refreshed in parallel rather than sequentially

Missing Delta-live-Table in hive-metastore catalog

Re: How to copy notebooks from local to the tarrget folder via asset bundles

Re: How to copy notebooks from local to the tarrget folder via asset bundles

Re: Delta Live Tables are refreshed in parallel rather than sequentially