Databricks Community

This won't work.best approach is create dlt sink to write to delta external table. This pipeline should only be 1 step. Read table and append flow using data sink. It works fine. 

Hello @ashraf1395 ,Nice to hear you and thank you for your hints.Actually with your idea, I could reach half of my aim you can see here the folder structure in my VS code:and here is part of my `databrick.yml` file:targets:  dev:    # The default tar...

you can close it: it was an ci/cd issue

I think I have solved this. I added a URL for `preloaded_docker_image` to my instance pool, and the job worked correctly.This suggests that the DBR docs for preloaded_docker_image are incomplete; they should clarify that a user must add an entry in o...

Did y'all ever figure this out? I'm running in a similar issue.

Hi there @cmathieu ,You can use sync  -paths to specify the files you want to deploy in the files folders instead of all using the include or exclude folder. -paths works better for me I can use it to deploy any files in my local to workspace even ou...

@badari_narayan Based on above terraform code, you are trying to use the databricks.accounts provider to read the current workspace metastore, which is incorrect — the databricks_current_metastore data source is a workspace-level resource, and must b...

Hi Stefan-Koch,We reached out to our account rep and was instructed to create an Azure support ticket since we do not yet have a paid support plan.  We are hoping to negotiate for paid support.  However, I do not believe the documentation surrounding...

In doc it is: "cloudFiles.maxFilesPerTrigger" https://docs.databricks.com/aws/en/ingestion/cloud-object-storage/auto-loader/options