Hi Community,I have successfully run a job through the API but would need to be able to pass parameters (configuration) to the DLT workflow via the APII have tried passing JSON in this format:{
"full_refresh": "true",
"configuration": [
...
Hi CommunityScenario:I have created a query in Databricks SQL, built a number of visualisations from it and published them to a dashboard. I then realise that I need to add another field to the underlying query that I want to then leverage as a dashb...
Hi, I would like to be able to do something like this...create table if not exists table1using parquetlocation = '/mnt/somelocationsome location needs to be a concatenation of static and code generated string. Documentation suggests that location onl...
Hi, We currently leverage Azure DevOps to source control our notebooks and use CICD to publish the notebooks to different environments and this works very well. We do not have the same functionality available for Databricks jobs (the ability to sourc...
Hi, I currently am running a number of notebook jobs from Azure Data Factory. A new requirement has come up where I need to capture a return code in ADF that has been generated from the note. I tried using dbutils.notebook.exit(json.dumps({"return_v...
Hi @Kaniz Fatma,Just wondered if there was any update on this. This is quite an important aspect of how we would implement DLT pipelines so would be good to know if it can be done, or if it's coming.Many thanks.
Hi @Kaniz Fatma, thanks for the detailed reply. Looks like the response is talking about a job, not a delta live tables pipeline. Apologies if my initial question was not clear enough...I am using the Delta Live Tables API:Delta Live Tables API guid...
Assuming by workflow, you mean jobs then yes for parameters using the jobs apihttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/api/2.0/jobsScheduling is a different matter. This may be possible through the spark_submit_params that the API...
Yep sureQuery 1 (screenshot of which for some reason at the bottom of the reply, whereas other images have inserted in-line) is a simple query which I built a bar chart from and added bar chart to a dashboard.If I then add a filter the dialog (correc...
