Databricks

gustavomcarmo-h · 06-14-2023

After creating the delta pipeline, I would like to get details from the dlt maintenance job automatically created by Databricks, like the scheduled time when the dlt maintenance tasks will be executed. However, it seems the Job API 2.1 doesn't cover ...

gustavomcarmo-h · 06-16-2023

Hi @Debayan Mukherjee ,Actually the Databricks Jobs API documentation has not been fixed yet. The parameter `job_type` should be included in the list endpoint request documentation. Please do this in order to avoid unnecessary questions here in the ...

gustavomcarmo-h · 06-15-2023

Hi @Debayan Mukherjee,Although undocumented, I figured out that the Databricks Jobs API list endpoint has a `job_type` parameter that I can set `MAINTENANCE_PIPELINE` to get the DLTs maintenance jobs. The following command works: `curl -H "Authoriza...

gustavomcarmo-h · 06-15-2023

Hi @Debayan Mukherjee,Unfortunately this doesn't help. The Pipelines API events endpoint only covers update events, not maintenance events. I need details about DLTs maintenance tasks performed automatically by Databricks under the hood. The Jobs AP...

Databricks

User Stats

User Activity

Is there a way to list the dlt maintenance jobs through the API?

Re: Is there a way to list the dlt maintenance jobs through the API?

Re: Is there a way to list the dlt maintenance jobs through the API?

Re: Is there a way to list the dlt maintenance jobs through the API?