Databricks

Kit · 04-24-2023

I have a scheduled job (running in continuous mode) with the following code``` ( spark .readStream .option("checkpointLocation", databricks_checkpoint_location) .option("readChangeFeed", "true") .option("startingVersion", VERSION + 1)...

Kit · 04-23-2023

Hi,I would like to set up a DBU usage alert, such that I will get an email notification when the DBU usage of last X hour exceeds the budget.How can I do that?Thanks,Kit

Kit · 04-06-2023

I want to deprecate a query from our workspace. However, I don't know if there is any downstream dashboard needs it.In case there is downstream dependency, then I can't just delete the query.I tried the search by query name, but it only returns the ...

Kit · 08-11-2022

I have a list of jobs that are using the code in GitHub as source.Everything worked fine until yesterday. Yesterday, I noticed that all the job that were using GitHub as source were failing. Because of the following error: ``` Run result unavailable:...

Kit · 04-24-2023

Databricks support suggests me to check the query history, to find out any history of the query, then check which dashboard is using it.Not an ideal solution but it works for me.

Kit · 04-11-2023

What if the table is not in unity, is there other way to get the data lineage?

Kit · 04-10-2023

> do you mean Databricks dashboardsyes> have you enabled Unity?yes

Kit · 08-16-2022

Thanks Ian,I only get the first page of the repos list. I can only recognise a few of them, and the rest of the repos are in internal path.``` "repos": [ { "id": {{ id }}, "path": "/Repos/.internal/.alias/f/{{ some_values }}/{{ some_val...

Databricks

User Stats

User Activity

How to use checkpoint with change data feed

How can I set up a DBU usage alert

How can I get the list of downstream dashboards of a query

Can't run a job that use GitHub as source

Re: How can I get the list of downstream dashboards of a query

Re: How can I get the list of downstream dashboards of a query

Re: How can I get the list of downstream dashboards of a query

Re: Can't run a job that use GitHub as source