Databricks Community

TamD

Our business does a LOT of reporting and analysis by time-of-day and clock times, independent of day or date. Databricks does not seem to support the TIME data type, that I can see. If I attempt to import data recorded as a time (eg., 02:59:59.000)...

TamD · 10-10-2024

I'm a newbie and I've just done the "Run your first Delta Live Tables pipeline" tutorial.The tutorial downloads a publicly available csv baby names file and creates two new Delta Live tables from it. Now I want to be a good dev and clean up the reso...

TamD · 09-18-2024

Hi; I'm new to Databricks, so apologies if this is a dumb question.I have a notebook with SQL cells that are selecting data from various Delta tables into temporary views. Then I have a query that joins up the data from these temporary views.I'd lik...

TamD · 08-18-2024

Hi.I'm just getting started with Databricks & am having trouble importing the course materials. So far, only one of the courses I'm taking has had instructions for finding and importing the course files, but the location was wrong (it's at the botto...

TamD · 10-14-2024

It would be good if Databricks would confirm the behaviour, rather than requiring us to make assumptions like this.

TamD · 10-13-2024

Hi @Ayushi_Suthar I don't see "Task options" in the Job UI. If I click on a Task, I see Task name, Type, Job, Depends on, Job parameters, Notifications, and Duration threshold. @SS_RATH , did you find an answer?

TamD · 10-13-2024

Thank you @gchandra . Deleting the pipeline does indeed remove the materialized view definitions from the Catalog. How can I confirm that the underlying S3 storage has also been cleared? Just removing the pointers in the Catalog is not enough, if ...

TamD · 10-13-2024

I would also like to know the answer to this. When I drop a mat view from Unity Catalog, I want to be sure the storage is also cleared so I'm not getting billed for it.

TamD · 10-10-2024

Hi @filipniziol thank you for replying. Have you confirmed that your method works? And if you have, could you please provide more detail for the "delete the delta tables" part? As I describe above, attempting to drop the tables outside of the pip...

Databricks Community

User Stats

User Activity

TIME data type

How do I drop a delta live table?

SELECT from VIEW to CREATE a table or view

Noob: how to import training material

Re: Where are materialized view generated by Delta Live Table stored?

Re: I have a notebook in workspace, how to know in which job this particular notebook is referenced.

Re: How do I drop a delta live table?

Re: Where are materialized view generated by Delta Live Table stored?

Re: How do I drop a delta live table?