topic Re: Databricks Workflow cost on running in interactive cluster in Data Engineering

Databricks Workflow cost on running in interactive cluster

Soma — Sun, 23 Apr 2023 15:51:03 GMT

Databricks Workflow cost on running in interactive cluster

Re: Databricks Workflow cost on running in interactive cluster

User16752242622 — Mon, 24 Apr 2023 05:18:47 GMT

Hello @somanath Sankaran Have you checked this article about pricing:

https://www.databricks.com/product/pricing

Re: Databricks Workflow cost on running in interactive cluster

Ajay-Pandey — Mon, 24 Apr 2023 05:27:34 GMT

Hi @somanath Sankaran ,

Please refer below blog for detailed costing for workflow.

Blog link

Re: Databricks Workflow cost on running in interactive cluster

Soma — Mon, 24 Apr 2023 10:56:02 GMT

@Ajay Pandey @Akash Bhat

is this the cost for ADB Job cluster or workflow.

I need to know diff b/w adf vs workflows

Re: Databricks Workflow cost on running in interactive cluster

karthik_p — Tue, 25 Apr 2023 02:51:03 GMT

@somanath Sankaran interactive clusters are always more than 3 times of job clusters, one of the benefits of jo cluster is , once job completes clusters stops.

Re: Databricks Workflow cost on running in interactive cluster

Soma — Tue, 25 Apr 2023 02:57:30 GMT

@karthik p we need interactive cluster as we need low latency streaming

my question was do we have additional charges for workflow as running in adf has additional charges for pipeline orchestration thanks

Re: Databricks Workflow cost on running in interactive cluster

karthik_p — Tue, 25 Apr 2023 03:08:09 GMT

@somanath Sankaran best way for streaming will be DLT , if you want to go with interactive with ADF ( azure data factory) with databricks workflows no extra charges are needed as far as i know.

Re: Databricks Workflow cost on running in interactive cluster

Soma — Tue, 25 Apr 2023 03:39:05 GMT

DLT live tables are costlier