cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

BUG in Job Task of Type DBT

tom_1
New Contributor
Hi, just wanted to let the Databricks Team know, that there is a bug in the task ui.
Currently it is not possible to save a task of "Type: dbt" if the "SQL Warehouse" is set to "None (Manual)".
Some weeks ago this was possible, also the "Profiles Directory" field is now missing (which is not a problem because it can be set using dbt run --profiles-dir, but still a change which confused me in the beginning).
Instead Warehouse Catalog and Schema must now be defined. Which makes no sense because the catalog and schema is actually defined in dbt's profiles.yml.

It would be great if this bug could be fixed, such that "SQL Warehouse: None (Manual)" is a valid option again.

UI Error:
Error updating Main Pipeline
No result returned

Edit as Yaml Error:
Could not update job
Catalog can only be defined if the warehouseId is defined

Old View
tom_1_0-1741870684542.png

New View

tom_1_1-1741870779606.png

 

1 ACCEPTED SOLUTION

Accepted Solutions

tom_1
New Contributor

Its now working as before, thanks for fixing it so fast!

View solution in original post

3 REPLIES 3

Alberto_Umana
Databricks Employee
Databricks Employee

Hello @tom_1,

Thanks for the detailed information provided, I will check and report this internally.

tom_1
New Contributor

Its now working as before, thanks for fixing it so fast!

Gerard_Sola
New Contributor

This bug has appeared again in Azure Databricks. Could you please review it?

Thanks!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group