Warning in dbt task
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-21-2024 06:40 AM
We are using dbt core and running our transformations in a dbt task. Since a few months ago we have started to see a warning message in our runs. This started happening after an update of dbt core and it seems that Databricks needs to update the definition of the generated prifiles file. Right now we are running version 1.8.7 of dbt core.
This is the warning:
+ dbt deps
12:48:49 Running with dbt=1.8.7
12:48:49 [WARNING]: Deprecated functionality User config should be moved from the 'config' key in profiles.yml to the 'flags' key in dbt_project.yml.
12:48:49 Installing brooklyn-data/dbt_artifacts
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-28-2024 05:01 AM
Looks like you had help from ChatGPT?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-28-2024 02:45 AM
@merry867 , Thanks for sharing , yes it looks like warning message indicates that user configuration should be moved from the config key in the profiles.yml file to the flags key in the dbt_project.yml file.
Bhanu Gautam
Kudos are appreciated
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-28-2024 05:05 AM
Both of you missed the sentence "Databricks needs to update the definition of the generated profiles file."
The warning is regarding the structure of the profiles.yml which is generated by Databrick. This is not anything I as a user can change accept follow the guide to run with a custom profile which I do not have a need for.
So I wand to reach somebody working at Databricks and can give this information to the team that works on the dbt task.

