dbt writting into different schema

ruoyuqian — Mon, 05 Aug 2024 02:56:11 GMT

I have a unity catalog and it goes like `catalogname.schemaname1`& `catalogname.schemaname2`. and I am trying to write tables into schemaname2 with dbt, the current setup in the dbt profiles.yml is

prj_dbt_databricks: outputs: dev: catalog: catalogname host: adb-xxxx.azuredatabricks.net http_path: /sql/1.0/warehouses/xxx schema: schemaname1 threads: 1 token: "{{ env_var('DATABRICKS_TOKEN') }}" type: databricks target: dev

so in the profiles.yml by default the schema is set to schemaname1.
and in my dbt_project.yml the setting is below

name: 'prj_dbt_databricks' version: '1.0.0' # This setting configures which "profile" dbt uses for this project. profile: 'prj_dbt_databricks' model-paths: ["models"] analysis-paths: ["analyses"] test-paths: ["tests"] seed-paths: ["seeds"] macro-paths: ["macros"] snapshot-paths: ["snapshots"] clean-targets: # directories to be removed by `dbt clean` - "target" - "dbt_packages" # Configuring models # Full documentation: https://docs.getdbt.com/docs/configuring-models models: prj_dbt_databricks: +persist_docs: relation: true columns: true +copy_grants: true schemaname1: +schema: schemaname1 materialized: table schemaname2: +schema: schemaname2 materialized: table # Configuring seeds seeds: prj_dbt_databricks: +persist_docs: relation: true # Persist descriptions for seeds columns: true # Persist descriptions for seed columns schemaname1: # Applies to seeds under this directory +schema: 'schemaname1' +persist_docs: relation: true # Persist descriptions for seeds columns: true # Persist descriptions for seed columns

and I put my SQL files in the corresponding folders for each schema under the models folder in DBT, however when I run the dbt models for schemaname2 it keeps writing into schemaname1. I am not sure why it happens to Databrick catalog, it works fine for Snowflake

topic dbt writting into different schema in Data Engineering

dbt writting into different schema