Databricks Community

Gecofer · 06-09-2025

Hi everyone,I’m running into a strange issue in one of my ETL pipelines using dbt on Databricks, and I’d appreciate any insights or ideas. I have a query that is part of my dbt model. When I run the ETL process, the results from this query are incorr...

Gecofer

Thanks for your follow-up! That’s a really good and fair question — especially for folks coming from traditional warehouses or on-prem environments.In most projects I’ve worked on, it’s true that the platform or infra team is responsible for cost con...

Gecofer

Hey Benedict!That’s actually a great question and one that a lot of people have when they come from a traditional ETL background.Before diving in, can I ask which cloud you’re using? (AWS, Azure, or GCP?) — because each one has its own native tools (...

Gecofer · 09-01-2025

Hi @AlkaSaliss!I ran into the same issue and found the root cause, I think it's related to the use of name instead of artifact_path when calling mlflow.xgboost.log_model(...). Even though the documentation says https://mlflow.org/docs/latest/api_refe...

Gecofer · 06-09-2025

Hi @Isi Thanks so much for your insight!It turned out to be a combination of the two things you mentioned:There was a data masking policy applied to one of the columns, and while I had permissions to view the unmasked data, the service principal runn...

Databricks Community

User Stats

User Activity

Inconsistent query results between dbt ETL run and SQL editor in Databricks

Re: Need help understanding Databricks

Re: Need help understanding Databricks

Re: Unable to register Scikit-learn or XGBoost model to unity catalog

Re: Inconsistent query results between dbt ETL run and SQL editor in Databricks