Databricks Community

ismaelhenzel

I would like to understand the differences between Terraform and Asset Bundles, especially since in some cases, they can do the same thing. I’m not talking about provisioning storage, networking, or the Databricks workspace itself—I know that is Terr...

ismaelhenzel

I am using Databricks Apps, and I want to grant privileges to the auto-generated service principal from the app to read specific Unity Catalog schemas. I can't find a way to do this automatically using Asset Bundles.I prefer to query using a service ...

ismaelhenzel · 08-25-2025

My team is migrating pipelines from Spark to Delta Live Tables (DLT), but we've found that some important features, like schema evolution for tables with enforced schemas, seem to be missing. In DLT, we can define schemas, set primary and foreign key...

ismaelhenzel · 08-14-2025

I'm wondering if anyone has successfully integrated data contracts with declarative pipelines in Databricks. Specifically, I want to reuse the quality checks and schema definitions from the contract directly within the pipeline's stages. I haven't fo...

ismaelhenzel · 12-09-2024

I'm very disappointed with this framework. The documentation is inadequate, and it has many limitations. I want to run materialized views with incremental updates, but DLT insists on performing a full recompute. Why is it doing this? Here is the log ...

ismaelhenzel

That is a very clear explanation; I understand it well now. Bundles seem better for simplicity and a repo-oriented workflow, making it easy to manage multiple repos where everyone creates their own Databricks resources. However, when I need stricter ...

ismaelhenzel

This is a possible solution. The Databricks service principal for the data app only exists after its deployment in the platform. Then, after deployment, I could get the ID that the principal of the data app received, and then apply the necessary read...

ismaelhenzel

Thanks for answering!I really like this approach, but how do I manage when I can only develop in the repository, and when I can make changes in the bundle? Let's suppose that I'm creating a schema and granting permissions with the bundle. As the bund...

ismaelhenzel · 08-15-2025

That's an interesting approach. Are you placing the schemas and quality rules in your DLT code based on reading a data contract? Currently, I'm using Databricks DQX YAML files to create my quality rules and defining the schemas directly in the @Dlt.t...

ismaelhenzel · 01-13-2025

Hello, I appreciate your response.I understand your point. I have tested Delta Live Tables (DLT) with incrementally materialized views of various query sizes, and I'm not impressed with the results. I imagine that the engine will continue to improve,...

Databricks Community

User Stats

User Activity

Asset bundle vs terraform

Databricks Apps - Automating Unity Catalog Privileges for Databricks Apps Service Principals

Schema Evolution/Type Widening in Materialized Views

Declarative Pipelines with datacontracts

DELTA LIVE TABLES - MATERIALIZED VIEW DOES NOT INCREMENT NOTHING !

Re: Asset bundle vs terraform

Re: Databricks Apps - Automating Unity Catalog Privileges for Databricks Apps Service Principals

Re: Asset bundle vs terraform

Re: Declarative Pipelines with datacontracts

Re: DELTA LIVE TABLES - MATERIALIZED VIEW DOES NOT INCREMENT NOTHING !