- 17 Views
- 1 replies
- 0 kudos
Azure Databricks Exclusive groups
Une nouvelle primitive de permissions pour empêcher le croisement de données entre usages hébergés sur le même workspace Databricks.
- 17 Views
- 1 replies
- 0 kudos
- 0 kudos
lien Medium :https://medium.com/@kacn12872/azure-databricks-exclusive-groups-garantir-létanchéité-entre-cas-d-usage-sur-la-lakehouse-e340ce28f332
- 0 kudos
- 65 Views
- 0 replies
- 1 kudos
Finally! A simple way to validate whether your Materialized View can actually refresh incrementally
One of the more frustrating things when working with materialized views in Databricks was checking whether a view had refreshed incrementally. One way to verify it was by checking the event log, but that required running the pipeline and executing a ...
- 65 Views
- 0 replies
- 1 kudos
- 72 Views
- 0 replies
- 1 kudos
Databricks Kafka Multi-Stream Ingestion Architecture: Scaling Beyond Single-Stream Bottlenecks
The Real Problem: Kafka Source Parallelism in SparkBefore discussing foreachBatch, multi-table writes, or any specific use case, it helps to understand the underlying issue. This is a problem with how Spark Structured Streaming consumes from Kafka, a...
- 72 Views
- 0 replies
- 1 kudos
- 221 Views
- 1 replies
- 2 kudos
How Databricks Genie Turns Collaboration Tools into AI-Powered Intelligence Platforms
Most organizations don’t have a data problem anymore.They have a data access and usability problem.The dashboards exist. The warehouses are modernized. The lakehouse is running. Yet business teams still wait days for answers because analytics remains...
- 221 Views
- 1 replies
- 2 kudos
- 2 kudos
The Dashboard Era Is Ending. Conversation Is Replacing It.
- 2 kudos
- 160 Views
- 0 replies
- 1 kudos
Scaling Enterprise AI with Databricks Without Losing Control
Enterprise AI becomes difficult to govern as useful projects accumulate. A machine learning team ships a forecasting model. A data engineering team automates pipeline refreshes. Another group connects a generative AI assistant to internal documentati...
- 160 Views
- 0 replies
- 1 kudos
- 167 Views
- 0 replies
- 2 kudos
Live Cost Estimator
I'm building a live cost estimator that doesn't have to wait for the system tables or billing data to update. It gives me immediate cost feedback every second and I'm sharing the development journey on YouTube.I already have live costs estimates for ...
- 167 Views
- 0 replies
- 2 kudos
- 150 Views
- 0 replies
- 0 kudos
Managed vs External Tables in Unity Catalog: The Decision That’s Silently Inflating Your Cloud Bill
Hi everyone,I recently took a look into a silent cost driver in many data platforms: the default choice between managed and external tables in Unity Catalog.It is very common for teams to default to external tables, but this choice often leads to acc...
- 150 Views
- 0 replies
- 0 kudos
- 198 Views
- 0 replies
- 1 kudos
Finally! Databricks lets you disable tasks without hacks
For years, there was no simple way to disable a single task in a Databricks workflow. Let that sink in If you wanted to skip a task, you had to get creative - Add custom flags - Wrap logic in if/else blocks - Or build your own workaround just to not...
- 198 Views
- 0 replies
- 1 kudos
- 7903 Views
- 7 replies
- 12 kudos
Attribute-Based Access Control (ABAC) in Databricks Unity Catalog
What Is ABAC and Why Does It Matter?Attribute-Based Access Control (ABAC) is a data governance model now available in Databricks, designed to offer fine-grained, dynamic, and scalable access control for data, AI assets, and files managed through Data...
- 7903 Views
- 7 replies
- 12 kudos
- 12 kudos
I wanted to check if ABAC (Attribute-Based Access Control) policies can be applied to metric views in Databricks.I have successfully applied ABAC policies on a fact table, and they are working as expected. However, when I query a metric view that use...
- 12 kudos
- 258 Views
- 0 replies
- 1 kudos
DataHacks 2026: University Alliance in Action at UCSD
DataHacks 2026: University Alliance in Action at UCSD How a single weekend of hands on exposure creates the next generation of Databricks advocates Workshop Lead: Anjana Sriram Why University Alliances Matters in the Field Early in my career, the ...
- 258 Views
- 0 replies
- 1 kudos
- 808 Views
- 0 replies
- 1 kudos
Databricks Metric Views - Power BI - BI compatibility mode Removal
BI compatibility mode allows us to query Unity Catalog Metric Views from external BI tools. It allows Databricks to rewrite queries generated by tools like Power BI, ensuring complex metric view logic is executed correctly while appearing as standard...
- 808 Views
- 0 replies
- 1 kudos
- 1483 Views
- 3 replies
- 2 kudos
Unity Catalog-only workspace for new Azure Databricks deployments
Big shift coming for Azure Databricks usersStarting 30 September 2026, all new Azure Databricks workspaces will be Unity Catalog only.- No DBFS root.- No Hive Metastore.- No legacy runtimes below 13.3 LTS.- No “old way” of doing things.Disabling DBFS...
- 1483 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi guys,There was an email message sent by Azure Databricks with this information. So no direct link, just information sent by Databricks to users.
- 2 kudos
- 308 Views
- 0 replies
- 1 kudos
How we solved the "18-Hour Running Job" problem with Data-Driven Timeouts
Hi everyone,I recently dealt with a frustrating scenario: a Databricks job that usually takes minutes ran for 18 hours without failing, quietly consuming compute and blocking downstream pipelines.The driver hadn't crashed, and the job hadn't failed—i...
- 308 Views
- 0 replies
- 1 kudos
- 421 Views
- 0 replies
- 2 kudos
Lakeflow Spark Declarative Pipelines now decouples pipeline and tables lifecycle
Ever deleted a pipeline… and accidentally wiped out the data with it? Databricks just introduced a beta feature that lets you decouple pipelines from the tables they manage.Lakeflow Spark Declarative Pipelines were desinged with data-as-code approach...
- 421 Views
- 0 replies
- 2 kudos
- 2713 Views
- 2 replies
- 1 kudos
Databricks Vector Search Integration: Powering Claude Desktop with MCP
https://medium.com/@bijumathewt/databricks-vector-search-integration-powering-claude-desktop-with-mcp-838c591b50b5
- 2713 Views
- 2 replies
- 1 kudos
- 1 kudos
Good Question Edonaire. There 2 options here. Continuous and Triggered. If continuous, it will take care of incrimental load automatically, but costly.Triggered can be filed by setting up job with a task to run the "Refresh" code.
- 1 kudos
| User | Count |
|---|---|
| 85 | |
| 72 | |
| 49 | |
| 44 | |
| 42 |
