- 1822 Views
- 1 replies
- 1 kudos
Terraform support for AI/BI dashboards
AI/BI dashboards can now be managed through Terraform.Dashboard using serialized_dashboard attribute: data "databricks_sql_warehouse" "starter" { name = "Starter Warehouse" } resource "databricks_dashboard" "dashboard" { display_name = "...
- 1822 Views
- 1 replies
- 1 kudos
- 1 kudos
if the content of `file_path` has changed, terraform detects no changes. It is better if you make it checking md5 of the file to allow resource updates.
- 1 kudos
- 362 Views
- 0 replies
- 2 kudos
Scaling Databricks Pipelines with Templates & ADF Orchestration
In a Databricks project integrating multiple legacy systems, one recurring challenge was maintaining development consistency as pipelines and team size grew.Pipeline divergence tends to emerge quickly:• Different ingestion approaches• Inconsistent tr...
- 362 Views
- 0 replies
- 2 kudos
- 483 Views
- 0 replies
- 1 kudos
Databricks AIBI: Moving from Report Factories to bAIBI
Organizations created report factories in the last few decades. We have spent decades in creating the paginated reports and interactive dashboards in various BI tools yet face the same bottleneck when the business asks a question, and data team takes...
- 483 Views
- 0 replies
- 1 kudos
- 551 Views
- 0 replies
- 2 kudos
Bristol's first ever Databricks Meetup
What an excellent evening at the inaugural Databricks Bristol Meetup! It was great to finally have an Databricks community in Bristol. A massive thanks to iO Associates for pulling this together and also to the awesome speakers. The evening had two g...
- 551 Views
- 0 replies
- 2 kudos
- 568 Views
- 0 replies
- 3 kudos
Stream a CockroachDB Changefeed to Databricks (Azure Edition)
Please check https://github.com/rsleedbx/crdb_to_dbx which has the steps and a working notebook. This guide shows how to stream CockroachDB data to Databricks using changefeeds, Azure Blob Storage, Unity Catalog, and Delta Lake. You get one platform...
- 568 Views
- 0 replies
- 3 kudos
- 2613 Views
- 1 replies
- 5 kudos
Resolved! Data Driven AI Roadmap Databricks Governance Best Practices Aligned with Gartner's AI Model
Introduction“AI First” - But Data Always Comes FirstI have been working in the data space for close to two decades. My journey started as an ETL developer and gradually evolved into roles spanning data engineering, platform design, and solution archi...
- 2613 Views
- 1 replies
- 5 kudos
- 5 kudos
@Saurabh2406 , I really appreciate how you grounded the “AI-first” conversation in the reality that data governance, security, and quality are what actually determine whether AI can scale beyond pilots. The tie-in to Gartner’s AI maturity model, and ...
- 5 kudos
- 2878 Views
- 1 replies
- 4 kudos
Wait, Did Databricks Just Put Git Inside My Database?
Wait, Did Databricks Just Put Git Inside My Database? If you've been scratching your head at Lakebase's "branching" feature wondering "am I working with a database or GitHub?"—you're not alone. Let me break down what's actually happening here, becaus...
- 2878 Views
- 1 replies
- 4 kudos
- 4 kudos
@AbhaySingh , This was a fun read — and a great way to spark discussion about what “Git inside my database” really means in practice. From what I’m seeing in the product world, Databricks isn’t literally putting Git inside the storage engine of your...
- 4 kudos
- 1085 Views
- 0 replies
- 4 kudos
Beyond Notebooks: Why SSH Access to the Databricks Driver Matters
IntroductionCloud-native data platforms like Azure Databricks are powerful because they abstract away infrastructure so you can focus on data engineering, analytics, and ML workloads. However, there are situations where you may run into issues that r...
- 1085 Views
- 0 replies
- 4 kudos
- 1226 Views
- 0 replies
- 1 kudos
New Feature for developer-productivity
Databricks has added 2 new feature on its UI. These are small but quite effective for the developer productivity. 1. Paste images into notebooksCopy images from your local file system and paste them into markdown cells in Databricks notebookshttps:/...
- 1226 Views
- 0 replies
- 1 kudos
- 6684 Views
- 4 replies
- 9 kudos
Building a Metadata Table-Driven Framework Using LakeFlow Declarative (Formerly DLT) Pipelines
IntroductionScaling data pipelines across an organization can be challenging, particularly when data sources, requirements, and transformation rules are always changing. A metadata table-driven framework using LakeFlow Declarative (Formerly DLT) enab...
- 6684 Views
- 4 replies
- 9 kudos
- 9 kudos
can you please share the details how this can be implemented using a sample use case in step by step process. Also python code that needs to written in each layer (bronze/silver/gold)
- 9 kudos
- 16970 Views
- 2 replies
- 8 kudos
Turning Databricks into an AI pair‑programmer with Claude‑powered coding agents
Databricks + Claude Code This guide walks through a practical, end‑to‑end setup: installing Claude Code, wiring it to Anthropic models served from Databricks, and configuring authentication so everything “just works” from your terminal and editor. Yo...
- 16970 Views
- 2 replies
- 8 kudos
- 8 kudos
I have yet to use Claude within Databricks - Thanks for this @pradeep_singh
- 8 kudos
- 877 Views
- 0 replies
- 1 kudos
Hive (Dark) Metastore — Azure Databricks Standard Tier Retirement is a great move
Retirement is planned for Azure in Oct 2026. Completed in other clouds in Oct 2025Data residing in the Hive Metastore is opaque, suffers from low governance and is siloed in legacy technical constructs. The Hive Metastore (HMS) was a technology revol...
- 877 Views
- 0 replies
- 1 kudos
- 1128 Views
- 0 replies
- 0 kudos
You can use built-in AI functions directly in Databricks SQL
Databricks provides built-in AI functions that can be used directly in SQL or notebooks, without managing models or infrastructure.Example:SELECT ticket_id, ai_generate( 'Summarize this support ticket:\n{{text}}', 'databricks-dbrx-instruct', descript...
- 1128 Views
- 0 replies
- 0 kudos
- 1078 Views
- 2 replies
- 8 kudos
How can I tell my Dashboard visualizations aren't stale?
With AI/BI Dashboards, a best practice is for the creator/owner to 'Schedule' the Dashboard to rerun the underlying datasets when changes have occurred. This ensures the Visualizations are rendered with the freshest data. But users still will questi...
- 1078 Views
- 2 replies
- 8 kudos
- 8 kudos
@mark_ott That is a nice idea and quite useful. Quick question: how did you define 'stale' data in your case? So what is the threshold at which your 'conditional equation' color codes the date red? did you somehow link that to the refresh schedule?
- 8 kudos
- 3321 Views
- 2 replies
- 6 kudos
Data + AI Is Not the Future at Databricks. It’s the Present.
One thing becomes very clear when you spend time in the Databricks community: AI is no longer an experiment. It is already part of how real teams build, ship, and operate data systems at scale.For a long time, many organizations treated data engineer...
- 3321 Views
- 2 replies
- 6 kudos
| User | Count |
|---|---|
| 85 | |
| 75 | |
| 72 | |
| 60 | |
| 43 |
