Most of the guidance on getting SQL Server data into Databricks quietly assumes the SQL Server is already in Azure. If it is, the managed connector story is easy. But on a lot of real projects the database is sitting on-premises, in a data centre tha...
There's a lot of talk about "agent-ready data governance" right now, and the mechanics are well covered on this board: service principals per agent, Unity Catalog grants, AI Gateway guardrails, MCP tools as securables. The layer that sits on top of a...
When teams scale their Databricks Asset Bundles (DABs) adoption, one of the first infrastructure questions that comes up is: should we keep all our bundles in a single monorepo, or split them across dedicated repos per domain? Having run both models ...
Help Your Knowledge Reach More People Every Technical Blog, Community Article, MVP article, or answer you share can help someone beyond the Databricks Community. Small improvements in how you write can make your content easier to discover through C...
Thank you for sharing this practical guide, @Rishabh_Tiwari.I used these GEO best practices as the foundation for an open-source Agent Skill that helps writers apply the guidance while creating Databricks Community content.The skill can help users:• ...
Vector search is everywhere right now, but is it always the right tool for the job? Actually, noIf you need to find a specific Trace ID or error code buried in 100 million log rows, you don't want an AI model guessing what's "conceptually similar." Y...
In many data platforms, the problem is not that we do not have enough tables.Usually, we have too many.Bronze tables.Silver tables.Gold tables.Reporting views.Power BI calculations.Tableau logic.Excel extracts.Ad-hoc SQL.Notebook logic.After some tim...
The problem you're describing with metric definitions living in five different places is exactly what pushed us to add a Views layer on top of Gold in a recent SAP to Databricks migration.We had three Tableau workbooks calculating vendor aging. One u...
In programmatic advertising, the value of an impression depends on whether an ad is viewed by a user. The Real-Time Bidding Optimization Solution Accelerator shows how to predict ad viewability and use those insights to optimize bidding strategies, m...
Databricks Academy offers the free AI/BI for Data Analysts course to help data analysts use AI/BI Dashboards and AI/BI Genie for business intelligence on the Databricks platform. It focuses on practical skills for designing dashboards, creating Genie...
If you are early in a Hadoop to Databricks migration, the artifact worth building before any pilot is a function-by-function control map. For each capability the Hadoop estate currently provides, record three things: the control objective that must s...
I am trying to make a GET /api/2.1/jobs/list call in a Notebook to get a list of all jobs in my workspace but am unable to do so due to a 403 "Invalid access to Org" error message. I am using a new PAT and the endpoint is correct. I also have workspa...
I don't know if this issue has been resolved yet, but I found the solution. Even if your credentials have workspace admin access, you must check if the service principal you are using lacks workspace-level access permissions.
Connecting marketing activity and ad spend to sales is not always straightforward across channels. The Measure Ad Effectiveness With Multi-Touch Attribution Solution Accelerator helps organizations understand what works best by pinpointing the impact...
Spark shuffles can be confusing at first. I put together this simple illustration to explain the concept visually. Hope it's useful!
How does Databricks process terabytes of data in just minutes?It's not about a single technology. It's the perfect combination of:里 Data Partitioning + Apache Spark (distributed processing) + Delta Lake (an optimized storage format).Just like a Fe...
Originally published at vmariiechko.com.This started with a broken Spark fixture on an ordinary day. Every test that needed Spark failed on the same setup error, and my coding agent had to read all of it before it could fix a thing. Reproduced and me...
Hi Community,Databricks and Microsoft just announced a major expansion of their strategic partnership extending through the 2030s:https://www.databricks.com/company/newsroom/press-releases/databricks-and-microsoft-expand-partnership-help-enterprises-...
| User | Count |
|---|---|
| 85 | |
| 76 | |
| 73 | |
| 60 | |
| 43 |
