- 403 Views
- 1 replies
- 2 kudos
Resolved! Databricks Metric Views: Why Gold Tables Are No Longer the End of the Pipeline
In many data platforms, the problem is not that we do not have enough tables.Usually, we have too many.Bronze tables.Silver tables.Gold tables.Reporting views.Power BI calculations.Tableau logic.Excel extracts.Ad-hoc SQL.Notebook logic.After some tim...
- 403 Views
- 1 replies
- 2 kudos
- 2 kudos
The problem you're describing with metric definitions living in five different places is exactly what pushed us to add a Views layer on top of Gold in a recent SAP to Databricks migration.We had three Tableau workbooks calculating vendor aging. One u...
- 2 kudos
- 464 Views
- 0 replies
- 1 kudos
Solution Accelerator Series | Real-Time Bidding Optimization
In programmatic advertising, the value of an impression depends on whether an ad is viewed by a user. The Real-Time Bidding Optimization Solution Accelerator shows how to predict ad viewability and use those insights to optimize bidding strategies, m...
- 464 Views
- 0 replies
- 1 kudos
- 1258 Views
- 6 replies
- 6 kudos
Learning Series | AI/BI for Data Analysts
Databricks Academy offers the free AI/BI for Data Analysts course to help data analysts use AI/BI Dashboards and AI/BI Genie for business intelligence on the Databricks platform. It focuses on practical skills for designing dashboards, creating Genie...
- 1258 Views
- 6 replies
- 6 kudos
- 188 Views
- 0 replies
- 0 kudos
Hadoop to Databricks Migration - Mapping HDFS, Hive, and YARN
If you are early in a Hadoop to Databricks migration, the artifact worth building before any pilot is a function-by-function control map. For each capability the Hadoop estate currently provides, record three things: the control objective that must s...
- 188 Views
- 0 replies
- 0 kudos
- 7976 Views
- 4 replies
- 0 kudos
Error code 403 - Invalid access to Org
I am trying to make a GET /api/2.1/jobs/list call in a Notebook to get a list of all jobs in my workspace but am unable to do so due to a 403 "Invalid access to Org" error message. I am using a new PAT and the endpoint is correct. I also have workspa...
- 7976 Views
- 4 replies
- 0 kudos
- 0 kudos
I don't know if this issue has been resolved yet, but I found the solution. Even if your credentials have workspace admin access, you must check if the service principal you are using lacks workspace-level access permissions.
- 0 kudos
- 471 Views
- 0 replies
- 1 kudos
Solution Accelerator Series | Measure Ad Effectiveness With Multi-Touch Attribution
Connecting marketing activity and ad spend to sales is not always straightforward across channels. The Measure Ad Effectiveness With Multi-Touch Attribution Solution Accelerator helps organizations understand what works best by pinpointing the impact...
- 471 Views
- 0 replies
- 1 kudos
- 311 Views
- 0 replies
- 3 kudos
What Is a Spark Shuffle? A Simple Visual Explanation ⭐
Spark shuffles can be confusing at first. I put together this simple illustration to explain the concept visually. Hope it's useful!
- 311 Views
- 0 replies
- 3 kudos
- 286 Views
- 0 replies
- 1 kudos
🚀 How does Databricks process terabytes of data in just minutes?
How does Databricks process terabytes of data in just minutes?It's not about a single technology. It's the perfect combination of:里 Data Partitioning + Apache Spark (distributed processing) + Delta Lake (an optimized storage format).Just like a Fe...
- 286 Views
- 0 replies
- 1 kudos
- 896 Views
- 4 replies
- 6 kudos
5 Minute Features - a new video series
I have spent the past couple of months building up a small hobby YouTube project where I run through Databricks Features in an easy to digest format.I am for a very hands-on and demo heavy approach so you can actually see what is going on, and how th...
- 896 Views
- 4 replies
- 6 kudos
- 6 kudos
Hot off the press with this one right as I saw the news!Want to know how RBAC works in just 5 (ish) minutes?Check out the newest 5 Minute Feature below!https://youtu.be/4V1ztTz7sdA
- 6 kudos
- 263 Views
- 0 replies
- 0 kudos
Keep a PySpark Test Flood Out of Your Coding Agent's Context Window
Originally published at vmariiechko.com.This started with a broken Spark fixture on an ordinary day. Every test that needed Spark failed on the same setup error, and my coding agent had to read all of it before it could fix a thing. Reproduced and me...
- 263 Views
- 0 replies
- 0 kudos
- 2054 Views
- 0 replies
- 3 kudos
Databricks & Microsoft Expand Partnership to 2030s: Architectural Impact on Azure Databricks
Hi Community,Databricks and Microsoft just announced a major expansion of their strategic partnership extending through the 2030s:https://www.databricks.com/company/newsroom/press-releases/databricks-and-microsoft-expand-partnership-help-enterprises-...
- 2054 Views
- 0 replies
- 3 kudos
- 14477 Views
- 4 replies
- 6 kudos
Getting Databricks Generative AI Engineer Associate (and What I Learned)
I just earned my Databricks Certified Generative AI Engineer Associate Certification, and in this post, I’m sharing the key tips, resources, and personal insights that helped me succeed. My certiticate from DatabricksNavigation:PreludeAbout the certR...
- 14477 Views
- 4 replies
- 6 kudos
- 6 kudos
Congratulations on your achievement! Your tips are really helpful. I also found this resource useful during my preparation: https://ln.run/-c8lD. It worked well alongside the official learning materials.
- 6 kudos
- 400 Views
- 0 replies
- 1 kudos
Rethinking Database Storage: Why LTAP (Lakebase) is the Next Paradigm Shift
For years, system architecture has been split by a fundamental design trade-off: OLTP for low-latency point reads/writes, and OLAP for massive analytical scanning.To bridge this gap, data engineering teams have historically built complex CDC pipeline...
- 400 Views
- 0 replies
- 1 kudos
- 265 Views
- 0 replies
- 0 kudos
Learning Series | Advanced Machine Learning Operations
Databricks Academy offers the free Advanced Machine Learning Operations course to help machine learning practitioners understand how to run ML projects more reliably at scale on Databricks. As the second course in the Advanced Machine Learning serie...
- 265 Views
- 0 replies
- 0 kudos
- 346 Views
- 0 replies
- 0 kudos
Handling Sensor Dropout in IoT Pipelines: A Quarantine Pattern with Lakeflow Declarative Pipelines
Why Your Solar Forecasting Model Doesn't Trust Every ZeroA data quality pattern for sensor dropout at IoT scale, using Lakeflow Declarative Pipelines (formerly DLT)A solar panel producing zero output at 2pm on a clear day is a maintenance ticket. A s...
- 346 Views
- 0 replies
- 0 kudos
| User | Count |
|---|---|
| 85 | |
| 75 | |
| 72 | |
| 60 | |
| 43 |
