- 8197 Views
- 4 replies
- 0 kudos
Error code 403 - Invalid access to Org
I am trying to make a GET /api/2.1/jobs/list call in a Notebook to get a list of all jobs in my workspace but am unable to do so due to a 403 "Invalid access to Org" error message. I am using a new PAT and the endpoint is correct. I also have workspa...
- 8197 Views
- 4 replies
- 0 kudos
- 0 kudos
I don't know if this issue has been resolved yet, but I found the solution. Even if your credentials have workspace admin access, you must check if the service principal you are using lacks workspace-level access permissions.
- 0 kudos
- 599 Views
- 0 replies
- 1 kudos
Solution Accelerator Series | Measure Ad Effectiveness With Multi-Touch Attribution
Connecting marketing activity and ad spend to sales is not always straightforward across channels. The Measure Ad Effectiveness With Multi-Touch Attribution Solution Accelerator helps organizations understand what works best by pinpointing the impact...
- 599 Views
- 0 replies
- 1 kudos
- 447 Views
- 0 replies
- 3 kudos
What Is a Spark Shuffle? A Simple Visual Explanation ⭐
Spark shuffles can be confusing at first. I put together this simple illustration to explain the concept visually. Hope it's useful!
- 447 Views
- 0 replies
- 3 kudos
- 371 Views
- 0 replies
- 1 kudos
🚀 How does Databricks process terabytes of data in just minutes?
How does Databricks process terabytes of data in just minutes?It's not about a single technology. It's the perfect combination of:里 Data Partitioning + Apache Spark (distributed processing) + Delta Lake (an optimized storage format).Just like a Fe...
- 371 Views
- 0 replies
- 1 kudos
- 357 Views
- 0 replies
- 0 kudos
Keep a PySpark Test Flood Out of Your Coding Agent's Context Window
Originally published at vmariiechko.com.This started with a broken Spark fixture on an ordinary day. Every test that needed Spark failed on the same setup error, and my coding agent had to read all of it before it could fix a thing. Reproduced and me...
- 357 Views
- 0 replies
- 0 kudos
- 2697 Views
- 0 replies
- 3 kudos
Databricks & Microsoft Expand Partnership to 2030s: Architectural Impact on Azure Databricks
Hi Community,Databricks and Microsoft just announced a major expansion of their strategic partnership extending through the 2030s:https://www.databricks.com/company/newsroom/press-releases/databricks-and-microsoft-expand-partnership-help-enterprises-...
- 2697 Views
- 0 replies
- 3 kudos
- 16322 Views
- 4 replies
- 6 kudos
Getting Databricks Generative AI Engineer Associate (and What I Learned)
I just earned my Databricks Certified Generative AI Engineer Associate Certification, and in this post, I’m sharing the key tips, resources, and personal insights that helped me succeed. My certiticate from DatabricksNavigation:PreludeAbout the certR...
- 16322 Views
- 4 replies
- 6 kudos
- 6 kudos
Congratulations on your achievement! Your tips are really helpful. I also found this resource useful during my preparation: https://ln.run/-c8lD. It worked well alongside the official learning materials.
- 6 kudos
- 606 Views
- 0 replies
- 1 kudos
Rethinking Database Storage: Why LTAP (Lakebase) is the Next Paradigm Shift
For years, system architecture has been split by a fundamental design trade-off: OLTP for low-latency point reads/writes, and OLAP for massive analytical scanning.To bridge this gap, data engineering teams have historically built complex CDC pipeline...
- 606 Views
- 0 replies
- 1 kudos
- 475 Views
- 0 replies
- 0 kudos
Learning Series | Advanced Machine Learning Operations
Databricks Academy offers the free Advanced Machine Learning Operations course to help machine learning practitioners understand how to run ML projects more reliably at scale on Databricks. As the second course in the Advanced Machine Learning serie...
- 475 Views
- 0 replies
- 0 kudos
- 472 Views
- 0 replies
- 0 kudos
Handling Sensor Dropout in IoT Pipelines: A Quarantine Pattern with Lakeflow Declarative Pipelines
Why Your Solar Forecasting Model Doesn't Trust Every ZeroA data quality pattern for sensor dropout at IoT scale, using Lakeflow Declarative Pipelines (formerly DLT)A solar panel producing zero output at 2pm on a clear day is a maintenance ticket. A s...
- 472 Views
- 0 replies
- 0 kudos
- 3147 Views
- 0 replies
- 1 kudos
Solution Accelerator Series | Social Determinants of Health
Driving seamless access to data on social determinants of health is important for helping healthcare professionals better understand health inequities across social groups. The Social Determinants of Health Solution Accelerator shows how healthcare d...
- 3147 Views
- 0 replies
- 1 kudos
- 1522 Views
- 0 replies
- 0 kudos
How Databricks Unity Catalog Business Semantics creates a governed layer for metrics
The problem: technically correct, but still inconsistentMost analytics teams eventually encounter the same frustrating pattern: one dashboard reports revenue at 10.2M, another at 10.6M, and a spreadsheet says 10.4M. Each result may be technically def...
- 1522 Views
- 0 replies
- 0 kudos
- 3227 Views
- 1 replies
- 2 kudos
Databricks Partner Tiers Explained for the People Who Build the Delivery
Databricks swapped the old partner labels this year; Registered / Select / Elite / Global Elite are gone, replaced by Bronze, Silver, Gold, and Platinum. Most write-ups on this are aimed at buyers choosing a vendor. I wanted to flip it for the people...
- 3227 Views
- 1 replies
- 2 kudos
- 2 kudos
@ericka-lorenz , thanks for this helpful practitioner-oriented summary, I feel it important to add a couple of small footnotes. Based on the public Databricks partner-program pages, certifications clearly matter, though partner tiering seems to run o...
- 2 kudos
- 925 Views
- 0 replies
- 2 kudos
Stop Translating Alteryx Boxes - A Lakebridge-assisted, test-driven migration to Azure Databricks
Lakebridge can assess an Alteryx estate, but the current support matrix does not list Alteryx for automated conversion or direct reconciliation. A safe migration therefore combines Lakebridge assessment with deliberate redesign, native Databricks eng...
- 925 Views
- 0 replies
- 2 kudos
- 891 Views
- 1 replies
- 2 kudos
Validating pointer-based Delta comparison architecture using flatMapGroupsWithState in Structured St
Hi everyone,I’m leading an implementation where we’re comparing events from two real-time streams — a Source and a Target — in Databricks Structured Streaming (Scala).Our goal is to identify and emit “delta” differences between corresponding records ...
- 891 Views
- 1 replies
- 2 kudos
- 2 kudos
The overall pattern is sound, but there are a few real production risks worth calling out. Delta point reads inside the state function are your biggest bottleneck. When flatMapGroupsWithState (or its replacement transformWithState) fetches a JSON fro...
- 2 kudos
| User | Count |
|---|---|
| 85 | |
| 75 | |
| 73 | |
| 60 | |
| 43 |
