Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
Hi everyone,Part 2 of my Helsinki live transit project is out. In part 1 I built a Databricks App that follows every tram and metro train in Helsinki in real time: a Lakeflow pipeline on HSL's live MQTT feed, Lakebase behind the live map, and a Genie...
Hey @SumeshKashyap Thanks for writing this up, and for the question at the end. I found it interesting enough that I ran an experiment on it.I set up bike, walk or wait inputs like the ones your agent gets back from its tools (16 scenarios over six H...
Five controls to put in place before rolling out Databricks Genie Agents.The benchmarks passed. Business users are ready. But who checks failed questions, approves updates, watches query performance, and manages spending after go-live?For a Databrick...
Every team that builds a Databricks Genie space goes through the same moment. The demo went well, the first few questions came back clean, and then a stakeholder asks something slightly different and the number is wrong. Not obviously wrong, which wo...
Hey Team, in my last post I asked how much AI has actually changed your day to day, and the responses were fantastic. But let's talk about the other side for a minute.
I'll go first — I've started second-guessing almost everything I see on social med...
One common AI pet peeve is when responses sound confident but miss the actual question, so improving accuracy, transparency, and context awareness would make AI tools more useful. Treating nail infections early stops paronychia from reaching the toe ...
The shift from classic compute to Serverless in Databricks is a game-changer, but the migration process requires a solid strategy. After diving deep into serverless conversions recently, I’ve put together a guided playbook.Here are my top 5 takeaways...
Sometimes the cheapest migration is no migration at all.An organization has already invested in Palantir Foundry, with established pipelines, validated data, Ontology models and operational applications. Another team wants to use the same data in Dat...
If you are new to the Databricks ecosystem, you have probably heard the name Genie in a demo, a keynote, or a hallway conversation. The pitch is simple and a little magical: ask a question about your data in plain English, and get back a table, a cha...
Databricks Training & Certifications
Learn Databricks Performance Optimization
Measure first, then make your Spark and Delta Lake workloads faster and cheaper.
Spark UI & Query Profile Liquid clustering & data skipping Photon & caching
Sl...
Hi everyone! I built a near-real-time app that follows every tram and metro train in Helsinki using only Databricks: no Kafka, no extra servers, and the whole thing deploys from one repository.What the app doesA live map of every tram and metro train...
A practical guide from 12 years of building Azure data platforms.If you've spent any time working on Azure data platforms, you've probably hit this question at some point — should I build this in Azure Data Factory or just do it in Databricks?I've be...
Great article clarifying the difference between ADF and Databricks Workflows!I have a design question for an architecture similar to your hybrid pattern: We use ADF to ingest raw data into the Bronze layer, while Databricks handles the downstream Bro...
Persistent Memory Is Only the BeginningAs AI agents move from isolated conversations toward persistent workflows, memory is becoming part of enterprise AI infrastructure.An agent that remembers previous interactions can reduce repetitive instructions...
@ShenXu : I found this really interesting so did a bit of experimentation. My lab notes and a test notebook are available at https://medium.com/lab-notes/unity-catalog-functions-kept-ai-agents-from-acting-on-stale-memory-7d63e15f992b
Genome-wide association studies help identify genetic variations associated with a disease or trait. The Genome-Wide Association Studies Solution Accelerator builds on Glow, an open source project for genomic analysis, to provide a fast, scalable and...
When teams start looking at Databricks cost, the first instinct is usually to query system.billing.usage.That gives a good view of Databricks consumption, but it is only one part of the overall cost picture..For a more complete FinOps view on Azure, ...