Lakebase Search brings vector search and BM25 keyword search directly into Lakebase, Databricks’ managed, serverless PostgreSQL offering.It introduces two PostgreSQL extensions:lakebase_vector — Approximate nearest-neighbor (ANN) vector search, compa...
Every team that builds a Databricks Genie space goes through the same moment. The demo went well, the first few questions came back clean, and then a stakeholder asks something slightly different and the number is wrong. Not obviously wrong, which wo...
Hey Team, in my last post I asked how much AI has actually changed your day to day, and the responses were fantastic. But let's talk about the other side for a minute. I'll go first — I've started second-guessing almost everything I see on social med...
One common AI pet peeve is when responses sound confident but miss the actual question, so improving accuracy, transparency, and context awareness would make AI tools more useful. Treating nail infections early stops paronychia from reaching the toe ...
The shift from classic compute to Serverless in Databricks is a game-changer, but the migration process requires a solid strategy. After diving deep into serverless conversions recently, I’ve put together a guided playbook.Here are my top 5 takeaways...
Sometimes the cheapest migration is no migration at all.An organization has already invested in Palantir Foundry, with established pipelines, validated data, Ontology models and operational applications. Another team wants to use the same data in Dat...
If you are new to the Databricks ecosystem, you have probably heard the name Genie in a demo, a keynote, or a hallway conversation. The pitch is simple and a little magical: ask a question about your data in plain English, and get back a table, a cha...
Databricks Training & Certifications Learn Databricks Performance Optimization Measure first, then make your Spark and Delta Lake workloads faster and cheaper. Spark UI & Query Profile Liquid clustering & data skipping Photon & caching Sl...
Hi everyone! I built a near-real-time app that follows every tram and metro train in Helsinki using only Databricks: no Kafka, no extra servers, and the whole thing deploys from one repository.What the app doesA live map of every tram and metro train...
Thanks for sharing this insightful app
A practical guide from 12 years of building Azure data platforms.If you've spent any time working on Azure data platforms, you've probably hit this question at some point — should I build this in Azure Data Factory or just do it in Databricks?I've be...
Great article clarifying the difference between ADF and Databricks Workflows!I have a design question for an architecture similar to your hybrid pattern: We use ADF to ingest raw data into the Bronze layer, while Databricks handles the downstream Bro...
Persistent Memory Is Only the BeginningAs AI agents move from isolated conversations toward persistent workflows, memory is becoming part of enterprise AI infrastructure.An agent that remembers previous interactions can reduce repetitive instructions...
@ShenXu : I found this really interesting so did a bit of experimentation. My lab notes and a test notebook are available at https://medium.com/lab-notes/unity-catalog-functions-kept-ai-agents-from-acting-on-stale-memory-7d63e15f992b
Genome-wide association studies help identify genetic variations associated with a disease or trait. The Genome-Wide Association Studies Solution Accelerator builds on Glow, an open source project for genomic analysis, to provide a fast, scalable and...
When teams start looking at Databricks cost, the first instinct is usually to query system.billing.usage.That gives a good view of Databricks consumption, but it is only one part of the overall cost picture..For a more complete FinOps view on Azure, ...
Insurance · Reinsurance · Banking · Telecom · Retail · Agriculture — Per-Object API Calls to Per-Cell Scoring with H3 and Native Spatial SQLBy @Phani_sannala, in collaboration with @sridharplvYour lakehouse already holds the geometry. Why are you shi...
Insurance · Reinsurance · Banking · Telecom · Retail · Agriculture — Per-Object API Calls to Per-Cell Scoring with H3 and Native Spatial SQL By @Phani_sannala, in collaboration with @sridharplvYour lakehouse already holds the geometry. Why are you s...
The quickest way to lose a self-service analytics programme is a bill nobody saw coming. In my last post I covered chargeback: working out, after the fact, which team spent what. That answers "whose cost is this?" It doesn't answer the question Finan...
| User | Count |
|---|---|
| 85 | |
| 77 | |
| 73 | |
| 60 | |
| 43 |
