cancel
Showing results for 
Search instead for 
Did you mean: 
Community Articles
Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Hubert-Dudek
by • Databricks MVP
  • 1260 Views
  • 0 replies
  • 3 kudos

Secret magic commands

Secret magic commands, there are a lot of them. Check my blogs to see which one can simplify your daily work. First one is %%writefile, which can be used to write a new file, for example, another notebook #databricks more magic commands:- https://dat...

magic1post.png
  • 1260 Views
  • 0 replies
  • 3 kudos
joseph_in_sf
by • New Contributor III
  • 761 Views
  • 0 replies
  • 0 kudos

Turn PRDs into Databricks PySpark pipelines with Agentic AI using Docker, Ollama, and QWEN3:4b

I’ve seen many examples of AI that can help you code individual routines and such, mostly junior-level coding help. The goal of this POC is to give the AI a general PRD containing coding examples and have it generate a Databricks pipeline from such.R...

  • 761 Views
  • 0 replies
  • 0 kudos
Hubert-Dudek
by • Databricks MVP
  • 1054 Views
  • 0 replies
  • 1 kudos

Runtime 18 / Spark 4.1 improvements

Runtime 18 / Spark 4.1 brings parameter markers everywhere #databricks Latest updates: read: https://databrickster.medium.com/databricks-news-week-1-29-december-2025-to-4-january-2025-432c6231d8b1 watch:https://www.youtube.com/watch?v=LLjoTkceKQI

param.png
  • 1054 Views
  • 0 replies
  • 1 kudos
BijuThottathil
by • New Contributor III
  • 2303 Views
  • 0 replies
  • 2 kudos

Zero-Copy, Zero Friction: Bridging the Gap Between Databricks and Microsoft Fabric using Delta Share

Databricks Microsoft Fabric: Zero-Copy Integration with Delta SharingManaging data across different ecosystems usually means messy ETL pipelines and high storage costs. I implemented a Zero-Copy architecture to streamline this. By leveraging Delta S...

ssss.png
  • 2303 Views
  • 0 replies
  • 2 kudos
Hubert-Dudek
by • Databricks MVP
  • 900 Views
  • 0 replies
  • 1 kudos

Runtime 18 / Spark 4.1 improvements

Runtime 18 / Spark 4.1 brings Literal string coalescing everywhere, thanks to what you can make your code more readable. Useful, for example, for table comments #databricks Latest updates: read: https://databrickster.medium.com/databricks-news-week-1...

coales.png
  • 900 Views
  • 0 replies
  • 1 kudos
Hubert-Dudek
by • Databricks MVP
  • 965 Views
  • 0 replies
  • 1 kudos

Secrets in UC

We can see new grant types in Unity Catalog. It seems that secrets are coming to UC, and I especially love the "Reference Secret" grant. #databricks Read more:- https://databrickster.medium.com/databricks-news-week-1-29-december-2025-to-4-january-202...

secrets.png
  • 965 Views
  • 0 replies
  • 1 kudos
Hubert-Dudek
by • Databricks MVP
  • 2416 Views
  • 0 replies
  • 2 kudos

DABS JSON Plan

DABS deployment from a JSON plan is one of my favourite new options. You can review the changes or even integrate the plan with your CI/CD process. #databricks Read more:- https://databrickster.medium.com/databricks-news-week-1-29-december-2025-to-4-...

plan.png
  • 2416 Views
  • 0 replies
  • 2 kudos
AbhaySingh
by • Databricks Employee
  • 3754 Views
  • 0 replies
  • 1 kudos

The Agile Path to Autonomous Agents

I read about a team demo about their shiny new "autonomous AI agent” leadership. It queried databases, generated reports, sent Slack notifications—all hands-free. Impressive stuff. Two weeks later? $12K in API costs, staging data accidentally pushed ...

  • 3754 Views
  • 0 replies
  • 1 kudos
Hubert-Dudek
by • Databricks MVP
  • 733 Views
  • 0 replies
  • 1 kudos

Ingest Everything, let's start with Excel

We can ingest Excel into Databricks, including natively from SharePoint. It was top news in December, but in fact is part of a big strategy which will allow us to ingest any format from anywhere in databricks. Foundation is already built as there is ...

excel.png
  • 733 Views
  • 0 replies
  • 1 kudos
rathorer
by • Databricks Partner
  • 14166 Views
  • 1 replies
  • 2 kudos

Building MultiTenant Architecture on Databricks Platform

This use case demonstrates how a SaaS product can be deployed for multiple customers or business units, ensuring data isolation at every layer through workspace separation, fine-grained access control with Unity Catalog, and secure processing using U...

rathorer_0-1753157201307.png rathorer_1-1753157291951.png rathorer_2-1753157577943.png rathorer_3-1753157853253.png
Community Articles
Architecture
multi-tenant
Security framework
  • 14166 Views
  • 1 replies
  • 2 kudos
Latest Reply
andyssojet
New Contributor II
  • 2 kudos

Good breakdown of the Databricks storage and catalog isolation patterns.One thing to keep in mind: workspace binding and Unity Catalog handle data isolation well, but the authentication layer is where tenant context gets established first. Without pr...

  • 2 kudos
Hubert-Dudek
by • Databricks MVP
  • 553 Views
  • 0 replies
  • 2 kudos

Labels and sort by Field

Dashboards now offer more flexibility, allowing us to use another field or expression to label or sort the chart. See demo at:- https://www.youtube.com/watch?v=4ngQUkdmD3o&t=893s- https://databrickster.medium.com/databricks-news-week-52-22-december-2...

202601dashboards.png
  • 553 Views
  • 0 replies
  • 2 kudos
emma_s
by • Databricks Employee
  • 3100 Views
  • 1 replies
  • 5 kudos

Databricks Excel Reader

We’ve recently created a new Excel reader function, and I decided to have a play around with it. I’ve used an open dataset for this tutorial, so you can follow along too. Using file available here - https://www.ons.gov.uk/employmentandlabourmarket/pe...

emma_s_0-1767193777925.png emma_s_1-1767193777925.png emma_s_2-1767193777925.png emma_s_3-1767193777926.png
  • 3100 Views
  • 1 replies
  • 5 kudos
Latest Reply
Hubert-Dudek
Databricks MVP
  • 5 kudos

Nice example!

  • 5 kudos
Hubert-Dudek
by • Databricks MVP
  • 1207 Views
  • 0 replies
  • 1 kudos

Databricks Lakeflow Jobs Workflow Backfill

When something goes wrong, and your pattern involves daily MERGE operations in your jobs, backfill jobs let you reload multiple days in a single execution without writing custom scripts or manually triggering runs. Read more:- https://www.sunnydata.a...

backfill.png
  • 1207 Views
  • 0 replies
  • 1 kudos
Hubert-Dudek
by • Databricks MVP
  • 1453 Views
  • 0 replies
  • 3 kudos

Goodbye community edition, Long live the free edition

I just logged in to the community edition for the last time and spun up the cluster for the last time. Today is the last day, but it's still there. Haven't logged in there for a while, as the free edition offers much more, but it is a place where man...

goodbye_era.png
  • 1453 Views
  • 0 replies
  • 3 kudos
Labels