Databricks Community

ShamenParis

The shift from classic compute to Serverless in Databricks is a game-changer, but the migration process requires a solid strategy. After diving deep into serverless conversions recently, I’ve put together a guided playbook.Here are my top 5 takeaways...

ShamenParis · 09-18-2026

Databricks Serverless is incredible for abstracting infrastructure, but because it scales based on the volume of pending tasks, relying on default configurations for massive data ingestion can leave performance on the table.I recently ran an experime...

ShamenParis · 09-13-2026

Building robust Medallion architectures takes time. Writing the same boilerplate for Auto Loader, streaming tables, and SCD Type 2 merges across different projects is a bottleneck.So, I ran an experiment: What happens if you let AI write your Spark D...

ShamenParis · 08-14-2026

Most public GitHub repositories for Databricks are just dry code dumps. You get a massive YAML file, a basic README, and are expected to just figure it out.When building production-grade infrastructure, engineers need to see the architecture and unde...

ShamenParis · 08-04-2026

Vector search is everywhere right now, but is it always the right tool for the job? Actually, noIf you need to find a specific Trace ID or error code buried in 100 million log rows, you don't want an AI model guessing what's "conceptually similar." Y...

ShamenParis

Hi @orlandovallejos , Check the Permissions tab to view access rights. If you can't see the external location permissions, reach out to your admin team. Keep in mind that these permissions are tied to the metastore, not the workspace

ShamenParis

@cpayne_vax you've mapped this out perfectly.@ThomazNeto really nailed the WHEN NOT approach, which is the real lifesaver here. By using WHEN NOT has_tag('mask_scope') for your default policy, you don't even need to manually apply a 'standard' tag to...

ShamenParis

Hi @daniel_benchANT ,Lakehouse//RT is currently in Beta. For many workspaces, admins can enable it directly by going to the workspace menu (top-right) -> Previews, searching for Lakehouse RT, and toggling it on.Lakehouse RT Doc However, since you me...

ShamenParis

Hi @cpayne_vax ,I’ve run into this exact inheritance trap while architecting platforms with Unity Catalog.Because UC always prioritizes the most restrictive policy to prevent accidental data leaks, fighting the catalog-to-schema inheritance is a losi...

ShamenParis · 09-14-2026

@ivanvyd thank you and please refer below link:https://shamenparis.github.io/databricks-dabs-playbook/

Databricks Community

User Stats

User Activity

The Databricks Serverless Conversion Playbook

How to force Databricks Serverless to process 1 TB (40 Billion Rows) in 14 Minutes

I Built an AI-Powered Data Pipeline Generator for Databricks — Here Is What Happened

Visual, step-by-step curriculum for mastering DABs and Infrastructure as Code

Demystifying Databricks Full Text Search: It’s Not Vector Search (And That’s Okay!)

Re: External location Manage permission

Re: How to override ABAC policies

Re: Access to Lakehouse Real-Time (RT) in the preview tab

Re: How to override ABAC policies

Re: Databricks Community Champion - August 2026 - Shamen Paris