Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, November 5! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 601 Views
- 0 replies
- 2 kudos
2 weeks ago
NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...
- 1341 Views
- 1 replies
- 0 kudos
a week ago
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 1078 Views
- 0 replies
- 2 kudos
2 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 3718 Views
- 0 replies
- 4 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 779 Views
- 0 replies
- 1 kudos
2 weeks ago
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
- 555 Views
- 1 replies
- 5 kudos
2 weeks ago
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 748 Views
- 0 replies
- 4 kudos
3 weeks ago
Community Activity
- 38 Views
- 0 replies
- 0 kudos
Private network gateway (ALL_TRAFFIC): serverless can't reach on-prem by raw IPv4, only by hostname
Hi all,We're testing the private network gateway (Beta) on Azure Databricks so that serverless compute egresses through a subnet in our VNet and reaches on-prem resources (through a hub firewall + ExpressRoute/VPN) from a predictable IP range.Setup- ...
- 38 Views
- 0 replies
- 0 kudos
- 51 Views
- 1 replies
- 1 kudos
Cluster Creation Failed
Hi Everyone, I am encountering an issue with Databricks cluster creation and would appreciate your support in resolving it.During cluster launch, the creation fails with the following network health check error:Error Details: - Error Code: X_NHC_CON...
- 51 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi,Both checks timing out, the control plane (centralindia.azuredatabricks.net) and www.databricks.com, usually means the cluster subnets have no outbound path at all, not a problem with one specific endpoint. The error codes doc says the same: when ...
- 1 kudos
- 179 Views
- 2 replies
- 0 kudos
Unity AI Gateway Observability: Models, MCP Tools, and Coding Agents
Databricks Unity AI Gateway provides a unified way to monitor and understand AI activity through its built-in Workspace AI Gateway Usage Analytics dashboard and the underlying system.ai_gateway.usage system table.Some useful capabilities include:Mode...
- 179 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
@jimcarre system.ai_gateway.usage provides quite useful coding-agent session metadata, including the agent name/version, session ID, model, token consumption, latency and request status etc.For eg, in my OpenCode validation, I could correlate all suc...
- 0 kudos
- 45 Views
- 0 replies
- 0 kudos
Partner Champion nomination – no Champions or PSA at my company (LATAM)
Hi Databricks team,I'm a Senior Data Engineer at DB, a Databricks partner in Brazil, and I'd like to be nominated for the Partner Champion Program (Solutions Architect track). Our company doesn't have any Partner Champions yet and we're not aligned w...
- 45 Views
- 0 replies
- 0 kudos
- 10892 Views
- 5 replies
- 3 kudos
Data Migration from SAP S/4HANA to Databricks
May someone please help me designing the Migration of SAP S/4 HANA to Databricks. How to design this. what all we need to consider as LLD.1. How Data needs to be extracted and by which tool ? near–real-time replication is required2. Each layer for Da...
- 10892 Views
- 5 replies
- 3 kudos
Latest Reply
- 3 kudos
@Pratikmsbsvm I will try to be brief but accurate.1. Getting data out of SAPYou need a properly supported connector/extraction method. You can start researching Fivetran, SNP Glue and alike. What you need to understand is that this can be expensive, ...
- 3 kudos
- 335 Views
- 2 replies
- 1 kudos
AI Agents Should Not Start Every Conversation From Zero
Databricks Agent Memory brings an interesting new direction to building AI agents that can learn from past interactions.Recently, Databricks introduced Agent Memory, and I think this is an interesting step toward making AI agents more useful in every...
- 335 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Worth knowing before anyone builds on it: the docs now mark the earlier managed memory store as deprecated and point new agents at the newer agent memory plus agent sessions, which Databricks runs on Lakebase for you. The self-managed Lakebase route ...
- 1 kudos
- 1576 Views
- 3 replies
- 0 kudos
Resolved! Databricks Cost Estimation Template
Hi Databricks Team, Is there a standard Databricks cost estimation template(xl), sizing calculator, or TCO tool that allows us to provide the following inputs and derive an approximate monthly and annual platform cost:Source systems and their types (...
- 1576 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
A standardized cost estimation template would be extremely useful for projects of this scale. Combining workload frequency, execution time, data volume, concurrency, and environment requirements into one model would make monthly and annual cost proje...
- 0 kudos
- 141 Views
- 2 replies
- 0 kudos
Workspaces Prefetch error: 500
I registered for Databricks Free Edition using Google authentication. Google login succeeds and I can see my account name. However, when I select my account to enter the workspace, I receive a "Workspaces Prefetch error: 500". This also happens in an...
- 141 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Multiple users reported this issue. The issue here is likely a temporary service degradation that broke the sign in flow for few workspaces hosted in the US region. The login page works and initial authentication (Google login or OTP) succeeds, but t...
- 0 kudos
- 67 Views
- 0 replies
- 0 kudos
"account users" system group has the Account admin role. Can it be removed, and how do we get a per-
We manage Databricks on AWS with Terraform (databricks provider 1.x), using one Unity Catalog metastore shared by several workspaces. Each customer gets its own workspace, an ISOLATED catalog, an ISOLATED storage credential, and an ISOLATED external ...
- 67 Views
- 0 replies
- 0 kudos
- 60 Views
- 0 replies
- 0 kudos
Databricks Free Edition – AI Playground Empty and system.ai Schema Does Not Exist
Hello Databricks Team,I recently created a new Databricks Free Edition account using my Google account and also completed LinkedIn identity verification.I am learning Generative AI and prompt engineering, but I cannot access any foundation models in ...
- 60 Views
- 0 replies
- 0 kudos
- 55 Views
- 0 replies
- 0 kudos
REQUEST ESCALATION: free resolution needed (purge soft-deleted tables OR raise quota)
My request — ONE of these two free resolutions is enough:Server-side purge of ~438 soft-deleted test tables in the UNDROP recovery window on metastore fd1c7b60-c241-495d-93f6-7c95d07f3b26 (all are unnecessary test artifacts, all owned by nani.onyx07@...
- 55 Views
- 0 replies
- 0 kudos
- 61 Views
- 0 replies
- 0 kudos
REQUEST ESCALATION: free resolution needed (purge soft-deleted tables OR raise quota)
Dear Databricks Support Team,My request — ONE of these two free resolutions is enough:Server-side purge of ~438 soft-deleted test tables in the UNDROP recovery window on metastore fd1c7b60-c241-495d-93f6-7c95d07f3b26 (all are unnecessary test artifac...
- 61 Views
- 0 replies
- 0 kudos
- 81 Views
- 1 replies
- 0 kudos
Support for mTLS in oracle
Hi all,We want to ingest from an Oracle Autonomous Database on Exadata Cloud@Customer with the Lakeflow Connect query-based Oracle connector (classic compute). The database enforces mutual TLS: the listener requires a client certificate from the Orac...
- 81 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @jakobhaggstrom, Thanks for the detailed write-up.You've read it correctly. Today, Unity Catalog Oracle connections, Lakehouse Federation and the Lakeflow Connect Oracle connectors don't support client-certificate or Oracle wallet (mTLS) authentic...
- 0 kudos
- 127 Views
- 2 replies
- 1 kudos
Add resource to app space
Hi,I recently started trying out the Genie App Builder first presented at DAIS. For this I created an app space and I wanted to connect my app to a lakebase project. But I can't seem to find any options to do this like it works with apps which are no...
- 127 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hello @JanW Following up on the answer above from @saurabh18cs and the results of a quick API test. Thank you for setting out what you tried and how you compared it with an app outside a space. That made the case easy to reproduce Short answer: You...
- 1 kudos
- 74 Views
- 1 replies
- 1 kudos
Lakeflow Connect – Hard Deletion Sync: GA Timeline and Production Readiness
Hello Databricks Community,We are using a Lakeflow Connect managed ingestion pipeline with the query-based connector to ingest Oracle tables via Unity Catalog foreign catalogs (Lakehouse Federation) on Azure Databricks.One of our requirements is to c...
- 74 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @faruk, Thanks for the detailed questions. You're right that hard-deletion tracking (hard_deletion_sync_min_interval_in_seconds) is still in Beta. GA timeline: There's no public GA date yet. The release notes and the query-based connector referenc...
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1506 | |
| 1255 | |
| 1189 | |
| 961 |
Latest from our Blog
Assume, don't inherit. Putting Databricks RBAC to work.
Access problems in Databricks are rarely about missing permissions. More often they are about people carrying every permission they have ever been given into every session. Someone gets added to a fin...
Geospatial Reasoning with Genie Agents: Competitor Impact in Your Trade Area (Part 1)
As we start building agents that deliver business value, it is inevitable that subsets of the data an agent needs are geospatial in nature. When agents are left to make geospatial decisions on their o...
Serving the Lakebase Data API Through Azure API Management
Why use APIM with Data API? The Data API is one of the underrated features of Lakebase. Traditionally, teams that wanted to share a database over HTTP built a layer of REST services in front of it. Th...
[PARTNER BLOG] Scaling Auto Loader on AWS: Moving to File Notification Mode with Managed File Events
Contents IntroductionUnderstanding the Key ConceptsWhy File Notification with Managed File Events?Key Benefits of Managed File EventsArchitecture OverviewPrerequisitesPhase 1: AWS IAM SetupPhase 2: Da...
