Hey Community! Join us for a free Databricks Community sponsored BrickTalk on Thursday, July 30! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and AI, ...
- 782 Views
- 2 replies
- 5 kudos
a week ago
VIRTUAL TRAINING Time: AMER Aug 19 – Aug 20, 2026 | 9:00 AM PT / 12:00 PM ET Register for the Workshop Note: Marking RSVP on this Community event does not register you for the workshop. Please use the Register button above to complete your registr...
- 74 Views
- 0 replies
- 0 kudos
15 hours ago
New in Community Say hello to the Genie Hub Your questions about Databricks Genie, answered by the people actually building with it. Ask the community anything about Genie… Ask → Genie runs on plain-language conversation - you ask, it answers f...
- 289 Views
- 1 replies
- 4 kudos
Wednesday
Community Ask Hey Community! Your Databricks Community profile is often the first thing other members see when they come across your posts, solutions, blogs, or event participation. A complete profile helps other members understand who you are,...
- 1018 Views
- 0 replies
- 4 kudos
2 weeks ago
Help Your Knowledge Reach More People Every Technical Blog, Community Article, MVP article, or answer you share can help someone beyond the Databricks Community. Small improvements in how you write can make your content easier to discover through C...
- 734 Views
- 0 replies
- 3 kudos
a week ago
Driving seamless access to data on social determinants of health is important for helping healthcare professionals better understand health inequities across social groups. The Social Determinants of Health Solution Accelerator shows how healthcare d...
- 224 Views
- 0 replies
- 0 kudos
Tuesday
The Weekly Digest • July 13 – July 19 Community Pulse Another week, another wave of knowledge. Here's what the community built... This Week's Community Stars Shoutout to this week's standout contributors – and a special welcome to a first-time...
- 257 Views
- 0 replies
- 3 kudos
Tuesday
Community Activity
- 3968 Views
- 7 replies
- 3 kudos
Oracle Essbase connectivity
Team, I wanted to understand the best way of connecting to Oracle Essbase to ingest data into the delta lake
- 3968 Views
- 7 replies
- 3 kudos
Latest Reply
- 3 kudos
I am currently working with Essbase 21c and I need to pull data from Databricks through a SQL query. I was able to successfully setup JDBC connection to Databricks but when I try to create a data source using a SQL query, it gives me an error: "[Data...
- 3 kudos
- 46 Views
- 1 replies
- 0 kudos
Use of Genie agents for ETL migration
I am currently working on a project to migrate existing ETL workflows from SSIS to Databricks. I would like to understand how Databricks Genie, Genie Code, or other Databricks AI-assisted capabilities can support this migration.Can these tools analyz...
- 46 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Genie code can meaningfully accelerate an SSIS migration, but they should be viewed as a productivity layer around the migration process rather than a push-button solution. In practice, the most reliable automation today is around assessment, invento...
- 0 kudos
- 63 Views
- 2 replies
- 0 kudos
CONNECTION Permission Issue - Can't use existing connection for Community Custom Connector
Hi there,I'm not sure if this is a glitch or something changed, but when trying to setup a new Data Ingestion Custom Connector, I am running into an issue at the connection page due to not having CREATE_CONNECTION permission.The thing is, I don't wan...
- 63 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi ChristianRRL,Most likely a classic UI race condition or state management glitch with the UI which is common as Community Custom Connectors are in beta and under active development. Interfaces and behavior are subject to change.What's likely happen...
- 0 kudos
- 640 Views
- 6 replies
- 5 kudos
Resolved! Request to Enable Foundation Model Endpoint Rate Limits
Hi,I'm working on a trade surveillance agent and need access to foundation model endpoints.Currently getting this error when calling any LLM endpoint:Error: "The endpoint is temporarily disabled due to a Databricks-set rate limit of 0"Could you pleas...
- 640 Views
- 6 replies
- 5 kudos
Latest Reply
- 5 kudos
@balajij8 -- qwen3-next-80b-a3b-instruct model has been very helpful for my POC/use case as it gives consistent and reproducible results.
- 5 kudos
- 46 Views
- 1 replies
- 0 kudos
can i deploy a metric view using DABs
I am trying to deploy metric view using DABs but I cant find a resource for it so i ended up with a SQL file but is there a way to automatically run the SQL for it
- 46 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Areqio, You can use a SQL file with Metric view definitions or Notebooks with Metric view definitions as the standard path. You can then wrap the SQL file or notebooks in a DABs job resource using a sql file task or notebook task.You can have the ...
- 0 kudos
- 76 Views
- 2 replies
- 1 kudos
Resolved! Community Custom Connector - Defining Non-Serverless Job Compute Runtime?
Hi there,I'm exploring Community Custom Connectors and I'm wondering about the Compute. By default, it's set to Serverless:But due to IT network limitations at our company, we cannot use serverless. In the Compute settings, I can untoggle the Serverl...
- 76 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
You generally cannot select DBR version in Lakeflow / Spark Declarative Pipelines because the pipeline runtime is Databricks-managed and versionless. Databricks auto-upgrades the runtime for pipelines.The settings has a JSON view, and some advanced o...
- 1 kudos
- 621 Views
- 0 replies
- 1 kudos
One Pipeline, Any Destination: The ForEachBatch Sink in Spark Declarative Pipelines is now GA
TL;DR Until recently, a Spark Declarative Pipeline’s (SDP) jurisdiction ended where the lakehouse ended. You could land, clean, and curate data into governed tables in Unity Catalog, and that was the contract. Use cases that required streaming to a s...
- 621 Views
- 0 replies
- 1 kudos
- 2085 Views
- 1 replies
- 1 kudos
Databricks AI Model Serving in production: scaling, cost, and latency lessons
Getting a model behind a REST endpoint is the easy part; however keeping it fast, affordable, and stable once production traffic shows up is where teams spend their real time. Databricks Model Serving (formerly called Mosaic AI Model Serving) is a se...
- 2085 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
One addition worth flagging: that formula assumes a fairly steady QPS, but the cost/latency tradeoff shifts a lot once workload shape enters the picture. A bursty agent workload (long idle stretches, then a spike of concurrent requests) gets penalize...
- 1 kudos
- 22274 Views
- 1 replies
- 1 kudos
Demystifying Databricks Pricing for AI Agents
Modern enterprises are rapidly adopting AI agents to automate complex workflows and enhance decision-making processes. Within the Databricks ecosystem, these agents represent a paradigm shift from standalone machine learning models to compound AI sys...
- 22274 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Two things I'd love to see quantified here, since they're where the real budgeting risk hides:1) GPU vs. CPU cost-per-token - the piece notes "GPUs excel at fine-tuning" but doesn't give a cost-per-token comparison against CPU serving for inference a...
- 1 kudos
- 9055 Views
- 4 replies
- 4 kudos
I looked into Genie Code costs in Databricks — it’s cheap until it isn’t
I’ve been testing Genie Code in Databricks and wanted to understand not just the UX, but the actual cost behavior.My impression so far:for simple code edits / code assistance, it looks almost free,but if Genie Code starts doing things that involve re...
- 9055 Views
- 4 replies
- 4 kudos
Latest Reply
- 4 kudos
Great writeup - I'm also facing the same problem with Genie Code.1. This billing attribution gap isn't specific to Genie Code, it shows up anywhere an agent/orchestration layer spins up ad-hoc compute (serverless one) on your behalf. Eventhough you c...
- 4 kudos
- 49 Views
- 1 replies
- 0 kudos
Auto-Termination Did Not Trigger on Production Cluster Despite 20-Minute Inactivity
Hello everyone,I recently encountered an issue with one of our production all-purpose clusters where the auto-termination feature did not work as expected.The cluster was configured with "Terminate after 20 minutes of inactivity", but it never termin...
- 49 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
The Spark UI details you shared points directly to the cause - Databricks Shell application. Auto termination only triggers when a cluster is completely idle with zero active sessions or connections. Databricks Shell application represents an active ...
- 0 kudos
- 390 Views
- 3 replies
- 1 kudos
Learning Series | AI/BI for Data Analysts
Databricks Academy offers the free AI/BI for Data Analysts course to help data analysts use AI/BI Dashboards and AI/BI Genie for business intelligence on the Databricks platform. It focuses on practical skills for designing dashboards, creating Genie...
- 390 Views
- 3 replies
- 1 kudos
- 6227 Views
- 3 replies
- 0 kudos
Resolved! Getting connection reset issue while connecting to a SQL server
Hello All,I am unable to connect to a SQL server instance that is installed in a on-premise network from databricks. I am able to successfully ping the server from the notebook using this command [nc -vz <hostname> <port>] which means I am able to e...
- 6227 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
The error you are encountering, "com.microsoft.sqlserver.jdbc.SQLServerException: Connection reset," even after a successful nc (netcat) connection, is a common but nuanced problem when connecting Databricks to an on-premise SQL Server. Although your...
- 0 kudos
- 174 Views
- 0 replies
- 0 kudos
Open Source Doesn't Mean You're Free. Managed Service/Closed Source Doesn't Mean You're Locked-in
Does your “open source” architecture actually deliver freedom? For an enterprise, lock-in isn’t a binary choice; it is a spectrum of exit costs that must be weighed against total TCO—specifically the hidden weight of OPEX. This piece aims to challeng...
- 174 Views
- 0 replies
- 0 kudos
- 1247 Views
- 1 replies
- 6 kudos
One Tenant, Multiple Subsidiaries: Account and Tenant Architecture for Azure Databricks
Introduction For enterprise groups deploying Azure Databricks, the Azure Tenant — Databricks Account relationship is a foundational architectural decision. It shapes data isolation between subsidiaries, governance scope, and operational overhead for ...
- 1247 Views
- 1 replies
- 6 kudos
Latest Reply
- 6 kudos
Option B is ideal when an organization has several teams and each team requires restriction of assets and access so only member of each team can see and access their own data, whereas other teams cannot. I have applied this solution and made it open ...
- 6 kudos
Announcements
| User | Count |
|---|---|
| 2280 | |
| 1356 | |
| 1241 | |
| 1184 | |
| 961 |
| User | Count |
|---|---|
| 445 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
Latest from our Blog
One Pipeline, Any Destination: The ForEachBatch Sink in Spark Declarative Pipelines is now GA
TL;DR Until recently, a Spark Declarative Pipeline’s (SDP) jurisdiction ended where the lakehouse ended. You could land, clean, and curate data into governed tables in Unity Catalog, and that was the ...
Open Source Doesn't Mean You're Free. Managed Service/Closed Source Doesn't Mean You're Locked-in
Does your “open source” architecture actually deliver freedom? For an enterprise, lock-in isn’t a binary choice; it is a spectrum of exit costs that must be weighed against total TCO—specifically the ...
Announcing General Availability of the Lakeflow Spark Declarative Pipelines Kafka Sink
The Lakeflow Spark Declarative Pipelines (SDP) Kafka sink is now generally available, turning your declarative pipeline into a unified engine for both data ingestion and real-time egress. You can now ...
AgentOps on Databricks: Operating Production AI Agents
Taking the proven MLOps deploy-code pattern and adapting it for GenAI agents: evaluation-driven CI/CD, a native observability loop, and open OpenTelemetry integration. From MLOps to AgentOps Most data...
