Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 29! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 348 Views
- 0 replies
- 0 kudos
a week ago
DATABRICKS Asia-Pacific Learning Festival Free, virtual, hands-on Databricks training 21 & 22 October 2026 Virtual, labs included Free Ready to level up your Databricks skills? The Databricks Asia-Pacific Learning Festival is back, and ...
- 2163 Views
- 1 replies
- 1 kudos
2 weeks ago
FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 1939 Views
- 3 replies
- 6 kudos
4 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 2589 Views
- 0 replies
- 3 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 934 Views
- 0 replies
- 0 kudos
a week ago
Community Champion • September 2026 Meet Venugopal Dabbara Every month, our Community Champion Program recognizes a member who makes the Databricks Community better for everyone, through their knowledge, their willingness to help, and their commitmen...
- 670 Views
- 3 replies
- 6 kudos
2 weeks ago
Genome-wide association studies help identify genetic variations associated with a disease or trait. The Genome-Wide Association Studies Solution Accelerator builds on Glow, an open source project for genomic analysis, to provide a fast, scalable and...
- 198 Views
- 0 replies
- 1 kudos
Tuesday
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 244 Views
- 0 replies
- 3 kudos
Thursday
Community Activity
- 7 Views
- 0 replies
- 0 kudos
Deploy Azure Databricks in 5 Minutes — VNET Injection + NAT Gateway
Presented by Julian Camacho Cardoza
- 7 Views
- 0 replies
- 0 kudos
- 9 Views
- 0 replies
- 0 kudos
- 9 Views
- 0 replies
- 0 kudos
- 18929 Views
- 27 replies
- 21 kudos
FAQ for Advanced Learning Festival September 16 - October 14 2026
Frequently Asked Questions Databricks Advanced Learning Festival | September 16 - October 14 2026 General Where can I ask questions while going through the self-paced material? The Databricks Academy Learners Group page is a forum within the Data...
- 18929 Views
- 27 replies
- 21 kudos
Latest Reply
- 21 kudos
Hurray! I have received Voucher.Subject: Thank you for participating in the Databricks Advanced Learning Festival!Thanks,Anita
- 21 kudos
- 189 Views
- 4 replies
- 0 kudos
About Azure SQL Managed Connector
Hi Community,We are trying to configure a Databricks Lakeflow Connect managed SQL Server connector to ingest data from Azure SQL Database into Databricks.We are using a contained SQL database user that has access only to the specific source database,...
- 189 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi srikanthp24, one distinction in the proposed workaround matters: permission to connect across databases and permission to read business tables are different security boundaries.The current Azure Databricks privilege matrix explicitly requires mast...
- 0 kudos
- 83 Views
- 2 replies
- 0 kudos
Table does not support batch scan.
After moving our incremental load jobs from DBR 16.4 (Spark 3.5) to DBR 18 (Spark 4.1.0), they fail with this error: [UNSUPPORTED_FEATURE.TABLE_OPERATION] The feature is not supported: Table `app_dev`.`vw_period` does not support batch scan. Please c...
- 83 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi harsh120, building on data_pulse's remote-scan observation, I would use localCheckpoint's success as a plan boundary to investigate, rather than proof that MAP is unsupported or that a particular DBR fix exists.Keep the same compute and run-as ide...
- 0 kudos
- 224 Views
- 4 replies
- 2 kudos
Databricks Connect + AutoDependencies + UDF + Streaming breaks
I have this toy python script:CATALOG = 'mpt_usd_gbl_bronze_dev' # <-- replaceSCHEMA = 'mpt_gbl_tco_fof' # <-- replacesrc=f'{CATALOG}.{SCHEMA}.toy_source'DEST = f'{CATALOG}.{SCHEMA}.toy_dest'from databricks.connect import DatabricksSession, Databrick...
- 224 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
Thanks for the updated reproducer, i4ata. I need to qualify my earlier withDependencies suggestion: the current Databricks Connect documentation says UDF dependency support for foreachBatch is not supported on serverless. On classic compute, it requi...
- 2 kudos
- 8 Views
- 0 replies
- 0 kudos
- 8 Views
- 0 replies
- 0 kudos
- 352 Views
- 7 replies
- 10 kudos
Datavault implemention on Databricks
Hi everyone,I'm building a Data Vault 2.0 architecture entirely natively in Databricks from scratch. We have specifically decided not to use dbt.While Raw Vault ingestion is straightforward with Spark/Delta, I'm looking for architectural advice on co...
- 352 Views
- 7 replies
- 10 kudos
Latest Reply
- 10 kudos
Great points from @balajij8 on the SDP/LDP approach. I've worked on a few Data Vault implementations, and these are the things that tend to bite when the Business Vault grows:1. Hash keys: standardize before hashing. Trim, upper-case and use a fixed ...
- 10 kudos
- 364 Views
- 1 replies
- 1 kudos
from_utc_timestamp silently double-shifts time when session timezone isn't UTC — docs should call th
Summary:from_utc_timestamp(current_timestamp(), '<tz>') produces an incorrect (future-shifted) timestamp whenever the Spark session timezone is already set to something other than UTC. This is a very common pattern for teams stamping dp_load_ts/creat...
- 364 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi rikkyvai, the audit-timestamp warning is useful. One nuance: with TIMESTAMP_LTZ, current_timestamp() represents an instant; the session timezone changes its display. from_utc_timestamp() shifts the value, rather than just formatting it.A useful ch...
- 1 kudos
- 10 Views
- 0 replies
- 0 kudos
- 10 Views
- 0 replies
- 0 kudos
- 26 Views
- 0 replies
- 0 kudos
DevOps Fundamentals: 08 - Creating and Executing Unit Tests: Instructions doesn't match code
Instructions: To execute pytest within Databricks complete the following:sys.dont_write_bytecode = True - By default, Python generates .pyc bytecode files in a pycache directory. Setting it to True prevents this, which is useful in read-only environm...
- 26 Views
- 0 replies
- 0 kudos
- 22 Views
- 0 replies
- 1 kudos
- 22 Views
- 0 replies
- 1 kudos
- 65 Views
- 1 replies
- 0 kudos
SCIM not returning account-level groups for Databricks App users
We’re building an Azure Databricks App for a company use case, designed as a self-service tool for a group of non-technical users (around 100-200).The main idea is that these users don’t have any permissions on the workspace. Access is granted only t...
- 65 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Your hypothesis is right. Workspace SCIM (including /Me) only returns groups that are assigned to the workspace. Your account SCIM calls failed because both tokens you tried are workspace-scoped. The user's OBO token and the app service principal's t...
- 0 kudos
- 190 Views
- 8 replies
- 1 kudos
Databricks DiscountVoucher
When does Databricks send email Discount Voucher? Because I'm waiting for today and not get it?Thank you.
- 190 Views
- 8 replies
- 1 kudos
- 92 Views
- 2 replies
- 0 kudos
Per-agent guardrails: what do you alert on, tokens, retries, or cost per task?
I'm trying to work out what a sensible guardrail looks like for each agent when several of them share a few serving endpoints.A plain token budget feels too blunt. An agent that retries a failing tool four times looks like a heavy user, while a cheap...
- 92 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Short answer: I'd use all three, but at different layers. A per-agent rate limit is the hard backstop, a calls-per-request alert is the early warning for loops and retry storms, and cost per completed task against a 7-day baseline is a review metric,...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1504 | |
| 1255 | |
| 1188 | |
| 961 |
Latest from our Blog
Databricks maintenance and cleanup: Visualize, Clean, and Log with Declarative Automation Bundles
Introduction Managing Databricks environments can quickly become overwhelming as jobs, AI Search indexes, and pipeline artifacts accumulate, making manual cleanup, logging, and compliance difficult. T...
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 2)
Part 1 introduced the pattern for verifiable visual AI. Let the model find the evidence, use deterministic code to measure it, apply governed rules to produce a pass, review, or fail verdict, and send...
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 1)
AI adoption has moved much faster than measurable business results. McKinsey reports that 88% of organizations now use AI in at least one business function, yet only 39% see a bottom-line effect. A co...
Minimize disruptions for continuous pipelines with Maintenance Windows
Minimize disruptions for continuous pipelines with Maintenance Windows In an agentic world, it is more important than ever to make decisions using the latest available data. To achieve this, data engi...
