FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 811 Views
- 3 replies
- 3 kudos
a week ago
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 8, 2026! Bricktalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with Data...
- 319 Views
- 0 replies
- 2 kudos
Monday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 1605 Views
- 0 replies
- 3 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 154 Views
- 0 replies
- 2 kudos
yesterday
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 190516 Views
- 303 replies
- 87 kudos
08-21-2026
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 1036 Views
- 6 replies
- 7 kudos
3 weeks ago
Cybersecurity investigations often require sifting through large volumes of log and telemetry data to uncover the patterns and relationships behind threat activity. The Incident Investigation Using Graphistry Solution Accelerator shows how to query i...
- 156 Views
- 0 replies
- 2 kudos
Tuesday
The Weekly Digest • September 7 – September 13 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week ...
- 520 Views
- 0 replies
- 4 kudos
2 weeks ago
Community Activity
- 95 Views
- 1 replies
- 0 kudos
Serverless compute returns 403 on S3 buckets in the account-regional namespace
SUMMARYServerless SQL warehouses and serverless notebook/jobs compute cannot read S3 buckets created in the AWS account-regional namespace (names ending -{accountId}-{region}-an). Classic compute reads the same buckets through the same IAM role witho...
- 95 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Greetings @alexgfowler_ld, I did some digging and here is what I found. First, this is one of the most carefully built-out reports I've seen on this forum. Your A/B test already rules out the usual suspects: same role, credential, data, and region wo...
- 0 kudos
- 240 Views
- 5 replies
- 4 kudos
AUTO CDC SCD Type 2 with late-arriving deletes: edge cases the docs don't cover
Hi everyone,I'm designing a Lakeflow Declarative Pipeline that processes customer profile changes from a CDC feed into an SCD Type 2 Silver table. Events can arrive out of order, sometimes up to 24 hours late. The planned flow:CREATE OR REFRESH STREA...
- 240 Views
- 5 replies
- 4 kudos
Latest Reply
- 4 kudos
Hello @LiresaFerizaj , I took a look at both internal and external documentation and here is what I found. You've already had solid answers from Thomaz, Nitesh, data_pulse, and Islam, so I'll tie the thread together, separate what's documented from w...
- 4 kudos
- 179 Views
- 2 replies
- 1 kudos
Question about MySQL Integrated‑CDC pipeline on Classic compute workspace
Hi everyone,I am trying to set up an Integrated‑CDC pipeline for a MySQL RDS instance on our Databricks workspace. Our workspace only uses Classic compute; Serverless compute is not available.According to the documentation, Integrated‑CDC for MySQL s...
- 179 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hello @david888 , I took a look at both internal and external documentation and here is what I found. Ivan (@ivanvyd) has this right, so I'll build on his answer rather than repeat it. Taking your three questions in order. Feature flag. Yes, enabl...
- 1 kudos
- 1913 Views
- 4 replies
- 2 kudos
Automate AI comment generation for columns
Hello, I have a question regarding the new AI Comment generation feature. Is it possbile to use this feature without using the UI. Currently i have to accept every suggested comment one-by-one. Is there a feature / SQL or Phython Statement that i can...
- 1913 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
@25Tabs Adding further to above replies, for this use case there aren't any native API calls yet available to generate the comments, but another work around could be:Use IDE's like VS Code with GitHub Copilot for Python Extension enabled. Copilot use...
- 2 kudos
- 94 Views
- 2 replies
- 1 kudos
PARTITIONED BY, Liquid Clustering, and OPTIMIZE: when should you use each?
I put together a practical guide to Delta Lake table layouts, with SQL examples in Databricks:When to consider partitioning or Liquid Clustering.How OPTIMIZE works with partitions, ZORDER, and clustering.How to compare bytes scanned, query latency, a...
- 94 Views
- 2 replies
- 1 kudos
- 292 Views
- 5 replies
- 5 kudos
Resolved! Lakebase Data API (GCP) returns jwk not found for valid service principal tokens
Workspace on GCP us-central1, Lakebase Autoscaling (Beta). The Data API returns 400 {"message":"jwk not found"} for every request.Setup follows the docs: role created with databricks_create_role('<sp-uuid>', 'SERVICE_PRINCIPAL'), GRANT "<sp-uuid>" TO...
- 292 Views
- 5 replies
- 5 kudos
Latest Reply
- 5 kudos
Update: resolved. Databricks confirmed this was a bug on their side in the Data API's JWKS resolution on GCP, and it has been fixed. The same requests that were failing with jwk not found now return 200 OK, with no changes to my configuration (same s...
- 5 kudos
- 101 Views
- 2 replies
- 1 kudos
Routing between GLM 5.3 Flash and GLM 5.3 with ai_decide: a cheap router in front of ai_query
I hope this helps for those who are trying to keep LLM costs under control on batch workloads. I have been looking at ai_decide (Beta) as a router rather than as a classifier, and it fits that job well. Sharing the pattern and the open questions, sin...
- 101 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Interesting approach. I like using the confidence from the choice output as a routing signal rather than making the router itself another complex LLM workflow.I'm also interested in the choice vs score approach. For routing, choice + confidence seems...
- 1 kudos
- 26 Views
- 0 replies
- 0 kudos
The trendtrack promo code is BESTCOUPON20
If you have been searching for a reliable way to spot viral trends early without breaking the bank, the trendtrack promo code is BESTCOUPON20. Let’s be honest—trying to keep up with what is trending across social media and search engines can feel lik...
- 26 Views
- 0 replies
- 0 kudos
- 62 Views
- 2 replies
- 0 kudos
Resource limits
Hi forks,I see page https://docs.databricks.com/aws/en/resources/limitsDoes Databricks have dashboard concurrent limits and resource limits ? I am wondering whether these limits are calculated over a time window of 1 day, 1 hour, or 1 minute. Please ...
- 62 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
@AnhPT , Check this URLhttps://docs.databricks.com/aws/en/dashboards/limits#:~:text=Table_title%3A%20Filter%20limits%E2%80%8B%20Table_content%3A%20%7C%20Limit%20%7C,values%20that%20exceed%20the%20100%2C000%2Dvalue%20rendering%20limit.
- 0 kudos
- 3317 Views
- 4 replies
- 2 kudos
Python logger.info() not showing inside applyInPandas (but print() works) — why?
Problem: In Databricks, logs from an external binary (via os.system) show up, but Python logger.info() inside groupBy(...).applyInPandas(...) does not. print(..., flush=True) does show up.Why: applyInPandas runs your function as a pandas UDF. That c...
- 3317 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @SteveOstrowski,Is your approach supposed to work for Databricks serverless (Spark connect)? I have tried implemented that helper function to my applyInPandas() function, but the logs do not appear in the cell output.
- 2 kudos
- 8924 Views
- 5 replies
- 12 kudos
How to use Service Credentials to enable the RBAC on the Key Vaults
How to use Service Credentials in Unity Catalog for Azure Key Vault RBAC Integration Azure Databricks now supports a service credential object in Unity Catalog, enabling secure and governed access to external cloud services like Azure Key Vault. A se...
- 8924 Views
- 5 replies
- 12 kudos
Latest Reply
- 12 kudos
The comments highlight a useful distinction between service credentials and secret scopes, especially for Azure Key Vault access. Shops and offices along State Street and Sanderson Avenue choose junk removal Hemet CA crews for quick cleanouts. We wor...
- 12 kudos
- 88 Views
- 1 replies
- 0 kudos
Certification Support Request #01015865 – No Response Since September 14
Hello,I’m hoping someone from the Databricks Certification Team can help me with an existing support request.I submitted Certification Support request #01015865 on September 14 regarding a concern about my Databricks Certified Data Engineer Associate...
- 88 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi, I wanted to follow up on this post as I still have not received any response or update regarding support request #01015865.The ticket was originally submitted on September 14, and I have also followed up by email, but I have not received a respon...
- 0 kudos
- 210 Views
- 2 replies
- 0 kudos
Certification Voucher Partner Academy
Hi TeamAre there any certification vouchers for learners from the partner academy?RegardsCarl
- 210 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Yes, certification exam vouchers are frequently available for learners through partner training programs (such as AWS Partner Certification Readiness, Google Cloud Partner/Skills Boost programs, and Microsoft-affiliated partner tracks), provided spec...
- 0 kudos
- 272 Views
- 4 replies
- 0 kudos
Resolved! Failed to convert to managed table: PrivilegedGenerateTemporaryTableCredential disable
Hello everyone, I noticed that when I tried to convert some external table to managed one using the alter table catalog.schema.table_name set managed command (like suggested by databricks) sometimes I will encounter this error: Error running query: c...
- 272 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello everyone, After following up with Databricks, they recognize it is a bug on their side therefore are starting the process to fix it, in the mean time the best way to deal with it according to Databricks is simply to setup a retry and it should ...
- 0 kudos
- 125 Views
- 2 replies
- 1 kudos
Resolved! SET MANAGED AND ROLLBACK IN RELATION TO VACUUM
Hello everyone,I am looking for clarification about the 14-day rollback period after converting an external table to a managed table using: ALTER TABLE table_name SET MANAGED.Databricks documentation states that the conversion can be rolled back with...
- 125 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi, I could not find these three cases documented either, so I will separate what the docs say from what I would treat as an assumption. What is documented (Convert external tables to managed): Databricks keeps the data in the old external location f...
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1461 | |
| 1253 | |
| 1187 | |
| 961 |
Latest from our Blog
Step-by-Step: Building a Vacation Rental Operations App with AppKit
Your team has analytics data in a SQL Warehouse. Leadership wants more than a dashboard — they want an app where ops reps can look up bookings, flag issues, add notes, and ask questions in plain Engli...
Multi-region model serving on Databricks with OpenSharing
Introduction Enterprises today serve customers across continents, from New York to Singapore, London to São Paulo. For these organizations, delivering fast, reliable user experiences is a business req...
Tutorial: Databricks Genie for Data Engineers and Data Scientists
Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scien...
Beyond the Dashboard: How Transferz Built a Truly Data-Driven Company Culture With AI/BI Genie
Transferz, a fast-growing travel tech platform, eliminated its data team bottleneck by deploying AI/BI Genie — achieving 89,5% adoption across business users achieving 60% operational improvements.Th...
