- 1324 Views
- 4 replies
- 5 kudos
Who All Are Attending Data + AI Summit 2026 in San Francisco?
I am excited to share that I have completed my registration for Data + AI Summit this year, happening from June 15 to June 18 in San Francisco. I am attending, and I wanted to check who else from our Databricks Community is planning to be there.For m...
- 1324 Views
- 4 replies
- 5 kudos
- 5 kudos
Absolutely @edonaire , even joining online is still a great way to learn and stay updated with all the latest announcements and ideas. I agree, the in-person networking has its own value, but the learning opportunity is still huge. Hoping we get more...
- 5 kudos
- 526 Views
- 3 replies
- 7 kudos
Resolved! Set a theshold Notification on Job run time.
Hello all, I am brand new to Databricks, so forgive me if this question has been answered before, but what i want to do is set a run time threshold to my Databricks Jobs such that if the job which say normally runs for 30 minutes, runs for over an h...
- 526 Views
- 3 replies
- 7 kudos
- 7 kudos
Hi @rwalrondNHS, You can set these thresholds and notifications programmatically. They’re part of the normal Jobs definition, not a UI‑only feature. I've just tested this for a sample job and it works perfectly. Under the hood, the run longer than X ...
- 7 kudos
- 17075 Views
- 3 replies
- 0 kudos
Resolved! Access Foreign Catalog using Python in Notebook
Hello - I have a foreign catalog which I can access fine in SQL. However, I can't access it from from python notebook.i.e. this works just fine if I have notebook using a Pro SQL Warehouse%sqlUSE CATALOG <my_foreign_catalog_name>;USE SCHEMA public;S...
- 17075 Views
- 3 replies
- 0 kudos
- 0 kudos
@Debayan , could you please help us how to resolve this issue with steps.
- 0 kudos
- 244 Views
- 1 replies
- 1 kudos
Resolved! doubt
Hey everyone, I am new here and interested to explore this field.I have never worked before on this can you guys guide me on this it will really help me.
- 244 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey, welcome aboard.You can get started with the Beginner Guides on how to start - https://community.databricks.com/t5/get-started-guides/tkb-p/Get-Started-Guides.Post this you may choose a Learning Path based on your preference or profession and get...
- 1 kudos
- 6376 Views
- 11 replies
- 0 kudos
Databricks apps - Volumes and Workspace - FileNotFound issues
I have a Databricks App I need to integrate with volumes using local python os functions. I've setup a simple test: def __init__(self, config: ObjectStoreConfig): self.config = config # Ensure our required paths are created ...
- 6376 Views
- 11 replies
- 0 kudos
- 0 kudos
These are the permissions needed for the app service principal:Catalog: Use CatalogSchema: Use Schema Volume: Read / WriteTo actually be able to read/write in the volume I had to use the Python databricks-sdk. Performing "normal" file system operatio...
- 0 kudos
- 1851 Views
- 3 replies
- 3 kudos
Databricks community group in Kerala
Calling All Data Enthusiasts in Kerala! Hey everyone,I'm excited about the idea of launching a Databricks Community Group here in Kerala! This group would be a hub for learning, sharing knowledge, and networking among data enthusiasts, analysts, a...
- 1851 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @AswinGovindan77 , Do you have an estimate of how many enthusiasts will be joining you? If you provide a rough number, we can create a group for you on Community!
- 3 kudos
- 300 Views
- 1 replies
- 0 kudos
Resolved! DQX Compatibility
Hi all,Does anyone know if DQX (Databricks Labs) is compatible with Microsoft Fabric Spark notebooks? It would be useful to know this, so that we can use it on Fabric-based projects as well.Thanks!
- 300 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @d_a_n, No, DQX isn’t supported on Microsoft Fabric Spark notebooks. DQX is a Databricks Labs framework that’s designed and documented to run on Databricks workspaces and Databricks clusters only (see the official installation prerequisites). In a...
- 0 kudos
- 2095 Views
- 11 replies
- 4 kudos
Resolved! Azure Databricks session expiry Issue
I frequently encounter a session-expired issue while using Databricks within 2 minutes, and this has been happening for two days. Are there any fixes or suggestions?
- 2095 Views
- 11 replies
- 4 kudos
- 4 kudos
Hi @Prathy @prasadv @joonkim4078 @Krissy_ , Thank you for your patience while we investigated this issue. We flagged this to our teams internally, and the team has deployed a fix, and based on our checks, the behaviour should now be back to normal. T...
- 4 kudos
- 334 Views
- 2 replies
- 1 kudos
Helping Data Engineers Learn Databricks Through Practical Thinking
Over the past months, our team spent a lot of time thinking about one question.Why do many data engineers understand Spark or SQL, but still struggle when building real data pipelines?We realized the challenge is rarely about tools. It is about struc...
- 334 Views
- 2 replies
- 1 kudos
- 451 Views
- 1 replies
- 2 kudos
Resolved! Learn scala using Databricks free edition
Hi, I want to run and learn spark scala using databricks free edition. It looks there was access in community edition but now in databricks free edition serverless does not scala . Please confirm if understanding is correct and possible alternative i...
- 451 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @kpavan2004, You are right. The free edition doesn't support R or Scala. You can see a list of limitations here. If this answer resolves your question, could you mark it as “Accept as Solution”? That helps other users quickly find the correct fix...
- 2 kudos
- 434 Views
- 2 replies
- 1 kudos
Serverless Compute Idle Timeout Time
I want to know what is the idle timeout for Databricks Serverless Compute. Can anyone Databricks document where it specifies the idle timeout time details.
- 434 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @AJ270990 , I did some digging and I have some helpful tips to guide you. This is one of those areas where the answer is “it depends,” based on which flavor of serverless compute you’re using. Let’s break it down so it’s easy to reason about. Firs...
- 1 kudos
- 690 Views
- 3 replies
- 1 kudos
Resolved! Guidance on Databricks Specializations and Migration Accelerators for Partner Tier Progression
Hi everyone,We are currently working toward progressing our tier in the Databricks Partner Network and had a quick question regarding the tier requirements.Could someone clarify:• What is the process for partners to achieve Databricks Specializations...
- 690 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @vamsi_simbus, Thanks for the questions and for growing your Databricks practice as you move beyond Bronze in the Databricks Partner Network. At a high level, each Brickbuilder Specialisation (industry or product) has a clear checklist that typica...
- 1 kudos
- 1298 Views
- 4 replies
- 2 kudos
Resolved! Blueprint: Entity Resolution(Dedup & Golden Records)on Databricks — blocking, fuzzy scoring, MLflow
Hi Databricks Community I’m working on designing a practical Entity Resolution / Deduplication framework on Databricks, and I wanted to share a high‑level blueprint and learn from others who’ve tackled similar problems at scale.The use case is fairly...
- 1298 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Mridu, Rather than building everything greenfield, you can lean heavily on Databricks’ existing Entity Resolution Solution Accelerators (Customer ER, Product Matching, Public Sector ER) as a starting point and then adapt their patterns to your bl...
- 2 kudos
- 2830 Views
- 2 replies
- 0 kudos
Databricks workspace in failed state
Hi Community,I had my Databricks workspace up and running and it was managed through terraform, and encryption was enabled through cmk, there were some updation in the code, so I put terraform plan, one of the key changes(replace) it showed me was"az...
- 2830 Views
- 2 replies
- 0 kudos
- 485 Views
- 3 replies
- 2 kudos
Resolved! Unable to start the lab for "Get Started with Databricks for Data Warehousing" course
Hello,I am having the following issue while starting the lab for the "Get Started with Databricks for Data Warehousing" course. I purchased the course with the lab option. Can you guide me to resolve this issue? I appreciate your help. Thank you. l =...
- 485 Views
- 3 replies
- 2 kudos
- 2 kudos
The issue has now been resolved @susmit, and the labs are running smoothly. You should be able to start the lab for the course without any errors.
- 2 kudos
