- 1580 Views
- 2 replies
- 3 kudos
Databricks community group in Kerala
Calling All Data Enthusiasts in Kerala! Hey everyone,I'm excited about the idea of launching a Databricks Community Group here in Kerala! This group would be a hub for learning, sharing knowledge, and networking among data enthusiasts, analysts, a...
- 1580 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @AswinGovindan77 , Do you have an estimate of how many enthusiasts will be joining you? If you provide a rough number, we can create a group for you on Community!
- 3 kudos
- 25 Views
- 1 replies
- 0 kudos
Resolved! DQX Compatibility
Hi all,Does anyone know if DQX (Databricks Labs) is compatible with Microsoft Fabric Spark notebooks? It would be useful to know this, so that we can use it on Fabric-based projects as well.Thanks!
- 25 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @d_a_n, No, DQX isn’t supported on Microsoft Fabric Spark notebooks. DQX is a Databricks Labs framework that’s designed and documented to run on Databricks workspaces and Databricks clusters only (see the official installation prerequisites). In a...
- 0 kudos
- 544 Views
- 11 replies
- 4 kudos
Azure Databricks session expiry Issue
I frequently encounter a session-expired issue while using Databricks within 2 minutes, and this has been happening for two days. Are there any fixes or suggestions?
- 544 Views
- 11 replies
- 4 kudos
- 4 kudos
Hi @Prathy @prasadv @joonkim4078 @Krissy_ , Thank you for your patience while we investigated this issue. We flagged this to our teams internally, and the team has deployed a fix, and based on our checks, the behaviour should now be back to normal. T...
- 4 kudos
- 112 Views
- 2 replies
- 1 kudos
Databricks Genie Explained Simply for Data Engineers
As a data engineer, I’ve been spending time recently exploring how AI is getting embedded into the Databricks ecosystem, and one feature that genuinely stood out to me is Databricks Genie. What caught my attention is the shift it brings — instead of ...
- 112 Views
- 2 replies
- 1 kudos
- 1 kudos
One thing I always say to my customers who are interested in Genie: despite the name, it is not magic. There is still work to be done at the catalog and semantic level by people who understand the underlying data. The difference between a successful ...
- 1 kudos
- 128 Views
- 2 replies
- 1 kudos
Helping Data Engineers Learn Databricks Through Practical Thinking
Over the past months, our team spent a lot of time thinking about one question.Why do many data engineers understand Spark or SQL, but still struggle when building real data pipelines?We realized the challenge is rarely about tools. It is about struc...
- 128 Views
- 2 replies
- 1 kudos
- 63 Views
- 1 replies
- 0 kudos
Learn scala using Databricks free edition
Hi, I want to run and learn spark scala using databricks free edition. It looks there was access in community edition but now in databricks free edition serverless does not scala . Please confirm if understanding is correct and possible alternative i...
- 63 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @kpavan2004, You are right. The free edition doesn't support R or Scala. You can see a list of limitations here. If this answer resolves your question, could you mark it as “Accept as Solution”? That helps other users quickly find the correct fix...
- 0 kudos
- 56431 Views
- 65 replies
- 37 kudos
Session expired Error - Databricks Community
Hi Team, After login into Databricks Community Edition within 2mins I am getting the following Error i.e, " Session expired. Your session has expired, please authenticate again." I have tried to login back again but still it is asking the Auth...
- 56431 Views
- 65 replies
- 37 kudos
- 141 Views
- 3 replies
- 1 kudos
Do we have an invite your fiends community?
Do we have an invite your fiends community?I noticed, in cloud.databricks we have a link Invite your friends.Some time in the future, I might need some.Do we have a community/group to find those friends?The ones I have, may not have the talent I need...
- 141 Views
- 3 replies
- 1 kudos
- 1 kudos
Not sure. Maybe. Let me try to rephrase it, the questions is, what is the best place to find people who are interested in joining the Databricks environment of someone else.
- 1 kudos
- 120 Views
- 2 replies
- 1 kudos
Serverless Compute Idle Timeout Time
I want to know what is the idle timeout for Databricks Serverless Compute. Can anyone Databricks document where it specifies the idle timeout time details.
- 120 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @AJ270990 , I did some digging and I have some helpful tips to guide you. This is one of those areas where the answer is “it depends,” based on which flavor of serverless compute you’re using. Let’s break it down so it’s easy to reason about. Firs...
- 1 kudos
- 186 Views
- 3 replies
- 1 kudos
Resolved! Guidance on Databricks Specializations and Migration Accelerators for Partner Tier Progression
Hi everyone,We are currently working toward progressing our tier in the Databricks Partner Network and had a quick question regarding the tier requirements.Could someone clarify:• What is the process for partners to achieve Databricks Specializations...
- 186 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @vamsi_simbus, Thanks for the questions and for growing your Databricks practice as you move beyond Bronze in the Databricks Partner Network. At a high level, each Brickbuilder Specialisation (industry or product) has a clear checklist that typica...
- 1 kudos
- 251 Views
- 4 replies
- 2 kudos
Resolved! Blueprint: Entity Resolution(Dedup & Golden Records)on Databricks — blocking, fuzzy scoring, MLflow
Hi Databricks Community I’m working on designing a practical Entity Resolution / Deduplication framework on Databricks, and I wanted to share a high‑level blueprint and learn from others who’ve tackled similar problems at scale.The use case is fairly...
- 251 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Mridu, Rather than building everything greenfield, you can lean heavily on Databricks’ existing Entity Resolution Solution Accelerators (Customer ER, Product Matching, Public Sector ER) as a starting point and then adapt their patterns to your bl...
- 2 kudos
- 2573 Views
- 2 replies
- 0 kudos
Databricks workspace in failed state
Hi Community,I had my Databricks workspace up and running and it was managed through terraform, and encryption was enabled through cmk, there were some updation in the code, so I put terraform plan, one of the key changes(replace) it showed me was"az...
- 2573 Views
- 2 replies
- 0 kudos
- 273 Views
- 3 replies
- 2 kudos
Resolved! Unable to start the lab for "Get Started with Databricks for Data Warehousing" course
Hello,I am having the following issue while starting the lab for the "Get Started with Databricks for Data Warehousing" course. I purchased the course with the lab option. Can you guide me to resolve this issue? I appreciate your help. Thank you. l =...
- 273 Views
- 3 replies
- 2 kudos
- 2 kudos
The issue has now been resolved @susmit, and the labs are running smoothly. You should be able to start the lab for the course without any errors.
- 2 kudos
- 448 Views
- 5 replies
- 12 kudos
LLM based Replies to community posts
Hello Everyone,I’ve been in the community for a few weeks and really enjoy reading the problems and production-focused solutions shared here.Recently, I’ve noticed some replies(solutions) that look quite verbose and seem like they might be generated ...
- 448 Views
- 5 replies
- 12 kudos
- 12 kudos
Hey guys, I appreciate you bringing this up. We do have an AI usage policy in our Code of Conduct that I recently asked Legal to update:Use of AI Tools: AI tools may be used to assist with formatting, clarity, and organization, or to draft ideas that...
- 12 kudos
- 256 Views
- 4 replies
- 0 kudos
Attempting to load a JSON file fails due to schema issue (Free Edition)
Hello,I created a Volume named 'test_volume' under catalog:workspace and schema:default.Then I uploaded a file named user_0.json into test_volume (fake data, of course):Now I want to load that file into a data frame.With Python in a notebook:With SQL...
- 256 Views
- 4 replies
- 0 kudos
- 0 kudos
The AnalysisException you're seeing in the Databricks Community Edition is almost always caused by a mismatch between the JSON file format and Spark’s default reader.By default, Spark expects JSON Lines (one JSON object per line). If your file is a s...
- 0 kudos
