- 4056 Views
- 8 replies
- 6 kudos
Resolved! Unexpected Script Execution Differences on databricks.com vs Mobile-Triggered Runtimes
I’m noticing some unusual inconsistencies in how scripts execute on databricks.com compared to when the same workflow is triggered through a mobile-based API. On Databricks, the script runs perfectly when executed directly inside a cluster notebook. ...
- 4056 Views
- 8 replies
- 6 kudos
- 6 kudos
This kind of difference can be surprisingly easy to miss because the same notebook may behave differently depending on how it is launched. In Databricks, compute type, runtime, permissions, parameters, and whether the execution is interactive or a jo...
- 6 kudos
- 167 Views
- 2 replies
- 1 kudos
LLM API Returning Inconsistent Responses When Using RAG
Hi Everyone,I am Soumitra Dutta,I have an issue with LLM API and Retrieval-Augmented Generation (RAG). Sometimes the same query returns different answers even if the retrieved documents and the prompt are the same.The retrieval results are useful, bu...
- 167 Views
- 2 replies
- 1 kudos
- 1 kudos
This is quite a common problem with RAG systems in general, and it's why monitoring and observability are so important. In terms of the generation step, setting the temperature to zero, as the previous commenter suggested, is a strong approach. Howev...
- 1 kudos
- 277 Views
- 8 replies
- 0 kudos
Databricks Data Ingestion
Hi all,I am currently exploring the data ingestion feature offered by databricks, specifically connecting to a SQL server. I have gone through the UI and configured an ingestion pipeline that connects to one specific server and can read tables into d...
- 277 Views
- 8 replies
- 0 kudos
- 0 kudos
I completely understand your concern, and I think this is a valid question.If one ingestion pipeline is permanently associated with one ingestion gateway, then from an operational perspective, 20–30 source connections could indeed result in 20–30 ing...
- 0 kudos
- 78 Views
- 0 replies
- 0 kudos
Databricks Implementation / BI Modernization Opportunities
Hello everyone,I’m a Toronto-based BI & Analytics professional with 12 years of experience across enterprise analytics and financial services. I recently completed the Databricks Certified Data Engineer Associate certification.My experience includes ...
- 78 Views
- 0 replies
- 0 kudos
- 75 Views
- 0 replies
- 0 kudos
How Can I Become a Databricks Partner Champion Through Technical Expertise?
Hello Databricks Community,I am actively building my technical expertise in the Databricks ecosystem and would like guidance on the roadmap to becoming a Databricks Partner Champion, with a strong focus on technical skills and hands-on implementation...
- 75 Views
- 0 replies
- 0 kudos
- 11861 Views
- 14 replies
- 36 kudos
Are you part of a Databricks user group in your city/region?
Joining a regional user group is a great way to connect with data and AI professionals near you. These groups bring together practitioners to learn, network, and share real-world experiences — all within your local context. To join a group: Select y...
- 11861 Views
- 14 replies
- 36 kudos
- 36 kudos
Hey @Rishabh_Tiwari, hope you're doing amazing!I'm interested in starting a Databricks User Group in Vadoara. I've checked the new User Group platform at usergroups.databricks.com and I don't see an existing chapter for our city.Could you point me to...
- 36 kudos
- 62 Views
- 0 replies
- 0 kudos
Como funciona la facturación y pago en Databricks?
Hola comunidad,Tengo una duda sobre cómo funciona la facturación en cuentas Pay-As-You-Go y quería saber si a alguien más le ha pasado algo similar.En mi panel de "Usage" veo un consumo acumulado de varios cientos de dólares durante el último año (pr...
- 62 Views
- 0 replies
- 0 kudos
- 107 Views
- 1 replies
- 0 kudos
Como aprender correctamente en el entorno de DataBricks y aprovecharlo al 100%
Hola a todos, soy ingeneriero en sistemas y deseo aprender a utilizar esta grandiosa herramienta para poder sacarle el mejor provecho posible.
- 107 Views
- 1 replies
- 0 kudos
- 0 kudos
Welcome to the Databricks Community, @maycol25! If you’re just getting started with Databricks, a great place to begin is Databricks Customer Academy, where you can explore courses based on the area you’re interested in, such as Data Engineering, Gen...
- 0 kudos
- 180 Views
- 0 replies
- 0 kudos
From Semantic Similarity to Business Authority: Why Genie Ontology and OntoRank Matter
Enterprise AI does not usually fail because the model lacks intelligence.It fails because the model does not understand what the organization means.Consider a simple question:“What is our current exposure to active customer?”Behind this question are ...
- 180 Views
- 0 replies
- 0 kudos
- 203 Views
- 2 replies
- 1 kudos
Resolved! External location not accessble with job and general purpose cluster but works fine with serverless
I m setting up a pipeline in databricks.For data source I create an external location and add my pipeline run_as SP as read files and read metadata permission. When i trigger the pipeline with serverless cluster, i m able to read data from external l...
- 203 Views
- 2 replies
- 1 kudos
- 1 kudos
@Anmol_Chauhan You have few distinct problems across the classic compute - cluster networking during boot and the cluster's compute access mode. Serverless works properly because Databricks manages the control plane routing and networking boundaries ...
- 1 kudos
- 92 Views
- 0 replies
- 0 kudos
Path to become a Databricks Trainer
Hello,I am an independent consultant and a trainer in the data space, focused primarily on Databricks. I wanted to understand the path to becoming a Databricks trainer delivering ILT sessions on Databricks Academy or to Databricks partners.It would b...
- 92 Views
- 0 replies
- 0 kudos
- 419 Views
- 3 replies
- 3 kudos
Resolved! Excel Add-in Regression - Sign-in opens external browser window instead of embedding in task pane, r
Issue: The Databricks Excel Add-in launches authentication in an external browser window rather than within the Excel task pane. The Unity Catalog does display in the external browser window, but after sign-in, Excel remains stuck spinning/loading in...
- 419 Views
- 3 replies
- 3 kudos
- 3 kudos
Worked with Databricks support engineers to resolve. Root cause determined to be that while the Marketplace add-in previously allowed the connection to be made to the workspace URL, it no longer does. Resolution was to remove the Marketplace add-in...
- 3 kudos
- 421 Views
- 4 replies
- 3 kudos
Is the Semantic Layer the Real Challenge With Databricks Genie?
I've been thinking about this while looking at different Genie use cases.It seems like the hardest part of implementing Genie isn't getting users to ask questions in natural language. It's making sure Genie understands what those questions actually m...
- 421 Views
- 4 replies
- 3 kudos
- 3 kudos
language interface itself. Genie can generate SQL, but it still needs clear business definitions, relationships, metrics, and terminology to know what the user actually means. Databricks itself recommends well-documented datasets, SQL expressions, ex...
- 3 kudos
- 3523 Views
- 3 replies
- 3 kudos
Resolved! When is it time to change from ETL in notebooks to whl/py?
Hi!I would like some input/tips from the community regarding when is it time to go from a working solution in notebooks to something more "stable", like whl/py-files?What are the pros/cons with notebooks compared to whl/py?The way i structured things...
- 3523 Views
- 3 replies
- 3 kudos
- 3 kudos
Hey @Forssen ,My advice:Using .py files and .whl packages is generally more secure and scalable, especially when working in a team. One of the key advantages is that code reviews and version control are much more efficient with .py files, as changes ...
- 3 kudos
- 1115 Views
- 4 replies
- 1 kudos
Resolved! Changing profile from customer to partner
HelloI was previously registered with a customer profile, and have updated my profile to use my work email which is a partner email, but still I am unable to access the partner academy.I tried different things (incognito window, clearing cookies, etc...
- 1115 Views
- 4 replies
- 1 kudos
- 1 kudos
Yeah, that sounds frustrating. Hopefully support can get the profile linked properly—seems like it should be a pretty straightforward account update.
- 1 kudos
