cancel
Showing results for 
Search instead for 
Did you mean: 
Discussions
Engage in dynamic conversations covering diverse topics within the Databricks Community. Explore discussions on data engineering, machine learning, and more. Join the conversation and expand your knowledge base with insights from experts and peers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Browse the Community

Community Discussions

Engage in vibrant discussions covering diverse learning topics within the Databricks Community. Expl...

4885 Posts

Activity in Discussions

DineshOjha
by > • New Contributor III
  • 396 Views
  • 4 replies
  • 3 kudos

Notebook commands hang after restarting a cluster with custom library installed

Hi,I'm experiencing an issue with a Databricks notebook after restarting a cluster that has a custom library installed.Here are the steps I followed:Created a Databricks compute cluster.Attached a notebook to the cluster.Installed a library required ...

  • 396 Views
  • 4 replies
  • 3 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 3 kudos

Hello @DineshOjha,  Short answer: this isn't expected behavior. When terminated compute starts again, Databricks recreates it, reinstalls the configured libraries, and reattaches notebooks. If a library is still pending, fails to install, or conflict...

  • 3 kudos
3 More Replies
Khasim_1
by > • New Contributor III
  • 371 Views
  • 4 replies
  • 2 kudos

How does AUTO CDC resolve same-timestamp tie in SEQUENCE BY?

We are using AUTO CDC (APPLY CHANGES INTO) to process change data capture events from an upstream source (via Autoloader ingesting CDC files landed in cloud storage) into our Silver layer tables. Our source occasionally delivers out-of-order events —...

  • 371 Views
  • 4 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Hello @Khasim_1, I took a look at both internal and external documentation and here is what I found. You're in good hands in this thread already. @Brahmareddy's STRUCT suggestion and @data_pulse's test both line up with the documented behavior, and @...

  • 2 kudos
3 More Replies
a_user12
by > • Contributor
  • 76 Views
  • 1 replies
  • 0 kudos

Declarative Pipeline with editable wheel: PYTHON.MODULE_NOT_FOUND_ERROR

Hi!I create a bundle with databricks bundle initand i let create a pipeline including a package. The pipeline definition looks like the following# The main pipeline for pipelinewithpackage resources: pipelines: pipelinewithpackage_etl: n...

databricks.png
Data Engineering
lakeflow pipelines
  • 76 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Hello @a_user12, . Your bundle config is the documented pattern for pulling pyproject.toml dependencies into a pipeline, so the setup itself is sound. The clue is the 1,433-byte wheel. An editable install doesn't copy your code into site-packages. It...

  • 0 kudos
skao
by > • Visitor
  • 71 Views
  • 1 replies
  • 0 kudos

ServiceNow ingestion failed since October 1st.

I have a data ingestion pipeline ingesting ServiceNow data into databricks. It has been working for several months, but it stopped working since October 1st.From what I see, the pipeline suffered connection time out.However, from the connection, I ca...

Screenshot 2026-10-10 at 2.02.42 PM.png
  • 71 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Hello @skao, I took a look at both internal and external documentation and here is what I found. A working token refresh and an active ServiceNow account are good signs, but they don't rule out a connectivity or ServiceNow API performance problem. Ge...

  • 0 kudos
DB1To3
by > • Contributor II
  • 265 Views
  • 8 replies
  • 4 kudos

Zerobus Ingest with Kafka compliant API and WITHOUT a callback

Is see that kafka for zerobus is still in beta.  So maybe something will change. Can someone tell me whether they are aware of an authentication handshake with this API that might AVOID the callback?Here is the python example, which uses a sophistica...

  • 265 Views
  • 8 replies
  • 4 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 4 kudos

Glad I could be a help. Cheers, Lou.

  • 4 kudos
7 More Replies
Mirela_J
by > • New Contributor
  • 86 Views
  • 1 replies
  • 0 kudos

TellR Roadmap and Strategic Direction | @Databricks Team

Hi,We have recently been evaluating TellR and are very interested in the concept of generating presentation-ready management decks directly from governed data through conversational interactions.From our perspective, the ability to transform insights...

  • 86 Views
  • 1 replies
  • 0 kudos
Latest Reply
Loyalty
Visitor
  • 0 kudos

<a href="https://www.peptidesourcelap.com/product/nad-750mg-for-sale/">nad 750mg for sale</a><a href="https://www.peptidesourcelap.com/product/nad-100mg-for-sale/">nad 100mg for sale</a>

  • 0 kudos
EminBoz
by > • Databricks Partner
  • 7390 Views
  • 8 replies
  • 1 kudos

"Revoke" permissions for SQL-Warehouse with API

Hello dear community,   i am trying to revoke permissions with the API for SQL-Warehouse. Granting permissions isn't a problem and works like a charme. But revoking won't function. I tried "NO_PERMISSIONS", "NO PERMISSIONS", "DENY", "REVOKE" But i al...

image.png
  • 7390 Views
  • 8 replies
  • 1 kudos
Latest Reply
David-jordj
  • 1 kudos

Have you tried checking the latest Databricks API documentation for the correct permission values and how to remove existing access? It would be helpful if someone could share a working example, since granting permissions seems to work but revoking t...

  • 1 kudos
7 More Replies
EllieFarrell
by > • Contributor
  • 7220 Views
  • 11 replies
  • 6 kudos

Resolved! Unexpected Script Execution Differences on databricks.com vs Mobile-Triggered Runtimes

I’m noticing some unusual inconsistencies in how scripts execute on databricks.com compared to when the same workflow is triggered through a mobile-based API. On Databricks, the script runs perfectly when executed directly inside a cluster notebook. ...

  • 7220 Views
  • 11 replies
  • 6 kudos
Latest Reply
David-jordj
  • 6 kudos

I’d start by checking environment variables, session initialization, and cluster startup differences between notebook runs and API-triggered executions. Logging timestamps and outputs at each step could help identify where the behavior changes. It wo...

  • 6 kudos
10 More Replies
kasinathanrames
by > • New Contributor III
  • 46183 Views
  • 38 replies
  • 34 kudos

Resolved! Free Certification voucher

looking for free certification voucher

  • 46183 Views
  • 38 replies
  • 34 kudos
Latest Reply
jk93
New Contributor II
  • 34 kudos

I have completed both Associate Data Engineering and Professional Data Engineering Learning Path and also got the credential badges as well. Looking forward to receiving the voucher after the festival is finished.

  • 34 kudos
37 More Replies
tomodachilifero
by > • New Contributor II
  • 853 Views
  • 3 replies
  • 0 kudos

Resolved! How Can I Analyze Gaming Website Traffic and Search Trends with Databricks?

I'm learning Databricks, and I'm interested in using it to analyze data from a gaming website focused on Tomodachi Life ROM .I'd like to understand the best approach for building a simple analytics workflow.Some questions I have are:How can I import ...

  • 853 Views
  • 3 replies
  • 0 kudos
Latest Reply
EvanBrooks
Visitor
  • 0 kudos

Databricks is a good option for learning website analytics because you can combine data preparation, SQL queries, PySpark, and visualizations in one workflow. I’d start by importing a CSV export from Google Analytics 4, checking for missing values, a...

  • 0 kudos
2 More Replies
AlexSantiago
by > • New Contributor II
  • 21624 Views
  • 24 replies
  • 4 kudos

spotify API get token - raw_input was called, but this frontend does not support input requests.

hello everyone, I'm trying use spotify's api to analyse my music data, but i'm receiving a error during authentication, specifically when I try get the token, above my code.Is it a databricks bug?pip install spotipyfrom spotipy.oauth2 import SpotifyO...

  • 21624 Views
  • 24 replies
  • 4 kudos
Latest Reply
Issac_Newton
  • 4 kudos

This error usually occurs because SpotifyOAuth is trying to request interactive input, which Databricks notebooks may not support. You can resolve it by configuring the Spotify authorization flow correctly, including the redirect URI, and obtaining t...

  • 4 kudos
23 More Replies
scbutler1
by > • New Contributor
  • 1167 Views
  • 1 replies
  • 0 kudos

Indexless Indexes

Super excited about learning how AI can help improve performance and throughout for our database customers.

  • 1167 Views
  • 1 replies
  • 0 kudos
Latest Reply
Issac_Newton
  • 0 kudos

Interesting topic! Could you explain how indexless indexes work and how they can improve database query performance? I’d be interested to learn about their practical use cases and any limitations compared with traditional indexing.

  • 0 kudos
Ajay-Pandey
by > • Databricks MVP
  • 6654 Views
  • 13 replies
  • 4 kudos

Databricks Job cluster for continuous run

Hi AllI am having situation where I wanted to run job as continuous trigger by using job cluster, cluster terminating and re-creating in every run within continuous trigger.I just wanted two know if we have any option where I can use same job cluster...

AjayPandey_0-1728973783760.png
  • 6654 Views
  • 13 replies
  • 4 kudos
Latest Reply
Henderson
Visitor
  • 4 kudos

Managing job clusters with continuous triggers can be challenging, especially when a cluster terminates and must be recreated for every run. Reusing the same cluster could potentially reduce startup delays and improve resource efficiency, depending o...

  • 4 kudos
12 More Replies
Payal_Pa
by > • New Contributor
  • 201 Views
  • 2 replies
  • 0 kudos

Is the Data Engineer Learning Plan enough to pass the Databricks Certified Data Engineer Associate e

Hi everyone,I'm currently preparing for the Databricks Certified Data Engineer Associate exam and have started the Data Engineer Learning Plan on Databricks Academy (11 e-learning courses, about 16 hours in total). It covers topics like:Data Ingestio...

  • 201 Views
  • 2 replies
  • 0 kudos
Latest Reply
SajeevS
Visitor
  • 0 kudos

Adding to Vlad's answer, here are a few areas from the current exam guide (May 2026) that are easy to under-prepare from the courses alone:Governance and Security (15%): practise Unity Catalog access control with GRANT, REVOKE and DENY, managed vs ex...

  • 0 kudos
1 More Replies
fflory
by > • New Contributor II
  • 309 Views
  • 4 replies
  • 0 kudos

Premium PAYG account stuck at TRIAL_VERIFIED (rate limit of 0 on resold models) — how do I get promo

Following up on the trust-tier mechanics iyashk-DB explained in this thread (https://community.databricks.com/t5/generative-ai/foundation-models-api-blocked-quot-databricks-set-rate-limit-of/m-p/160952) and this one (https://community.databricks.com/...

  • 309 Views
  • 4 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Short answer: I'm not aware of any self-service action, in the workspace or the account console, that promotes an account's trust tier. That's a Databricks-side determination, so someone at Databricks has to act on it. The Anthropic 401 is a separat...

  • 0 kudos
3 More Replies