Databricks Community

adhi_databricks

Hi everyone,We're migrating a Scala Structured Streaming application (Kinesis → Delta) from classic compute to Databricks Serverless Jobs for cost optimization. During the migration, we're consistently seeing what appears to be a Spark Connect / gRPC...

adhi_databricks · 12-01-2025

I am encountering multiple issues in our Databricks environment and would appreciate guidance or best-practice recommendations for each. Details below:1. [MaxSparkContextsExceeded] Too many execution contexts are open right now (Limit 150)Error: [Max...

adhi_databricks · 11-28-2025

Hi everyone,I’m trying to set up a smooth local-development workflow for Databricks and would love to hear how others are doing it.My Current SetupI do most of my development in Cursor (VS Code-based editor) because the AI agents make coding much fas...

adhi_databricks · 07-27-2025

Hi everyone,I'm experiencing a strange issue with one of my Databricks notebooks — the Table of Contents (ToC) pane is no longer visible. It used to show up on the left, but now it’s missing only for this specific notebook.What I’ve observed so far:T...

adhi_databricks · 07-17-2025

Hi Databricks Community! I'm currently preparing for the Databricks Certified Associate Developer for Apache Spark exam, and I’ve noticed there’s been a recent update to the exam pattern as of June 2025. I’m reaching out to gather insights, resource...

adhi_databricks · 07-28-2025

Hey @Raghavan93513 ,Thanks for your response.The issue I'm facing is that the markdown text in our notebooks isn't appearing in the table of contents. I can see the table of contents panel on the left side of the notebook, but it doesn’t display any ...

adhi_databricks · 07-15-2025

Hey folks, Thanks for the help hereWas able to solve this issue with updating the databricks cli to latest versionThanks once again!!

adhi_databricks · 07-14-2025

Have already tried adding the default value , still the same error was displayed.

adhi_databricks · 03-25-2025

Hey @ayushmangal72 , try using the Databricks Job Run API (/api/2.2/jobs/runs/list) to fetch older run IDs for the job.Once you have the run_id, make a request to the API at /api/2.2/jobs/runs/get. You'll be able to find the DBR version in the API r...

adhi_databricks · 02-26-2025

Hi @Alberto_Umana , Just a QQ would we be able to change table properties like adding column details, column tagging and Column level masking on the snowflake tables that are under the foreign catalog created?

Databricks Community

User Stats

User Activity

Serverless Scala JAR: foreachBatch fails with RST_STREAM PROTOCOL_ERROR

Multiple Databricks Issues: Spark Context Limit, Concurrency Load, API Character Limit & Job Timeout

How Are You Using Local IDEs (VS Code / Cursor/ Whatever) to Develop & Run Code in Databricks?

Table of Contents Not Visible in Databricks Notebook

Seeking Guidance for Spark Certification

Re: Table of Contents Not Visible in Databricks Notebook

Re: Requirement to run a databricks job from another job based on custom conditions using DAB

Re: Requirement to run a databricks job from another job based on custom conditions using DAB

Re: Revert cluster DBR version to last DBR

Re: Connect snowflake to Databricks