Databricks Community

Dimitry

Hi allI've recently had to switch to VS Code to run some Claude coding over my notebooks and python libraries.I stumbled on highlighting cells for notebooks with SQL injection. It seems to be nowhere documented how to fix.I use Databricks issued "IDE...

Dimitry · 02-23-2026

I have a job that is triggered from changes in a table.Table is located in the home catalog.I have multiple environments, that are not predefined (created on the fly)Some process writes into a table, and then job starts processing this table.I have a...

Dimitry · 11-23-2025

I have a query with some grouping. I'm using spark.sql to run that query.skus = spark.sql('with cte as (select... group by all) select *, .. from cte group by all')It displays as expected table.This table I want to split into batches for processing, ...

Dimitry · 10-27-2025

Hi guys I've added a parameter "files_mask " to a notebook, with a default value.The job running this notebook broke with error: com.databricks.dbutils_v1.InputWidgetNotDefined: No input widget named files_mask is definedCode: mask = dbutils.widgets....

Dimitry · 10-16-2025

HI allServerless V3 solved an error of mismatching python versions between driver and worker which I had on V2 (can't remember the exact wording).So I'd been running this on classic compute so far.Today I tried on serverless to a partial success - un...

Dimitry · 03-24-2026

Thanks for the comprehensive answer. Very well explained.

Dimitry · 02-24-2026

Thanks for the details, but I mentioned that pathway:>>I understand there is a way round using CLI and providing the parameter in the command line.My question is "Is there a better solution that would enable deployment from the UI?" Perhaps I was not...

Dimitry · 12-02-2025

Experiencing the same issue. Solved partially by placing high level targets in the job yml file, but this only works if the job has to go only one environment. If this is for two environments, but not the third, there is no way to avoid duplicating t...

Dimitry · 11-24-2025

Hi @Coffee77 Its not a problem with sql (I can generate batch id in other means) - it is a sudden problem with SPARK that may happen with my other existing queries out of nowhere. I don't understand how an existing field (that batch id) being visibly...

Dimitry · 10-28-2025

Also, the same problem with SQL cells

Databricks Community

User Stats

User Activity

Cells highlighter for VS Code?

How to specify home catalog for table trigger in YAML

Dataframe from SQL query glitches when grouping - what is going on !?!

databricks notebook parameter works in interactive mode but not in the job

Serverless - can't parallelize UDF in applyInPandas

Re: How to specify home catalog for table trigger in YAML

Re: How to specify home catalog for table trigger in YAML

Re: Databricks Bundles - How to select which jobs resources to deploy per target?

Re: Dataframe from SQL query glitches when grouping - what is going on !?!

Re: databricks notebook parameter works in interactive mode but not in the job