- 992 Views
- 3 replies
- 0 kudos
unable to create DBX account : Unable to signup. Please try again, or sign in here...
Hi,I have been trying to create an account at databricks community edition but unable to do it for the past we weeks.Can someone from the databricks support team look into it? I am getting this since past few weeks. Unable to attach the HAR file. Do ...
- 992 Views
- 3 replies
- 0 kudos
- 0 kudos
I hit this same error last week and finally got past it. Sharing what worked, since the existing replies didn't cover this specific cause.What worked for me:Used Edge in InPrivate / incognito mode (Chrome works too if you fully clear cookies first)Sw...
- 0 kudos
- 275 Views
- 1 replies
- 0 kudos
Resolved! Cells highlighter for VS Code?
Hi allI've recently had to switch to VS Code to run some Claude coding over my notebooks and python libraries.I stumbled on highlighting cells for notebooks with SQL injection. It seems to be nowhere documented how to fix.I use Databricks issued "IDE...
- 275 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Dimitry, From the public docs, this looks more like a limitation of the current VS Code experience. As you stated, Databricks now defaults notebooks to .ipynb format. However, you can still switch or convert notebooks between Jupyter (.ipynb) and...
- 0 kudos
- 376 Views
- 3 replies
- 0 kudos
Incremental Load Without any keys
so am performing incremental load where i want to insert or update data but there are no date columns or any keys how can i do the incremental load from silver to gold layer
- 376 Views
- 3 replies
- 0 kudos
- 0 kudos
@Rupa0503 Watermark doesn't need a date column from silver/gold. You can use pipeline run timestamp as the watermark — tracking when the pipeline last ran, not when data was modified. Also you can use Delta table version history within watermark as ...
- 0 kudos
- 402 Views
- 3 replies
- 0 kudos
Resolved! Starting Data Engineering
Hello everyone, my name is Judith. I have been a tech community manager and customer support for the past 5 years. However, this year I am transitioning to become a data engineer. I would love any recommendations or courses to get started. Thank you....
- 402 Views
- 3 replies
- 0 kudos
- 0 kudos
Hello , You can start with Databricks Academy I started directly by exploring free Databricks Workspace and its tool , gaining insights from various resources .You can start with Data Ingestion , there are lot many clouds that databricks give as opti...
- 0 kudos
- 277 Views
- 1 replies
- 0 kudos
Looking for exam voucher help — Databricks Data Engineer Professional
Hi Databricks Community,I am Ragini, a fresher AI/ML developer from Vadodara, India. I am reaching out honestly because I need help with the exam fee for the Databricks Certified Data Engineer Professional certification.During my internship at Stella...
- 277 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Ragini_T, really sorry to hear that. Databricks does offer 50% certification vouchers during its Learning Festival events. The upcoming Advanced Learning Festival is scheduled for 15 June - 06 July 2026, where you can earn a discount voucher. You...
- 0 kudos
- 583 Views
- 2 replies
- 0 kudos
Add comment to multi columns with views
With Table, I can add comment to multi columns by using: ALTER TABLE your_table_name ALTER COLUMN col1 COMMENT 'comment1', col2 COMMENT 'comment2', col3 COMMENT 'comment3';How can I do with views?
- 583 Views
- 2 replies
- 0 kudos
- 0 kudos
For views, there isn’t a single multi-column ALTER VIEW ... ALTER COLUMN col1 ..., col2 ... form. Update each column one at a time instead. Databricks supports column comments on views, and newer runtimes/SQL warehouses use COMMENT ON COLUMN; older f...
- 0 kudos
- 671 Views
- 3 replies
- 1 kudos
Resolved! Schema Evolution and Schema Enforcement without Delta live Tables & Unity catalog
In Delta Lake, schema evolution with mergeSchema handles column additions perfectly — new columns get added and old rows get NULL. But when there is a data type change in the incoming data (for example, a column that was INT now coming as STRING from...
- 671 Views
- 3 replies
- 1 kudos
- 1 kudos
Yes — defining the schema manually for production is okay when you are not using Auto Loader. With a manually provided schema, you should expect stricter enforcement: Delta will not automatically absorb non-widening type changes like INT -> STRING in...
- 1 kudos
- 4130 Views
- 1 replies
- 1 kudos
Seeking GitBook Alternatives for Documenting Databricks Pipelines & ML Workflows
We’re scaling our use of Databricks notebooks and ML pipelines, and keeping everything properly documented is becoming a challenge. I’ve used GitBook in past projects, but it’s starting to feel a bit clunky, especially when trying to keep markdown do...
- 4130 Views
- 1 replies
- 1 kudos
- 1 kudos
There are are a bunch of choices for API documentation tools, especially if you are comfortable with markdown or MDX, GitHub, etc.Some to consider other than GitBook are: Mintlify, Readme, Docusaurus (self-hosted), and Jamdesk.
- 1 kudos
- 318 Views
- 3 replies
- 0 kudos
Databricks missing scheduler for scheduled jobs
Suppose a job is scheduled at 2 am but if scheduler misses it we need to get an alert message how can it be possible.we don't have centralised table monitoring and APIs for it
- 318 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Teja3051, Yes, it is possible for a scheduled run to be delayed or skipped, so I’d first recommend identifying the root cause before putting an alerting workaround in place. Common things to check are scheduler or cloud delays of a few minutes, m...
- 0 kudos
- 267 Views
- 1 replies
- 2 kudos
What I’m Seeing in the Databricks World Right Now
The energy around Databricks feels different this year. It’s no longer just about faster queries or better pipelines. It’s about building intelligent systems on top of trusted data. The conversations have shifted. The expectations have shifted. Even ...
- 267 Views
- 1 replies
- 2 kudos
- 2 kudos
I totally agree with you !I have always learnt by joining communities
- 2 kudos
- 421 Views
- 2 replies
- 3 kudos
Resolved! not able to access "Compute"
when i click on Compute it redirects me to the SQL warehouse section. Why is that happening? I believe i have the enterprise plan with pay as you go enabled.
- 421 Views
- 2 replies
- 3 kudos
- 3 kudos
I am having the same problem. Signed up for a new account (separate from the free trial account) under the same email address. Added credit card details. But I get redirected to SQL Warehouses when I click on Compute.Workspace ID 7474652800168347
- 3 kudos
- 617 Views
- 4 replies
- 0 kudos
Resolved! Databricks Platform Administrator
I am an Informatica Administrator. Want to become Databricks Administrator. Would like to connect with people who are working as Databricks platform admins and understand the path to become a successful Admin.
- 617 Views
- 4 replies
- 0 kudos
- 0 kudos
I think the slides are there for reference . There should be some video later that references that. But I understand that can be be confusing . The notebooks would be downloadable from another version of the course that has a paid labs . So if you ar...
- 0 kudos
- 242 Views
- 1 replies
- 1 kudos
Resolved! Requesting for assistance in creating a user group for my region
Hello Databricks team, I hope you are doing well. I am based in Boston and currently working as a manager in healthcare analytics with one of the Databricks partners. I have been conducting Databricks events and meetups in Boston as well as NY but we...
- 242 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi !You can submit your application here :https://community.databricks.com/t5/announcements/the-new-databricks-user-groups-platform-is-here/td-p/146919
- 1 kudos
- 3464 Views
- 2 replies
- 0 kudos
Archival Strategy for Delta tables
Hi Team, We would like to define the archival strategy for data. Could you please share best practices /guide me on the below are the 3 use cases Case-1: On-Prem SQL and Oracle Data which is more than 20 years and they wanted to bring them into clou...
- 3464 Views
- 2 replies
- 0 kudos
- 0 kudos
case 1: I'd extract the data from the db to a data lake (cold storage if that is possible, that is cheaper) using an ETL tool like Data Factory, Glue etc. Then the archiving can take place. Perhaps also create a backup of the data on a 2nd data lak...
- 0 kudos
- 1262 Views
- 4 replies
- 1 kudos
Databricks Java SDK retrieving job task values
Greetings,I have a Job that consists of notebook tasks running python code.Some of the task set task values using dbutils.jobs.taskValues.set(key=key, value=value)as described here How do I retrieve those task values using Databricks Java SDK v0.69.0...
- 1262 Views
- 4 replies
- 1 kudos
- 1 kudos
Unfortunately you can’t read dbutils.jobs.taskValues directly via the Java SDK. But you could return a JSON payload via dbutils.notebook.exit and read it with getRunOutput. Databricks exposes the notebook “exit” result through Jobs GetRunOutput, then...
- 1 kudos
