Databricks Community

Kirankumarbs

Hi all,I'm evaluating Lakebase for my company and writing up a recommendation. Most of what I can find is launch material and overview posts. Useful for understanding what it does, less useful for deciding whether to run it.So I'd rather hear from pe...

Kirankumarbs

How do you debug OOM on long-running streaming jobs?Hi All,One of my Structured Streaming jobs has started dying with OutOfMemoryError. Runs fine for about approx 40 hours, then falls over, restarts, and does the same thing again. I had introduced fe...

Kirankumarbs

Background. In October 2026, eight eMudhra intermediate CA keys turned out to be recoverable from their public certificates. Browsers blocked them within days. Non-browser clients that carry their own trust store keep trusting the chain until that st...

Kirankumarbs · 05-06-2026

I recently bought an Instructor-Led Databricks Academy Course, but i am unable to see the option to download an invoice for my Corporate Reimbursement!Anyone aware of how to download or facing the same issue? I checked/skimmed all over Databricks Aca...

Kirankumarbs · 03-27-2026

We needed job_id and run_id in a custom metrics Delta table so we could join to `system.lakeflow.job_run_timeline`. Tried four approaches before finding the one that works on serverless compute.What doesn't workspark.conf.get("spark.databricks.job.id...

Kirankumarbs

For example: When we talk about Lakbase costs, resources mention simply aboutPrice per CU-hour(List price: $0.58 per DBU, so $0.1235 per CU-h) but Always-On leads you $67.6 per CU per monthWhat about Storage costs(Probably, $0.345 per GB-month)PITR h...

Kirankumarbs

Autoscaling is going to be default going forward and provisioned going to be deprecated

Kirankumarbs

By treating Databricks resources as code, DABs enables peer review through standard Git Lakeflow Jobs like pull requestsThat means keeping all resources such as Jobs, Servings, lakeflow, Dashboards as code at Github repo and deploy through DABs allow...

Kirankumarbs

I don't have first hand experience with SAP BW migration and i don't think any direct connectors are supported here such as Lakeflow connect or Copy commands.I think this might require either some external partner tools or build migration yourself! O...

Kirankumarbs

Thanks for reply and let me share my investigation so far!> Look at heap used right after a full GC. If that floor keeps rising at a steady input rate, something is retaining memory.Heap seems not raising. Live heap after GC is around 2-3.5GB(we are ...

Databricks Community

User Stats

User Activity

Lakebase in production: what surprised you?

Memory Profiling

eMudhra CA key leak: Databricks LTS runtimes still trust the affected root.

How to download Course Invoice from Databricks Academy

How to actually get job_id and run_id in a Databricks Python wheel task (Avoid Hallucinations)

Re: Lakebase in production: what surprised you?

Re: Lakebase experience

Re: DevOps Fundamentals: Lecture - Deploying Databricks Assets Overview

Re: Best approach for migrating SAP BW to Databricks?

Re: Memory Profiling