Databricks Community

AmitDECopilot

I recently explored the Lakehouse Industry Data Models repository published under Databricks Industry Solutions on GitHub.The scale of the repository is impressive:• 40 industries• 80 models across ECM and MVM variants• More than 23,000 tables and da...

AmitDECopilot

AI is becoming part of almost every data engineering workflow.We are asking AI to generate SQL, PySpark pipelines, data-quality rules, unit tests, technical specifications and even complete project structures. The results can be impressive, but there...

AmitDECopilot

I have been exploring the architecture behind Agent Bricks Knowledge Assistant, particularly the relationship between Instructed Retriever and the newer Instructed-Retriever-1 model.One practical question helped me understand the difference:“The prod...

AmitDECopilot · 08-09-2026

One interesting way to look at CDF on Materialized Views is the difference between source-level change and business-level change.CDC might tell us that five banking transactions changed. But after those transactions pass through our transformations,...

AmitDECopilot · 08-02-2026

In many data platforms, the problem is not that we do not have enough tables.Usually, we have too many.Bronze tables.Silver tables.Gold tables.Reporting views.Power BI calculations.Tableau logic.Excel extracts.Ad-hoc SQL.Notebook logic.After some tim...

AmitDECopilot · Re: Databricks Advanced Learning Festival: September 16 - October 14 2026

The combination of structured learning with a 50% certification voucher makes this a great opportunity for anyone looking to strengthen their Data + AI skills.I put together a quick summary of the program, key dates, and what Data Engineers should lo...

AmitDECopilot

Great question. I’d generally avoid patching the already-computed Gold table directly.For late-arriving or corrected records, I prefer replaying from the earliest reliable layer where the correction exists, but only for the impacted keys/time window ...

AmitDECopilot · 07-23-2026

Hi,I think this may be more of an account/subscription mapping issue than customer vs partner sign-up only.Few things I would check:Are you logged into the same Databricks Academy account where the Labs subscription is active?Are you going through th...

AmitDECopilot · 07-23-2026

Hi,I think first thing to check is whether this is expected auto-stop behavior or the app is actually crashing.In Databricks Apps, if the app is Stopped, normally the app config is still there and you should be able to restart it. But if it is Crashe...

AmitDECopilot · 07-19-2026

My understanding is Databricks AI/BI dashboards are not really built like Grafana where you can install custom visualization plug-ins inside the dashboard itself. So if the requirement is true custom 3D charts using ObservableHQ / Three.js / custom J...

Databricks Community

User Stats

User Activity

Databricks Lakehouse Industry Data Models: What Data Engineers Can Learn from the GitHub Repository

I Stopped Sending Every Data Engineering Task to an LLM - A Cost Aware Routing Pattern on Databricks

Exploring Databricks Instructed-Retriever-1 Through a Data Engineering Use Case

Change Data Feed on Materialized Views Why I Think This Is More Than an Incremental Processing

Databricks Metric Views: Why Gold Tables Are No Longer the End of the Pipeline

Re: Databricks Advanced Learning Festival: September 16 - October 14 2026

Re: Change Data Feed on Materialized Views Why I Think This Is More Than an Incremental Processing

Re: Labs

Re: My Apps get stopped automatically

Re: Building Plug-ins for AI/BI Dashboard