Databricks Community

Poorva21

Databricks is positioning the platform as a full stack for LLM development — from data ingestion → feature/embedding pipelines → fine-tuning (Mosaic AI) → evaluation → deployment (Model Serving) → monitoring (Lakehouse Monitoring).I’m curious about r...

Poorva21

Hi everyone,I'm working on optimizing Databricks costs for a production-grade data pipeline (Spark + Delta Lake) on Azure. I’m looking for practical, field-tested strategies to reduce compute and storage spend without impacting performance.So far, I’...

Poorva21

@siva_pusarla , Try to convert env_setup into repo-based code and control behavior via environmentInstead of a workspace notebook, use a Python module in the repo and drive environment differences using:Job parametersBranches (dev / test / prod)Secre...

Poorva21

Awesome! Thank for sharing

Poorva21

Your masking UDF returns a VARIANT, but it is being applied as a column-level security (CLS) policy on a column with a fixed data type (e.g., DATE).Inside a CLS policy, Databricks requires that the final returned value must cast back into the target ...

Poorva21

1. dbmanagedidentity is the Workspace-Managed Identity (WMI) that Databricks automatically creates when your workspace is deployed (in Azure).It is the identity used by compute resources such as:Jobs computeAll-purpose clustersSQL warehousesModel ser...

Poorva21

Thank You @Gecofer for taking the time to share such a clear, experience-backed breakdown of where Databricks shines and where real-world LLM Ops architectures still need supporting components. Your explanation was incredibly practical and resonates ...

Databricks Community

User Stats

User Activity

How realistic is truly end-to-end LLMOps on Databricks?

Best Practices for Optimizing Databricks Costs in Production Workloads?

Re: workspace notebook path not recognized by dbutils.notebook.run() when running from a workflow/jo

Re: How to Accelerate Databricks SQL Migration Using BrickMod and AI

Re: CLS function with lookup fails on dates

Re: What's the difference between dbmanagedidentity and a storage credential based on managed identi

Re: How realistic is truly end-to-end LLMOps on Databricks?