Databricks Community

@Louis_Frolio - will there be similar guidelines for other 'source' code too such as T-SQL, Teradata. Any such comprhensive docs on Laeebridge to cover per source.

private link from serverless, as probably you are not allowing public internet access. Configure private connectivity to Azure resources - Azure Databricks | Microsoft Learn you need to add both dfs and blob

Thank you K_Anudeep! The REST API is exactly what I was looking for.

My PoV please, We use Databricks REST API; and we have faced 401 or Azure Front door related auth issues. Like you said, we use retry mechanism. Runtime errors are recorded and retry attempts are made if the tasks are idempotent; otherwise user inter...

It sounds like Spark is splitting your output into many small files (one per row) despite coalesce(1). Can you try setting spark.sql.files.maxRecordsPerFile , this limits how many records can be written into a single output file; if this is set to 1 ...

Classic 360 Custoemr View case and Databricks is certainly the right platform to do so.Strcutred Data - Stores in the Delta TablesEmail and PDFs - stored in Volumes, however, metadata as path to the volumes stored in delta table against customer-idIn...

Hi there, I vibe-coded* a query where I was able to derive most of your events from the system tables: system.lakeflow.jobssystem.lakeflow.job_run_timelinesystem.lakeflow.job_task_run_timeline If you have SELECT access to system tables, this could b...

Hi @ssommer-ai ,When you use a table update trigger with a parameter like {{job.trigger.table_update.updated_tables}}, this dynamic parameter only gets populated when the job is triggered by an actual table update event. When you manually click "Run ...

Really cool project! The mood-based movie matching and conversational memory make the whole discovery experience feel way more intuitive. It’s interesting because most people still browse platforms manually — like on streaming App — but your system s...