Databricks Community

Seems like you are combining a file path for FLASK_APP with running a file using command. When FLASK_APP is set to a full path, Flask expects that path to point to a Python file (e.g., app.py) or package that contains the application instance.​Correc...

Hello @smoortema , here are some helpful tips and tricks.   Here’s how to quickly determine which join strategy Spark used—between broadcast hash join, shuffle hash join, and sort-merge join—and how to read both the query plan and the Spark UI to ver...

Hello @shivamrai162! The error is from a workspace quota, not billing. You’ve hit the Model Serving provisioned concurrency quota, which is enforced independently of your remaining trial credits. That’s why you can still have $200 left and see a quot...

Here’s how you can implement DQ at each stage:Bronze LayerChecks:File format validation (CSV, JSON, etc.).Schema validation (column names, types).Row count vs. source system.Tools:Use Databricks Autoloader with schema evolution and badRecordsPathImpl...

I Passed my Exam today thanks

Root cause in plain English The lookup client is trying to read SQL-style credentials like PREFIX_USER/PREFIX_PASSWORD for a third‑party online store and the “prefix” is empty, so it searches for “_USER” and fails. That auth scheme applies only to th...

DLT doesn’t have a UI for library installation, but you can:Use libraries configuration in the pipeline JSON or YAML spec:{ "libraries": [ { "maven": { "coordinates": "com.sap.hana.hadoop:sap-hdlfs:<version>" } } ] }Or...

well no concrete answer on why, perhaps Data Profile is treated as ephemeral, computed metadata or a snapshot of summary statistics (like min/max, distinct counts, etc.). It is created by a user's compute job within a specific workspace environment. ...