Databricks Community

I hit the same error.When creating a Unity Catalog metastore from the web UI of the Azure Databricks Account Console, the following error appeared during Access Connector validation, despite having all the Azure configuration correctly set up (manage...

This sounds like it could be related to the size of the result set or the way the internal stage handles large downloads, rather than the federation itself. If smaller query results download successfully while larger ones fail, I’d compare the file s...

Hi @treesloth You can easily do this by using a dashboard parameter to handle the date grouping directly in your SQL query, while keeping the chart's Transform setting as None. Here is the step-by-step setup:Step 1: Create a dataset for the dropdown ...

Your overall design is sensible, but Databricks’ current recommendation is to use Managed Disaster Recovery when your account is eligible. If Managed DR is unavailable, use an active-passive warm standby with Terraform/DABs, cross-region data replica...

@ThiamLee You can use Notebooks that let you write Python and SQL code interactively. You use libraries like pandas, matplotlib, ydata profiling and Py Spark for both small and large-scale analysis in it. Databricks SQL provides a dedicated SQL edito...

@karuppusamy Try using ORCL as the service name.

Good point managed schemas/volumes need extra caution with bundle destroy. I’d avoid managing production data resources directly through DABs, or use safeguards to prevent accidental deletion.

If you must use an All-Purpose cluster (e.g., for cost savings or fast start times), here is how you manage the chaos:The "Job Name" filter in the Jobs UI: Don't look at the Spark UI first. Go to the Workflows > Jobs tab. You can filter the "Runs" li...