Databricks Community

fuselessmatt · 04-03-2023

We want to use the INSERT INTO command with specific columns as specified in the official documentation. The only requirements for this are✅️ Databricks SQL warehouse version 2022.35 or higher✅️ Databricks Runtime 11.2 and aboveand the behaviour sh...

fuselessmatt · 04-03-2023

The Databricks widget (dbutils) provides the get function for accessing the job parameters of a job.dbutils.widgets.get('my_param')Unlike Python dict, where get returns None or an optional argument if the dict doesn't contain the parameter, the widg...

fuselessmatt · 03-27-2023

I renamed our service principal in Terraform, which forces a replacement where the old service principal is removed and a new principal with the same permission is recreated. The Terraform succeeds to apply, but when I try to run dbt that creates tab...

fuselessmatt · 03-01-2023

Hi!We have this dbt model that generates a table with user activity in the previous days, but we get this vague error message in the Databricks SQL Warehouse.Job aborted due to stage failure: Task 3 in stage 4267.0 failed 4 times, most recent failure...

fuselessmatt · 01-18-2023

We have been successfully managing access for our unity catalogs using the databricks_grant resources in Terraform. Now we want to enable the Rudderstack integration for Databricks, but that does not support unity catalog and instead put files inside...

fuselessmatt · 04-19-2023

Is this really accurate? It is true that if you REVOKE usage on Unity Catalogs, it disappears, but I tried to remove everything for the hive_metastore with the Data Explorer UI and account admin and it still seems to persist?Same thing for the sample...

fuselessmatt · 04-19-2023

This is also true for removing groups before unassigning them (removing and unassigning in Terraform)│ Error: cannot update grants: Could not find principal with name <My Group Name>

fuselessmatt · 04-03-2023

Thanks for helping us with this. Are you sure about that? It seems the documentation says it should still be possible"If the target table schema does not define any default value for the inserted column, Databricks SQL assigns NULL if the column is n...

fuselessmatt · 04-03-2023

Thanks! This is actually a really helpful (secret?) command to know if I end up in this situation again! I guess I was too stuck in how it worked in Redshift to try that.Since you are from Databricks, what do you think of the idea of letting the view...

fuselessmatt · 03-30-2023

Reducing the data volume works, sadly we need that exact logic and we have that users. However, calculating the join condition works as I mentioned in my own reply in this thread

Databricks Community

User Stats

User Activity

Omitting columns in an INSERT statement does not seem to work despite meeting the requirements

Can assign a default value for job parameter from the widget?

Accidentally removing the service principal that owns the view seems to put the Unity Catalog in an illegal state. Can you fix this?

What does "Command exited with code 50 mean" and how do you solve it?

Is it possible to manage access for legacy catalogs (hive_metastore) in Terraform?

Re: Hide hive_metastore

Re: Accidentally removing the service principal that owns the view seems to put the Unity Catalog in an illegal state. Can you fix this?

Re: Omitting columns in an INSERT statement does not seem to work despite meeting the requirements

Re: Accidentally removing the service principal that owns the view seems to put the Unity Catalog in an illegal state. Can you fix this?

Re: What does "Command exited with code 50 mean" and how do you solve it?