Databricks Community

Shazaamzaa · 08-05-2024

Hey team, I'm trying to standardize the development environment setup in our team. I've written up a shell script that I want our devs to run in WSL2 after setup. The shell script does the following:1. setup Azure CLI - install and authenticate2. Ins...

Shazaamzaa

DABs use Terraform which in turn calls the API anyway. So, I guess it comes down to personal preference of deployment consistency, code maintenance etc. However, from your description of "taking a user's SQL" I'm assuming some sort of real-time appli...

Shazaamzaa

If I understand it correctly, you have source files partitioned by application and region in cloud storage that you want to load and would like some suggestions on the Unity Catalog structure. It will definitely depend on how you want the data to be ...

Shazaamzaa · 08-07-2024

Hey @Kaniz_Fatma thanks for the response. I persisted a little more with the logs and the issue appears to be related to WSL2 not having a backend credential manager to handle management of tokens supplied by the OAuth process. To be honest, this is ...

Shazaamzaa · 08-06-2024

It's an interesting question. Based on the below limitation listed in their official docs, I'm assuming the location of the file is purposefully not displayed in the metadata. Would be interested to know the answer though. Ref:- Use materialized view...

Shazaamzaa · 08-05-2024

Alerts are available as an object under the SQL task in a Workflow/job using DAB. I also see from the docs that creating and maintaining alerts via the API is still in Public Preview. So, I'd be sure to wait until GA prior to using it in production.C...

Databricks Community

User Stats

User Activity

Setup dbt-core with Azure Entra ID

Re: DABs vs API

Re: Unity Catalog: Metastore 3 level Hierarchy

Re: Setup dbt-core with Azure Entra ID

Re: Where are materialized view generated by Delta Live Table stored?

Re: Promoting assets from Dev workspace to Prod