- 2882 Views
- 5 replies
- 2 kudos
Promoting assets from Dev workspace to Prod
What is the best way to promote Databricks objects from one workspace to another? For example, DABs are great for code and models. However, SQL alerts do not seem to fall into DABs. The API allows for retrieving queries and creating them via API in t...
- 2882 Views
- 5 replies
- 2 kudos
- 2 kudos
https://docs.databricks.com/api/workspace/queries https://docs.databricks.com/en/sql/dbsql-api-latest.html#changes-to-the-alerts-api The API path is now api/2.0/sql/alerts, replacing the legacy path of /api/2.0/preview/sql/alerts. https://docs.databr...
- 2 kudos
- 1157 Views
- 1 replies
- 1 kudos
System Tables
Hi,I've recently enabled the billing schema in system tables, but still not able to view it in catalog. I am both an account admin and workspace admin, as well as an owner of the workspace in Azure. A colleague (who used to be Azure AD admin but no l...
- 1157 Views
- 1 replies
- 1 kudos
- 880 Views
- 1 replies
- 1 kudos
How to list my groups in unitity catalog via an API
I'm trying to list my groups in unity catalog via an API call, but it keeps giving the error "Bad Target"My GET request is:-https://adb-3676685197829242.2.azuredatabricks.net/api/2.1/accounts/cfb89269-0d9e-4235-b7985-455481b501a/scim/v2/GroupsI'm abl...
- 880 Views
- 1 replies
- 1 kudos
- 1326 Views
- 1 replies
- 1 kudos
Databricks + Apache Iceberg = advantageous or wasted effort due to duplicate functionality ?
Trying to design a Lakehouse. Spark is at the base layer. Now wondering if adding Apache Iceberg sitting below Spark will be of help, or, not ? Preferring Iceberg for its auto indexing, ACID query facilities over big hetergenous datasets. Wonder if i...
- 1326 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello, if you're planning on building your own open source stack of spark+iceberg, it can be a good choice. If you're on Databricks, however, you're going to miss out a *lot* on delta features that are baked into the platform. Specifically compute +...
- 1 kudos
- 4881 Views
- 4 replies
- 3 kudos
Resolved! [VNET injection] Container and container subnet
Hi,I was researching everywhere and could not find the answer. I understand that when workspace is created, it has 2 subnets, host and container. The VM, which runs the Databricks container, is in host subnet, which logically means the container is a...
- 4881 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @data_bricklayer ,Public Subnet (host): The public subnet is typically used for resources that need to communicate with the internet or other Azure services. In Azure Databricks, this subnet is used for driver nodes of the clusters that require ou...
- 3 kudos
- 5786 Views
- 3 replies
- 2 kudos
Connecting external location from a different tenant in Azure
Hi,we have a setup with 2 different Azure tenants. In tenant A we have a storage account that we want to connect as an external location to a databricks workspace in the tenant B. For that we have established a private endpoint from the storage accou...
- 5786 Views
- 3 replies
- 2 kudos
- 2 kudos
It would be superb to connect between two tenants with Azure Databricks Access Connector
- 2 kudos
- 4259 Views
- 1 replies
- 0 kudos
Resolved! Prevent service principal UUID from appearing on job name
Hello!I am using service principal id to authenticate my databricks bundle. But when the job runs, this id is automatically appended to both the name and tags column on the jobs run page. In my databricks.yml file I have name: "[${var.environment}]" ...
- 4259 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi!Sounds like the "development" mode. DAB will automatically prefix your jobname with <env> <user name> if you set "mode" to "development" in the databricks.yml file. The name lookup for service principals apparently doesn't work nicely and you get ...
- 0 kudos
- 2450 Views
- 4 replies
- 5 kudos
Why all workspace users can see my user folder
Hi, I am a Databricks account admin user with admin access to our workspace. My user folder for some reason is visible to all workspace users. I have checked permissions settings where possible and cannot see anything that would indicate fully shared...
- 2450 Views
- 4 replies
- 5 kudos
- 5 kudos
workspace is visible for all , you have to make changes in Admin console ,you will find this feature there to disable it
- 5 kudos
- 2150 Views
- 1 replies
- 1 kudos
Resolved! How to Pass Azure variable to databricks.yml file
Hello I would like to find a way to pass a variable from my Azure variables to my databricks yml file. For example I would like to pass the variable BUNDLE_TARGET to the location in this databricks.yml fileIs there a way to do something like this?...
- 2150 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @TheManOfSteele ,Here are the examples of how to achieve that. I think the simplest way would be to set environment variables.azure devops - How can I pass parameters to databricks.yml in Databricks Asset Bundles? - Stack OverflowDatabricks Asset ...
- 1 kudos
- 3638 Views
- 0 replies
- 0 kudos
Azure Pipeline Release Bundle Validate Failure
Hello,I am trying to create a CI/CD pipeline. After the build pipeline, I am trying to create a release to databricks that runs a notebook. I am trying to run this as a service principal. During the bundle validate step I am getting this error. "Erro...
- 3638 Views
- 0 replies
- 0 kudos
- 2080 Views
- 3 replies
- 0 kudos
Resolved! Workspace selector not working
On the top-right of the Databricks GUI is a selector to select workspaces from.Since yesterday morning (approximately the same time the Microsoft outage happened) that selector stopped working. Instead of a dropdown of Workspaces, we only get a spin...
- 2080 Views
- 3 replies
- 0 kudos
- 0 kudos
Glad to know the issue has stopped occurring, but in case it re-occurs in future, we could collect some backend logs, to understand what is causing the slowness, when the issue is and resolve the service. I would request you to involve the azure team...
- 0 kudos
- 3722 Views
- 2 replies
- 0 kudos
Azure Network Settings in regards to Databricks Table Monitoring
I have set up my Unity Catalog on an Azure Data Lake which uses the companies virtual network to allow access.I have all privileges on my account, so I am able to create, alter or delete catalogs, schemas and tables. I can do these things either usin...
- 3722 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi Kaniz,Thanks for the response and for identifying the problem.I would like some steps on how to adjust the network settings, as everything I have tried so far, hasn't seemed to work.
- 0 kudos
- 1420 Views
- 1 replies
- 0 kudos
databricks-connect 14.3 spark error against 14.3 cluster with data_security_mode = NONE
I am running into an issue with trying to use a 14.3 cluster with databricks-connect 14.3.My cluster config: { "autoscale": { "min_workers": 2, "max_workers": 10 }, "cluster_name": "Developer Cluster", "spark_version": "14.3.x-scala2...
- 1420 Views
- 1 replies
- 0 kudos
- 0 kudos
Are you running the latest version of the Databricks connect?
- 0 kudos
- 3473 Views
- 2 replies
- 3 kudos
Unable to read resources - Unsupported Protocol Scheme (Terraform AWS)
Hello everyone!Over the last few weeks my company has been trying to deploy a Databricks workspace on AWS adapted to the customer's needs, using Terraform. To do this, we started from a base code on Databricks own github (https://github.com/databrick...
- 3473 Views
- 2 replies
- 3 kudos
- 3446 Views
- 2 replies
- 0 kudos
Databricks dashboard programatically
Hi,How can I create a databricks dashboard, filters and visuals programatically (api, terraform, sdk, cli...)?Thanks,Pawel
- 3446 Views
- 2 replies
- 0 kudos
- 0 kudos
Maybe slightly late (maybe because development was late :P), but hopefully it will also help other.1. There seems to be support added to the newest terraform databricks provider - 1.49.0 - here2. Other solution would be to use databricks cli (e.g. `d...
- 0 kudos
