- 3989 Views
- 4 replies
- 0 kudos
Azure Databricks account api can't auth
Hi,does anyone know about any existing issue with azure databricks account api? I cannot do below:1. login with cli `databricks auth login --account-id <acc_id>, this is what I get https://adb-MY_ID.azuredatabricks.net/oidc/accounts/MY_ACC_ID/v1/auth...
- 3989 Views
- 4 replies
- 0 kudos
- 0 kudos
UPDATE Solved, the very same solution started to work today from running a pipeline with tf - M2M auth. with a service principal with fed auth. That's the 2 from my above post.When trying to follow these steps https://learn.microsoft.com/en-us/azure/...
- 0 kudos
- 2783 Views
- 1 replies
- 0 kudos
Public exposure for clusters in SCC enabled workspaces
Hi,We are facing a requirement where we need to somehow expose one of our Databricks clusters to an external service. Our organization's cyber team is running a security audit of all of the resource we use and they have some tools which they use to r...
- 2783 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod ,Thank you very much for the reply. But I don't think this actually resolves our concern.All these solutions talk about utilizing the databricks cluster to access/read data in Databricks. They focus on getting to the Databricks data t...
- 0 kudos
- 5524 Views
- 2 replies
- 1 kudos
Resolved! Install system libraries on the cluster
The `Library` option in cluster config allows installation of language-specific libraries - e.g., PyPi for Python, CRAN for R.Some of these libraries - e.g., `sf` - require system libraries - e.g., `libudunits2-dev`, `libgdal-dev`.How may one install...
- 5524 Views
- 2 replies
- 1 kudos
- 1 kudos
you can install in init scripthttps://docs.databricks.com/en/init-scripts/index.html
- 1 kudos
- 4494 Views
- 2 replies
- 0 kudos
Authenticate with Terraform to Databricks Account level using Azure MSI(System assigned)
Hello, I want to authenticate with terraform to databricks account level with : Azure Managed Identity(System-assigned) of my Azure VMto perform operation like create group. I followed differents tutorial and the documentation on Azure and Databricks...
- 4494 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello,On my side, I always have to add the provider in each resource block.You can try that: resource "databricks_group" "xxxxx" { provider = databricks.accounts display_name = "xxxxx" } About authentication, you can also try to add:auth_type ...
- 0 kudos
- 4096 Views
- 2 replies
- 0 kudos
Problem loading catalog data from multi node cluster after changing Vnet IP range in AzureDatabricks
We've changed address range for Vnet and subnet that the Azure Databricks workspace(standard sku) was using, after that when we try to access the catalog data, we're getting socket closed error. This error is only with Multi node cluster, for single ...
- 4096 Views
- 2 replies
- 0 kudos
- 0 kudos
Yes, it is mentioned that we cannot change the Vnet. I've changed the range in the same vnet but not the Vnet. Is there any troubleshooting that I can do to find this issue. The problem is, I don't want to recreate the workspace. It is a worst case s...
- 0 kudos
- 19725 Views
- 4 replies
- 1 kudos
Resolved! databricks OAuth is not supported for this host
I'm trying to deploy using Databricks Asset Bundles via an Azure DevOps pipeline. I keep getting this error when trying to use oauth:Error: default auth: oauth-m2m: oidc: databricks OAuth is not supported for this host. Config: host=https://<workspac...
- 19725 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @bradleyjamrozik, thank you for posting your question. You will need to use ARM_ variables to make it work Specifically ARM_CLIENT_ID ARM_TENANT_ID ARM_CLIENT_SECRET https://learn.microsoft.com/en-us/azure/databricks/dev-tools/auth#environment-3 f...
- 1 kudos
- 2590 Views
- 1 replies
- 0 kudos
Terraform for Databricks
Hi all,I can't find guidance on how to create a Databricks access connector for connecting catalogs to external data locations, using Terraform.Also, I want to create my catalogs, set-up external locations etc using Terraform. Has anyone got a good r...
- 2590 Views
- 1 replies
- 0 kudos
- 2490 Views
- 1 replies
- 1 kudos
keyrings.google-artifactregistry-auth fails to install backend on runtimes > 10.4
We run Databricks on GCP. We store our private Python packages in the Google Artifact Registry. When we need to install the private packages we a global init script to install `keyring` and `keyrings.google-artifactregistry-auth`. The we `pip inst...
- 2490 Views
- 1 replies
- 1 kudos
- 1555 Views
- 1 replies
- 0 kudos
SQL Warehouse tag list from system table ?
Hello, Is there a way to get the tags of SQL Warehouse clusters from system tables ? like you do with system.compute.clustersThanks,
- 1555 Views
- 1 replies
- 0 kudos
- 0 kudos
Answering my own question : system.billing.usage.custom_tags['cluster-owner'] @ databricks : I don't really understand the logic here
- 0 kudos
- 6690 Views
- 2 replies
- 0 kudos
Resolved! Databricks SSO Azure AD
Hello,I'm trying to test SSO with Azure AD.The test sso is passing on dtabricks and I can connect to databricks using SSO.When I try to test with postman to obtain a token I have the next error message :{"error_description":"OAuth application with ...
- 6690 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello,The issue was with the postman.In postman you don't have to give the client id from your IDP but the client id from databricks "App connections".it is working well now.thank you.
- 0 kudos
- 4373 Views
- 1 replies
- 0 kudos
Databricks on premise GDCE
Hello, Any plans for supporting Databricks on GDCE or other on private cloud-native stack/HW on premise?Regards, Patrick
- 4373 Views
- 1 replies
- 0 kudos
- 1575 Views
- 2 replies
- 1 kudos
inter connected notebook
How to use inter connected notebook, available in databricks?
- 1575 Views
- 2 replies
- 1 kudos
- 1 kudos
Do you mean running one notebook from another and using variables and functions defined in the other one? If that's what you're seeking, try using the magic command %run + notebook path. You can find some documentation about it here: https://docs.da...
- 1 kudos
- 2324 Views
- 2 replies
- 0 kudos
Asset Bundles -> creation of Azure DevOps pipeline
If you choose in asset bundles mlops-stacks, it will create for you out of the box many nice things, including a pipeline to deploy to dev/stage/prod. #databricks
- 2324 Views
- 2 replies
- 0 kudos
- 2019 Views
- 1 replies
- 0 kudos
databricks on azure jdbc
Hello Databricks teamI have one question regarding data bricks on azure configuration using jdbc [Simba][SparkJDBCDriver](700100)I am getting below error message : java.sql.SQLException: [Simba][SparkJDBCDriver](700100) Connection timeout expired. De...
- 2019 Views
- 1 replies
- 0 kudos
- 0 kudos
Check your network connection. Try "%sh nc -zv {hostname} {port}"
- 0 kudos
- 2430 Views
- 0 replies
- 0 kudos
Unity Catalog - Created UC and linked it to my DEV storage account for the entire org
Hello everyone,I was lead in a data platform modernization project. This was my first time administrating databricks and I got myself into quite the situation. Essentially i made the mistake of linking our enterprise wide Unity Catalog to our DEV Azu...
- 2430 Views
- 0 replies
- 0 kudos
