cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

weilin0323
by New Contributor III
  • 1544 Views
  • 1 replies
  • 0 kudos

Testing and Issues Related to Admin Role Changes

Hello,I would like to ask a question regarding user permissions.Currently, all team members are admins. Recently, we plan to change the admin roles so that only I and another user, A, will be admins. The other members will retain general usage permis...

  • 1544 Views
  • 1 replies
  • 0 kudos
Latest Reply
weilin0323
New Contributor III
  • 0 kudos

Hi @Kaniz_Fatma , Can you please help me to delete my post as I accidentally resubmitted the post.Thank you.

  • 0 kudos
MosefJJunior3rd
by New Contributor
  • 1021 Views
  • 1 replies
  • 0 kudos

How to fully enable row-level concurrency on Databricks 14.1

Hey guys,I hope whoever's reading this is doing well.We're trying to enable row-level concurrency on Databricks 14.1. However, the documentation seems a bit contradictory as to whether this is possible, and whether the whole capability of row-level c...

  • 1021 Views
  • 1 replies
  • 0 kudos
Latest Reply
gchandra
Databricks Employee
  • 0 kudos

Yes, your understanding is correct. As best practice, use 14.3 LTS DBR, as LTS has longer support compared to 6 months.

  • 0 kudos
JohnHarmer
by New Contributor
  • 735 Views
  • 1 replies
  • 0 kudos

Unable to publish notebook

Hello, I receive an error each time I attempt to publish my notebook. the error message does not provide any additional information on why it is occurring. I need to publish this for a bootcamp assignment, so please let me know what I can do to resol...

  • 735 Views
  • 1 replies
  • 0 kudos
Latest Reply
gchandra
Databricks Employee
  • 0 kudos

Try it from a different browser, or try it in incognito mode.

  • 0 kudos
saravjeet
by New Contributor III
  • 1583 Views
  • 2 replies
  • 0 kudos

Allow non-admin users to view the driver logs from a Unity Catalog-enabled pipeline

We are trying to enable the option to allow log reading to the non-admin users in  the databricks wokspace but we are not able to see the obvious way to check them. The documentation is not showing after enabling the below property where to check the...

  • 1583 Views
  • 2 replies
  • 0 kudos
Latest Reply
gchandra
Databricks Employee
  • 0 kudos

Do they see these links in the pipeline?

  • 0 kudos
1 More Replies
jmsimonramos1
by New Contributor II
  • 3610 Views
  • 3 replies
  • 0 kudos

Grant permissions to groups on catalogs linked to the same metastore

Hi everyone!I am configuring several projects using Databricks, and I have a question regarding permission management in Unity Catalog. Here's the situation: Currently, I have two different Databricks resources in an Azure account, each with its resp...

Administration & Architecture
catalog
permissions
Unity Catalog
  • 3610 Views
  • 3 replies
  • 0 kudos
Latest Reply
CharlesWoo
New Contributor II
  • 0 kudos

You could bind the catalog to specific workspaces, making them accessbile only from workspaces they are bound to.https://docs.databricks.com/en/catalogs/binding.htmlIn your example:if `my_catalog_2` is bound to `my_workspace_2` a user in `my_workspac...

  • 0 kudos
2 More Replies
Saf4Databricks
by New Contributor III
  • 887 Views
  • 1 replies
  • 0 kudos

Databricks Free Trial - can I link it back from AWS to Azure?

I created a 14-day trial account on Databricks.com and linked it to my AWS. I have not used the trial yet and want to link it to Azure instead. Question: Can I do it, and if so, how?Remark: Please note that I have not used trial yet and the only rele...

  • 887 Views
  • 1 replies
  • 0 kudos
Latest Reply
gchandra
Databricks Employee
  • 0 kudos

The easy way will be to create a new account in portal.azure.com and launch Azure Databricks with Pay as you go.

  • 0 kudos
mkieszek
by New Contributor II
  • 2136 Views
  • 4 replies
  • 1 kudos

set access control list for job cluster

Hello,currently, we are using an init script that calls the DBW API to add "can_attach_to" permissions for a specific group to initialize the job cluster. How can we set an access control list for job clusters? Is it possible to add it to a policy?

  • 2136 Views
  • 4 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @mkieszek ,You can use REST API to set access control list for job clusters. The endpoint is for doing that you can find below/api/2.0/permissions/clusters/{cluster_id}  (https://docs.databricks.com/api/workspace/clusters/setpermissions)And it's n...

  • 1 kudos
3 More Replies
AlbertWang
by Valued Contributor
  • 2237 Views
  • 5 replies
  • 2 kudos

Resolved! Databricks bundle custom variables feature does not work for workspace host

Hi all,I am not sure whether this is a bug. I followed the document.My databricks.yml file: bundle: name: test variables: DATABRICKS_HOST: description: The host of the Databricks workspace. DATABRICKS_JOB_RUNNING_SERVICE_PRINCIPAL_CLIENT_I...

  • 2237 Views
  • 5 replies
  • 2 kudos
Latest Reply
filipniziol
Esteemed Contributor
  • 2 kudos

Hi @AlbertWang ,The documentation states you cannot map workspace host: 

  • 2 kudos
4 More Replies
Janpie
by New Contributor
  • 1088 Views
  • 1 replies
  • 0 kudos

Installation of python module nevergrad with R package reticulate fails

I'm trying to run Robyn in Databricks but it fails since the python module nevergrad fails to install properly using the r package reticulate. This code still worked properly about 1,5 months ago so maybe the issue is on some new update in databricks...

  • 1088 Views
  • 1 replies
  • 0 kudos
Latest Reply
macromill
New Contributor II
  • 0 kudos

My same issue soleve this answer, thank you Kaniz!

  • 0 kudos
6502
by New Contributor III
  • 3847 Views
  • 5 replies
  • 0 kudos

In Shared cluster with unity catalog Python process can't connect

The story is that I can access a service listening on port 80 using a single node cluster, but can't do the same using a shared node cluster. I read about the `spark.databricks.pyspark.iptable.outbound.whitelisted.ports` , however, setting that : `sp...

  • 3847 Views
  • 5 replies
  • 0 kudos
Latest Reply
adriennn
Valued Contributor
  • 0 kudos

@6502 you first need to allow the script in the metastore configuration (navgiate to catalog, on the top of the page there's a small cogwheel, click on your catalog name), then:

  • 0 kudos
4 More Replies
PabloCSD
by Valued Contributor II
  • 1908 Views
  • 1 replies
  • 0 kudos

Resolved! Databricks Asset Bundle deploy a job: Python wheel could not be found

I created a repository for testing DAB, and I'm getting this error: run failed with error message Python wheel with name dab_test_repo could not be found. Please check the driver logs for more details This is my databricks.yml: bundle: name: dab_t...

  • 1908 Views
  • 1 replies
  • 0 kudos
Latest Reply
PabloCSD
Valued Contributor II
  • 0 kudos

Fixed it:Uncommenting out: # libraries: # - whl: ./dist/*.whl 

  • 0 kudos
Behwar
by New Contributor III
  • 3298 Views
  • 1 replies
  • 0 kudos

Databricks Azure Cross-Tenant connection to storage account

I'm currently facing a challenge with establishing a cross-tenant connection between Azure Databricks in Tenant A and a Storage Account in Tenant B. Below is the detailed setup of both tenants:| Tenant A | Tenant B || -------- | -------- || Azure Dat...

  • 3298 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaib
New Contributor II
  • 0 kudos

Have you tried connecting to the storage account from the compute plane itself?I've used this in a notebook to confirm that i can access a storage account over the private endpoint, even when i can't add it as an external data source in the UI.from a...

  • 0 kudos
DenJackson
by New Contributor II
  • 1435 Views
  • 1 replies
  • 1 kudos

Resolved! Can't Link Git and Databricks Community Edition

I am trying to link Git and Databricks but keep running into the error: "Error fetching credentials." I am on the Settings > Linked Accounts tab, and I cannot select anything except the "Retry" button at the bottom of the page, which does not resolve...

  • 1435 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @DenJackson ,Community edition it pretty limite and it seems that the option to integrate repository is disabled. If you need more capabalities you can sign up for 14-day free trial. 

  • 1 kudos
eric-c
by New Contributor
  • 1164 Views
  • 1 replies
  • 0 kudos

Alert ACL's not available

The list of available ACL's for alerts suggests there's a way to set "can run" and "can manage" permissions but neither the REST API nor the Databricks CLI show options for setting permissions. Is there a way to set acl's on alerts? If so, how?Alert ...

  • 1164 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

The API call needed to set the ACLs for an alert and other object types as (alerts | dashboards | data_sources | queries) is:https://docs.databricks.com/api/workspace/dbsqlpermissions/set

  • 0 kudos
Databrixer
by New Contributor II
  • 1608 Views
  • 2 replies
  • 4 kudos

Changes in Databricks rest api

Hi all, Just wanted to ask if there is an announcement regarding changes on Databricks REST API?  Because I had weird experiences in using the REST API. Specifically for Query History API Last Aug 29, 2024. I created a script to pull get request in t...

  • 1608 Views
  • 2 replies
  • 4 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 4 kudos

Yeah, totally agree with you. It should be documented/mentioned somewhere. Or maybe the API should be versioned, so if they introduce a new version, it won't break existing workflows.Anyway, thanks for sharing!

  • 4 kudos
1 More Replies