- 1340 Views
- 1 replies
- 0 kudos
Can I edit the ADLSg2 storage location for a schema?
I want to alter the schema and basically point it to a new path in the data lake #UnityCatalog
- 1340 Views
- 1 replies
- 0 kudos
- 0 kudos
don't think so.You can alter the owner and dbproperties using the alter schema command, but not the location.https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-alter-schema
- 0 kudos
- 3488 Views
- 0 replies
- 0 kudos
Struggling with UC Volume Paths
I am trying to setup my volumes and give them paths in the data lake but I keep getting this message:Input path url 'abfss://my-container@my-storage-account.dfs.core.windows.net/' overlaps with managed storage within 'CreateVolume' callThere WAS some...
- 3488 Views
- 0 replies
- 0 kudos
- 4266 Views
- 0 replies
- 0 kudos
Error: cannot create permissions: invalid character '<' looking for beginning of value
I'm trying to use terraform to assign a cluster policy to an account-level group (sync'd from AAD via SCIM)My provider is configured like thisprovider "databricks" {alias = "azure_account"host = "accounts.azuredatabricks.net"account_id = "%DATABRICKS...
- 4266 Views
- 0 replies
- 0 kudos
- 9252 Views
- 0 replies
- 0 kudos
[Possible Bug] Repo Notebooks being modified without human interaction
Our production workspace has several Repos integrated with GitHub. These repos aways point to master and should never be modified manually by a human directly in the workspace as the pulls are triggered by a GitHub Actions workflow. This workflow cal...
- 9252 Views
- 0 replies
- 0 kudos
- 3812 Views
- 1 replies
- 1 kudos
Resolved! Terraform Repos Git URL Allow List
Hi,I am provisioning databricks workspaces using terraform and want to add specific github repo url that can be used. In UI there is an option for that but when it comes to terraform there is nothing specific. I came across custom_config option here ...
- 3812 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello,This can normally be achieved using this terraform resource:resource "databricks_workspace_conf" "this" { custom_config = { "enableProjectsAllowList": true, "projectsAllowList": "url1,url2,url3", } }Cheers
- 1 kudos
- 9271 Views
- 0 replies
- 0 kudos
Databricks workspace in our own VNET
We have setup a Databricks workspace in our own Azure VNET, including a private endpoint. Connecting to the WS works fine (through the private ip address). However, when creating my first cluster, I run into this problem:"ADD_NODES_FAILED...Failed to...
- 9271 Views
- 0 replies
- 0 kudos
- 1152 Views
- 0 replies
- 0 kudos
Data Marketplace private exchange
I want to use Data Markerplace but only as private / local mode, so don't want to publish any products outside my organization.I know I can create private listing , but it can be done only from provider console.I'm added to marketplace role but not s...
- 1152 Views
- 0 replies
- 0 kudos
- 6684 Views
- 1 replies
- 2 kudos
Assigning Databricks Account Admin role to User group
At my current organization, we have a few users with the Databricks Account admin role assigned. But as per our company policy, individual users should not be given such elevated privileges. They should be given to user groups so that users in those ...
- 6684 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi Kaniz,Thank you for the feedback and I was able to find below solution from the article you have mentioned.https://docs.databricks.com/en/administration-guide/users-groups/groups.html#assign-account-admin-roles-to-a-groupSeems we can use Databrick...
- 2 kudos
- 1943 Views
- 2 replies
- 1 kudos
Global search programatically
Hi!At the workspace header, there is a search box that allow us to look for a text in all notebooks in the workspace. Is there a way via CLI or API to call the global search https://<workspace-domain>/graphql/SearchGql so the result can be analysed a...
- 1943 Views
- 2 replies
- 1 kudos
- 1 kudos
if you checked in the notebooks into a git repo, the search in the git repo (or API) might save you.
- 1 kudos
- 2420 Views
- 1 replies
- 1 kudos
Resolved! REST API workspace list content doesn't work with Queries
Hi, I'm trying to export the SQL Queries in certain folders in workspace, but the list content API callGET /api/2.0/workspace/list doesnt work with queries? how should I export only queries in a certain folder in workspace? Thank you very much
- 2420 Views
- 1 replies
- 1 kudos
- 1 kudos
@Xyguo - Currently, exporting a SQL query file is not supported. Kindly create an idea feature request by following the article listed - https://docs.databricks.com/en/resources/ideas.html#create-an-idea-in-the-ideas-portal to raise a feature reques...
- 1 kudos
- 8816 Views
- 2 replies
- 1 kudos
Resolved! Multiple orphan vms in managed resource group after starting and terminating my personal cluster
Hi today, i had problem with starting the cluster and therefore i did multiple times star and terminating. The problem is that this actions always started one new VM in the managed resource group but never turned it off. Therefore i ended up with mul...
- 8816 Views
- 2 replies
- 1 kudos
- 1 kudos
It always takes a few minutes, even 10, before the machine is terminated in Azure. It is better to set a pool of machines in data bricks and use them from there so we will not be keeping Zombie machines.
- 1 kudos
- 3216 Views
- 0 replies
- 1 kudos
Databricks Enhances Job Monitoring with Duration Thresholds for Workflow
Databricks has introduced Duration Thresholds for workflows. This new addition allows users to set time limits for workflow execution, significantly improving monitoring of job performance. When a job exceeds the preset duration, the system triggers ...
- 3216 Views
- 0 replies
- 1 kudos
- 988 Views
- 0 replies
- 0 kudos
Multi bronze layers : multi client data
data coming in from multiple sources belonging to multiple customers.Should I create Single storage account name it bronze and then separate containers for each client's data to be put in.And then merge the data in the silver layer. What's the best p...
- 988 Views
- 0 replies
- 0 kudos
- 6902 Views
- 1 replies
- 0 kudos
Resolved! Can't set account admin using Terraform
I want to set the account admin for a service principal in order to create the Unity Catalog metastore. The Terraform code looks like this: data "databricks_service_principal" "application" { count = var.environment == "dev" ? 1 : 0 application_...
- 6902 Views
- 1 replies
- 0 kudos
- 6224 Views
- 2 replies
- 0 kudos
INVALID_PARAMETER_VALUE.LOCATION_OVERLAP: overlaps with managed storage error with S3 paths
We're trying to read from an S3 bucket using unity catalog and are selectively getting "INVALID_PARAMETER_VALUE.LOCATION_OVERLAP: overlaps with managed storage error" errors within the same bucket. This works: "dbutils.fs.ls("s3://BUCKETNAME/dev/he...
- 6224 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi,Could you please elaborate on the issue here? Running the list command on a managed directory is not supported in Unity Catalog. Catalog/schema storage locations are reserved for managed storage.Please tag @Debayan with your next comment which wi...
- 0 kudos
