- 3257 Views
- 2 replies
- 0 kudos
INVALID_PARAMETER_VALUE.LOCATION_OVERLAP: overlaps with managed storage error with S3 paths
We're trying to read from an S3 bucket using unity catalog and are selectively getting "INVALID_PARAMETER_VALUE.LOCATION_OVERLAP: overlaps with managed storage error" errors within the same bucket. This works: "dbutils.fs.ls("s3://BUCKETNAME/dev/he...
- 3257 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi,Could you please elaborate on the issue here? Running the list command on a managed directory is not supported in Unity Catalog. Catalog/schema storage locations are reserved for managed storage.Please tag @Debayan with your next comment which wi...
- 0 kudos
- 1472 Views
- 1 replies
- 0 kudos
Bitbucket Repo Add Assistance
I am trying to add a Bitbucket cloud repo to my workspace, but keep getting a credentials invalid error. I made sure to set a username and generate an app password with repo read write permissions. What am i doing wrong?
- 1472 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello,Did you also set the password in User Settings > Git integration ? If so can you paste the full error?
- 0 kudos
- 718 Views
- 0 replies
- 0 kudos
An user is assigned multiple groups but unable to query a data table
Hi all, I have a user who is enrolled in multiple groups within databricks but she is only able to query one of the query tables based on the original group assigned. For example:Group 1 will only be able to view data where [group] (column) = 'group1...
- 718 Views
- 0 replies
- 0 kudos
- 3032 Views
- 1 replies
- 1 kudos
Resolved! OIDC account-level SSO and SAML workspace-level SSO
Hey folks! I am seeking clarity for this passage in documentation: "This means that SSO for your account and SSO for each workspace must be managed separately. You should configure SSO to the the same identity provider at the account and on your work...
- 3032 Views
- 1 replies
- 1 kudos
- 1 kudos
If both are pointing to the same IDP then it should not be a problem.
- 1 kudos
- 3065 Views
- 5 replies
- 0 kudos
How to hide workspace to which I don't have access anymore?
In my Account Console and workspace selector I'm seeing a list of 10 workspaces, but to half of them I don't have access anymore (as intended). How can I remove these workspaces which have become irrelevant for me from this view?
- 3065 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @FrankBarten Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too. Cheers!
- 0 kudos
- 2187 Views
- 1 replies
- 4 kudos
Metrics are the lifeblood of every business. They help measure performance, track progress, and optimize decision-making. Unfortunately, however, most...
Metrics are the lifeblood of every business. They help measure performance, track progress, and optimize decision-making. Unfortunately, however, most projects' metrics are buried in code and scattered across different tools and platforms. This makes...
- 2187 Views
- 1 replies
- 4 kudos
- 4 kudos
Thanks for sharing your knowledge with Community.
- 4 kudos
- 2751 Views
- 1 replies
- 0 kudos
Connection Error
I am getting this type of erro "com.databricks.spark.sqldw.SqlDWConnectorException: Exception encountered in Azure Synapse Analytics connector code" while loading the data into Synapse. I am able to load other tables with the same connection. Not sur...
- 2751 Views
- 1 replies
- 0 kudos
- 0 kudos
The error message you provided indicates that an exception occurred in the Azure Synapse Analytics connector code while loading data into Synapse. This can happen due to various reasons, such as issues with the table structure, data type compatibilit...
- 0 kudos
- 760 Views
- 1 replies
- 0 kudos
Want to learn more about system tables
Where can I learn more about system tables? Looking for docs or usage stories! Thanks
- 760 Views
- 1 replies
- 0 kudos
- 0 kudos
Please refer to this - https://docs.databricks.com/administration-guide/system-tables/index.html
- 0 kudos
- 1175 Views
- 1 replies
- 0 kudos
Can I use Databricks as a Backend?
Hi, I am new to Databricks and I am exploring its CE. I have data science background and I am building an analytics webapp, instead of connecting to Supabase or other back-end services, is it possible for me to connect to Databricks directly? I could...
- 1175 Views
- 1 replies
- 0 kudos
- 0 kudos
How about the Databricks REST API? DB offers a comprehensive REST API that allows you to programmatically interact with Databricks resources. You can use this API to submit jobs, run queries, manage clusters, and perform various other operations.
- 0 kudos
- 702 Views
- 1 replies
- 0 kudos
Single Sign On with Duo - Redirect Error
Hi,Has anybody tried using Duo for SSO (Single Sign On)?We used OIDC on Duo, and getting this error when we test. Basically, after we get authenticated by Duo, the redirect page shows up like this:Any tips would be greatly appreciated. Thanks!
- 702 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @yubin-apollo We are reaching out to inform you that Databricks Community has migrated to a new service provider. As a result, all users and published content are migrated on June 24, 2023.This change will enhance your overall Databricks Community...
- 0 kudos
- 8212 Views
- 2 replies
- 0 kudos
Strategy for Unity Catalog migration
Hi, I am looking for a way to better migrate our workspace to Unity Catalog. We have several tables created as external tables and created using mount points, but I am worried that migrating to unity catalog will break those tables if we migrate usin...
- 8212 Views
- 2 replies
- 0 kudos
- 0 kudos
@Rodrigo_Mohr you need to mainly consider below things1. Number of managed tables2. Number of external tablesin case external tables upgrade tool will help which is built in with UC, where as for managed you need to either go CTAS/Deep clone. but we ...
- 0 kudos
- 1392 Views
- 2 replies
- 0 kudos
Best practice to use s3 gateway with VPC
The company is getting a high expensive cost in data traffic after setting up the VPC, now we notice that we have to set up a s3 gateway, I wonder what is the best practices
- 1392 Views
- 2 replies
- 0 kudos
- 0 kudos
@Ayun In terms of s3 gateway wrt to aws that looks promising in terms of price, but i have not seen anything related to s3 gateway mentioned in databricks articles. for most of implementations we went with standard approach that databricks mentioned....
- 0 kudos
- 3681 Views
- 1 replies
- 0 kudos
Resolved! Issue with Enabling Unity Catalog in Workspace
I hope this message finds you all well.I followed the necessary steps to enable the Unity Catalog in our workspace.However, upon saving the configuration, I noticed that the Unity Catalog feature is automatically being disabled.I have double-checked ...
- 3681 Views
- 1 replies
- 0 kudos
- 0 kudos
@msserpa where you are enabling this config please, usually if you add workspace in data--> metastore--> workspace , then you should not get any issue
- 0 kudos
- 969 Views
- 1 replies
- 1 kudos
Restrict access to Hive Metastore in environments
Hi, We have issues with users creating tables and storing data in hive metastore in environments with UC. How to you restrict this access?
- 969 Views
- 1 replies
- 1 kudos
- 1 kudos
@JohannaAK please restrict users in catalog level, by only providing select operation, looks all permissions are enabled for users
- 1 kudos
- 399 Views
- 0 replies
- 0 kudos
API to access query data plan
I'm working on a tool to visualise who accessed which (unity) catalogs, schemas and tables. To do that, I would like to access the query plan of the queries in the query history. Unfortunately, It seems like the REST api doesn't support accessing tho...
- 399 Views
- 0 replies
- 0 kudos
