- 2161 Views
- 2 replies
- 0 kudos
Resolved! Terraform databricks_grants errors on external_location
We are using terraform to setup Unity Catalog external locations and when using databricks_grants to set permissions on the external locations it throws the following error: Error: cannot create grants: permissions for external_location-test_locatio...
- 2161 Views
- 2 replies
- 0 kudos
- 0 kudos
I figured out my issue... The principal name is case sensitive and if the input value doesn't match the case of the email address or Group Name in the workspace/account it throws that ambiguous error.
- 0 kudos
- 2952 Views
- 0 replies
- 0 kudos
Send formatted html email from email distribution address
Hi, I have created an email distribution list "#MyList@mycompany.com". In the RShiny world I was able to send emails by a) getting the IP of the server I was sending the emails from and b) whitelisting that IP address within my company's SMTP Relay r...
- 2952 Views
- 0 replies
- 0 kudos
- 2982 Views
- 0 replies
- 0 kudos
Databricks Rest APIs CORS Issue
Hello Team,We are currently integrating Databricks Rest APIs into our in-house application for managing access permissions. While testing with curl and Postman, we've successfully accessed certain APIs like listing cluster permission. However, we're ...
- 2982 Views
- 0 replies
- 0 kudos
- 1744 Views
- 4 replies
- 0 kudos
Databricks job with a type "Python wheel" does not work if "Package name" contains dash
HelloI created a databricks job with a type "Python wheel". In the "Package name" field I assigned a python package which contains a dash in its name (see attach). The run of the job failed saying that could not import python package due to dash in t...
- 1744 Views
- 4 replies
- 0 kudos
- 0 kudos
There you can see a complete template project with a python wheel task and modules. Please, follow the instructions for deployment.https://github.com/andre-salvati/databricks-template
- 0 kudos
- 7291 Views
- 2 replies
- 1 kudos
Databricks AWS Secrets Manager access
I have a workspace deployed in AWS and need to read some secrets from AWS Secrets Manager in my notebook. I'm aware that there is no default process similar to Azure Key Vault, however I know that we can try to access it using boto3, but I'm stuck at...
- 7291 Views
- 2 replies
- 1 kudos
- 1 kudos
I have a workspace deployed in AWS and need to read some secrets from AWS Secrets Manager in my notebook. I'm aware that there is no default process similar to Azure Key Vault, however I know that we can try to access it using boto3, but I'm stuck at...
- 1 kudos
- 1460 Views
- 2 replies
- 0 kudos
Defaulting or overriding the cluster policy list order
I have numerous cluster policies varying that varies in sizes (Job - xsmall, Job - small, Job - medium...). However, when I create a new job and create a new job cluster the default policy selected from the drop down menu is on the bigger size. Is th...
- 1460 Views
- 2 replies
- 0 kudos
- 0 kudos
I checked on our sorting, and there does not seem to be any logic in it.They are not sorted by ID or description for sure.
- 0 kudos
- 1952 Views
- 1 replies
- 0 kudos
Monitor and Alert Databricks Resource Utilization and Cost Consumption
We want to build monitoring and Alerting solution for Azure Databricks that should capture Resource Utilization details (like Aggregated CPU%, Memory% etc.) and Cost consumption at the Account Level.We have Unity Catalog Enabled and there are multipl...
- 1952 Views
- 1 replies
- 0 kudos
- 0 kudos
@smehta_0908 Greetings! You can utilize Datadog for monitoring CPU and memory of clusters. https://docs.datadoghq.com/integrations/databricks/?tab=driveronly For Cost consumption at accounts level you can make use of billable usage logs using the Acc...
- 0 kudos
- 1667 Views
- 2 replies
- 0 kudos
Connecting to Azure Databricks deployed using Vnet injection over Public Internet
I'm trying to connect to Azure Databricks (deployed using Vnet injection method) from a 3rd party service running on Azure in the same region. When I try to connect using the Databricks hostname directly in my connection the host name always resolves...
- 1667 Views
- 2 replies
- 0 kudos
- 0 kudos
@arpit thanks for the link and I did review the doc. But it doesn't really say whether it its always required to use an Azure Private Link to connect to databricks deployed with Vnet injection method from a 3rd party service also on deployed on Azure...
- 0 kudos
- 2654 Views
- 0 replies
- 0 kudos
Managing databricks workspace permissions
I need assistance with writing API/Python code to manage a Databricks workspace permissions database(unity catalog). The task involves obtaining a list of workspace details from the account console, which includes various details like Workspace name,...
- 2654 Views
- 0 replies
- 0 kudos
- 6382 Views
- 2 replies
- 0 kudos
Unity Catalog - Lakehouse Federation: Permission to read data from foreign catalogs
I have seup connection "SQL-SV-conn" to SQL Server and based on that connection I have created foreign catalog "FC-SQL-SV".I have granted All permission on CATALOG to developers:Use CatalogUse SchemaSelectBut they can not query table (e.g. by running...
- 6382 Views
- 2 replies
- 0 kudos
- 0 kudos
OK, I have found out the answer in below docummentation:https://learn.microsoft.com/en-us/azure/databricks/query-federation/#limitationsSingle-user access mode is only available for users that own the connection.So when I use e.g. Job Cluster that ru...
- 0 kudos
- 4661 Views
- 0 replies
- 0 kudos
Is it possible to change the Azure storage account of Unity Catalog?
We have unity catalog metastore set up in storage account prod_1. Can we move this to prod_2 storage account and delete prod_1?Also, is it possible to rename the catalogs once they are created?
- 4661 Views
- 0 replies
- 0 kudos
- 4391 Views
- 3 replies
- 2 kudos
Connect to databricks from external non-spark cluster
Hi,I have an app/service on a non-spark kubernetes cluster. Is there a way to access/query a databricks service from my app/service? I see documentations on connectors, particularly on scala which is the code of my app/service. Can I use these connec...
- 4391 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi,I have an app/service on a non-spark kubernetes cluster. Is there a way to access/query a databricks service from my app/service? I see documentations on connectors, particularly on scala which is the code of my app/service. Can I use these connec...
- 2 kudos
- 2081 Views
- 0 replies
- 0 kudos
Databricks deployment and automation tools comparison.
Hello All, As a newcomer to databricks, I am seeking guidance on automation within databricks environments. What are the best best practices for deployment, and how do Terraform, the REST API, and the databricks SDK compare in terms of advantages and...
- 2081 Views
- 0 replies
- 0 kudos
- 669 Views
- 0 replies
- 0 kudos
An user is assigned multiple groups but unable to query a data table
Hi all, I have a user who is enrolled in multiple groups within databricks but she is only able to query one of the query tables based on the original group assigned. For example:Group 1 will only be able to view data where [group] (column) = 'group1...
- 669 Views
- 0 replies
- 0 kudos
- 703 Views
- 1 replies
- 0 kudos
Want to learn more about system tables
Where can I learn more about system tables? Looking for docs or usage stories! Thanks
- 703 Views
- 1 replies
- 0 kudos
- 0 kudos
Please refer to this - https://docs.databricks.com/administration-guide/system-tables/index.html
- 0 kudos