- 12549 Views
- 2 replies
- 1 kudos
Notebook and folder owner
Hi allWe can use this API https://docs.databricks.com/api/workspace/dbsqlpermissions/transferownership to transfer the ownership of a Query.Is there anything similar for notebooks and folders?
- 12549 Views
- 2 replies
- 1 kudos
- 1 kudos
This api only allows to set permissions based on permission level , which doesn't include changing OWNER. Any suggestions on this particular request.
- 1 kudos
- 909 Views
- 3 replies
- 0 kudos
How to get cost per job which runs on ALL_PURPOSE_COMPUTE ??
with system.billing.usage table i could get cost per jobs which are runs on JOB_COMPUTE but not for jobs which runs on ALL_PURPOSE_COMPUTE.
- 909 Views
- 3 replies
- 0 kudos
- 0 kudos
If nowhere DBU is captured for jobs under ALL_PURPOSE_COMPUTE then cost breakdown-based cluster events is very difficult as more than 2 jobs can parallel. So mapping is very difficult to break down cost for specific job.let me know if I am missing an...
- 0 kudos
- 638 Views
- 1 replies
- 2 kudos
slow cluster start up time up to 30 min gcp
instance type: e2-highmem-2
- 638 Views
- 1 replies
- 2 kudos
- 2 kudos
please use a higher-powered instance type (e.g. n2-highmem-4). The instance type you are currently using (i.e. e2-highmem-2) is significantly underpowered and will result in slower cluster launch times.
- 2 kudos
- 1601 Views
- 4 replies
- 0 kudos
Unity Catalog hive_metastore schemas
Hi all,Apologies if this is the wrong group but I was looking in Unity Catalog and noticed that you have different schemas in the hive_metastore depending on if you select a cluster or if you select a warehouse. Could someone please explain what the ...
- 1601 Views
- 4 replies
- 0 kudos
- 0 kudos
No schemas are directly attached to compute resources, whether it's an all-purpose cluster or a SQL warehouse in serverless mode.
- 0 kudos
- 910 Views
- 1 replies
- 0 kudos
Databricks Workflow/Jobs View Log Permission
If we don't want to expose admin right to user group. What should we do to allow a specific user group to have permission to view all of the job logs in a Databricks account? We don't want to grant job level permission too.Thanks,VC
- 910 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, I guess you can use Databricks API to list jobs and set Can view permission to all jobs.Sample code below: import requestsfrom databricks_cli.sdk import ApiClient, JobsService, PermissionsService# Initialize the API clientapi_client = ApiClient( ...
- 0 kudos
- 989 Views
- 1 replies
- 0 kudos
data ingestion from external system - auth via client certificate
Hi Community,we have the requirement to ingest data in azure databricks from external systems.Our customer ask us to use Client Certificate as authentication method.Requests - https://requests.readthedocs.io/en/latest/user/advanced/Aiohttp - https://...
- 989 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @cuhlmann ,As I understand you need to ingest data into Azure Databricks from external systems, and your customer requires using client certificate authentication. The challenge is that the client certificate is stored in Azure Key Vault, but the ...
- 0 kudos
- 625 Views
- 2 replies
- 1 kudos
Bill for Premium subscription
hi, there, I have subscribed the Premium plan of databricks, How can I get the bills for this subscription? I didn't find it from the account settings. Anyone can help?
- 625 Views
- 2 replies
- 1 kudos
- 1 kudos
AWS https://docs.databricks.com/en/admin/account-settings/account.html Azure https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/account GCP https://docs.gcp.databricks.com/en/admin/account-settings/account.html
- 1 kudos
- 5195 Views
- 4 replies
- 0 kudos
Override default Personal Compute policy using terraform / disable Personal Compute policy
I want to programmatically do some adjustments to the default personal compute resource or preferably create my own custom one based on the same configuration or policy family (in which all users can gain access to) when deploying a new workspace usi...
- 5195 Views
- 4 replies
- 0 kudos
- 0 kudos
Only way I got it working was by importing the pre-existing policy into terraform and do an overwrite as already mentioned by @jsimonovic . The full code example looks like this:import { id = "001BF0AC280610B4" # Polcy ID of the pre-existing person...
- 0 kudos
- 969 Views
- 1 replies
- 1 kudos
Resolved! Retention for hive_metastore tables
HiI have a notebook that creates tables in the hive_metastore with the following code: df.write.format("delta").mode("overwrite").saveAsTable(output_table_name) Which is the retantion for the data saved in the hive metastore? is there any configurati...
- 969 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi mattiagsAs long as you do not delete the data via notebook or in the data lake, it will not be deleted in any other way. This means that there is no retention time in this sense, or conversely, it is infinite until you deliberately delete the data...
- 1 kudos
- 3018 Views
- 3 replies
- 0 kudos
Resolved! Databricks on AWS - Changes to your Unity Catalog storage credentials
Hi Context: On June 30, 2023, AWS updated its IAM role trust policy, which requires updating Unity Catalog storage credentials. Databricks previously sent an email communication to customers in March 2023 on this topic and updated the documentation a...
- 3018 Views
- 3 replies
- 0 kudos
- 0 kudos
Thank you for the response @MoJaMa - we will try it out tomorrow and post an update here.
- 0 kudos
- 3954 Views
- 4 replies
- 1 kudos
Resolved! How to use Databricks CLI as a service principal?
Hi all,I have a question about how to use Databricks CLI on my local environment as a service principal?I have installed Databricks CLI and configured the file `.databrickscfg` as shown below. [DEFAULT] host = https://adb-123123123.1.azuredatabr...
- 3954 Views
- 4 replies
- 1 kudos
- 1 kudos
got you.I found a working solution. Try this one:[devsp] azure_workspace_resource_id = /subscriptions/bc0cd1..././.../Databricks/workspaces/my-workspace azure_tenant_id = bc0cd1... azure_client_id = fa0cd1... azure_client_secr...
- 1 kudos
- 2070 Views
- 4 replies
- 0 kudos
- 2070 Views
- 4 replies
- 0 kudos
- 0 kudos
Thank you so much!! I solve this by reinstalling chrome browser. I got this issue last week and can not solve it even if wait, clear cache, restart..etc. But worked in another type of browser. So I reinstall Chrome browser and it worked. Thank you
- 0 kudos
- 1475 Views
- 4 replies
- 0 kudos
Interface for Databricks CE
My Databricks CE interface does not have the quick guides or toggles for Data Science & Engineering/Machine Learning. this is what it looks like and I want to see the quick guides. 
- 1475 Views
- 4 replies
- 0 kudos
- 2166 Views
- 1 replies
- 0 kudos
Resolved! Docs/Info for metastore, artifact blob storage endpoints etc for Azure Databricks
Hi! This is probably a very newbie type of question and my google skills seems to be lacking but is there any in depth documentation/explanations of the metastore, artifact blob storage, system tables storage, log blob storage and event hubs services...
- 2166 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi,You can check below: System Tables Storage Purpose: System tables storage is used to store system-level metadata and configuration data for the Azure Databricks workspace.Data Stored: This includes metadata related to the Unity Catalog, cluster c...
- 0 kudos
- 3747 Views
- 2 replies
- 3 kudos
Resolved! Databricks Asset Bundles + Artifacts + Poetry
Hello,I've configured the DABs on our project successfully. Moreover, I could switch from setuptools to poetry almost successfully. In the project's databricks.yml I configured it as the documentation suggested, I've just changed the name of the arti...
- 3747 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Fiabane ,Could you first check:Do you see your .whl file in your artifacts folder?Could you try to install the package by running the code in your notebook : %pip install <path to your wheel>As far as I understand you want to have a job ...
- 3 kudos
