- 2110 Views
- 1 replies
- 0 kudos
local filesystem access is forbidden
Hi,When i running this command over my private cluster (Single User) it works well :dbutils.fs.cp(ituff_file, protocol_local_file_path) When i try to run it over a shared cluster, i am getting : java.lang.SecurityException: Cannot use com.databricks....
- 2110 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Could you please refer to the limitations here: https://docs.databricks.com/en/compute/access-mode-limitations.html#shared-access-mode-limitations-on-unity-catalog (Volumes do not support dbutils.fs commands distributed to executors.) , Also, fo...
- 0 kudos
- 1427 Views
- 0 replies
- 0 kudos
Py4JSecurityException for file access in azure data storage - seeking help
I am trying to access a file in azure data storage using databricks in python. when i access I am getting py4SecurityException (py4j.security.Py4JSecurityException: Method public com.databricks.backend.daemon.dbutils.DBUtilsCore$Result com.databricks...
- 1427 Views
- 0 replies
- 0 kudos
- 3290 Views
- 1 replies
- 0 kudos
How to update a value in a column in a delta table with Map of Struct datatype?
I have a delta table in Databricks named "prod.silver.control_table". It has a few columns including "table_name" with string data type and "transform_options" with the below structure: |-- transform_options: map (nullable = true) | |-- key: str...
- 3290 Views
- 1 replies
- 0 kudos
- 0 kudos
I have a delta table in Databricks named "prod.silver.control_table". It has a few columns including "table_name" with string data type and "transform_options" with the below structure: |-- transform_options: map (nullable = true) | |-- key: str...
- 0 kudos
- 1406 Views
- 0 replies
- 0 kudos
Unable to login to Databricks Community edition
I signed up to Databricks Community Edition with gmail and verified my account and used it to create a notebook as well but having issue in re-logging in even though email and password provided are correct. I did try "Forget Password" step but I am...
- 1406 Views
- 0 replies
- 0 kudos
- 2473 Views
- 3 replies
- 0 kudos
Unable to login to community edition
Hello there,I have successfully created a databricks account and went to login to the community edition with the exact same login credentials as my account, but it tells me that the email/password are invalid. I can login with these same exact creden...
- 2473 Views
- 3 replies
- 0 kudos
- 0 kudos
Databricks Community Edition and Databricks are separate services. You have to create an account specific to community.
- 0 kudos
- 691 Views
- 1 replies
- 0 kudos
Is it possible to create a scratchpad ui?
https://jupyter-contrib-nbextensions.readthedocs.io/en/latest/nbextensions/scratchpad/README.htmlIs something like this available on Databrick's notebooks ui?
- 691 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, it would be great if you can submit the idea on this and the progress can be tracked by the ideas portal. https://docs.databricks.com/en/resources/ideas.html
- 0 kudos
- 1607 Views
- 1 replies
- 1 kudos
Generated Access Token is deleted/Expired after lifetime 90 days? How to use old token now?
Hello Team,I have generated a new token via Admin Settings --> Developer --> Access Token -- > Manage.Now my token is deleted/Expired after 90 days. I know what is my token and generated alphanumeric one.Now how can i set or reuse the same token in d...
- 1607 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi, To change the default lifetime of 90 days ,you can leave the Lifetime (days) box empty (blank). Refer: https://docs.databricks.com/en/dev-tools/auth/pat.html#databricks-personal-access-tokens-for-workspace-users
- 1 kudos
- 6382 Views
- 1 replies
- 0 kudos
Exciting Announcement: Launch of New Course - Data Analysis with Databricks!
Welcome to the world of Data Analysis with Databricks! We are thrilled to introduce our latest course, providing a comprehensive journey into data analysis on the Databricks platform. Whether you're a beginner or looking to enhance your skills, this...
- 6382 Views
- 1 replies
- 0 kudos
- 0 kudos
is this course made available in Home - Databricks Learning?
- 0 kudos
- 1520 Views
- 0 replies
- 0 kudos
Unable to list a folder with square bracket in name
I am trying to iterate over a container(adls gen2) in azure databricks using pyspark. basically I am using dbutils.fs.ls to list the contents for folder using recursive function.this logic works perfectly fine for all folder except for the folders eh...
- 1520 Views
- 0 replies
- 0 kudos
- 2921 Views
- 3 replies
- 0 kudos
Resolved! Meta Question: Databricks Community Posting Issue
Can someone please tell me what "errors" I need to correct to post???
- 2921 Views
- 3 replies
- 0 kudos
- 0 kudos
Yeah, it worked. I'll need to use the "code sample" more going forward!
- 0 kudos
- 1481 Views
- 1 replies
- 1 kudos
Azure devops pipeline throwing databricks provider bug when trying to read the metastore
Hi I created Terraform script to add the existing workspace to exisitng unity catlaog by reading the metastore id . When i created pipleina nd tried to use it . This is failing with below error.Planning failed. Terraform encountered an error while ge...
- 1481 Views
- 1 replies
- 1 kudos
- 1 kudos
Please can anyone provide help me on this ?
- 1 kudos
- 1138 Views
- 1 replies
- 1 kudos
Failed to create Cluster on GCP
I am getting following error while trying to create a Cluster for my Workspace Cluster creation failed: Constraint constraints/compute.disableSerialPortLogging violated for projectCloud ENV is GCP and we can't turn off the constraint mentioned above....
- 1138 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi, Haven't found any solution so far. What I hoping for is to create a cluster in a way it doesn't require SerialPortLogging so that the Policy Constraint we have e.g. disableSerialPortLogging doesn't come in the way. Not sure how can we do that. Ma...
- 1 kudos
- 7578 Views
- 9 replies
- 1 kudos
Resolved! Terraform databricks_storage_credential has wrong External ID
We create storage credentials using Terraform. I don't see any way to specify a given External ID (DBR Account ID) when creating the credentials via Terraform or in the web UI console. However, today when I tried creating a new set of credentials usi...
- 7578 Views
- 9 replies
- 1 kudos
- 1 kudos
I tried the proposed solution using an account provider like this provider "databricks" { account_id = "ACCOUNT_ID" host = "https://accounts.cloud.databricks.com" } for creating the storage credential. However, that did not work. I got an e...
- 1 kudos
- 2814 Views
- 1 replies
- 2 kudos
Built-In Governance for Your Databricks Workspace
Databricks Unity Catalog simplifies data and AI governance by providing a unified solution for organizations to securely discover, access, monitor, and collaborate on a range of data and AI assets. This includes tables, ML models, files and functions...
- 2814 Views
- 1 replies
- 2 kudos
- 2 kudos
Thank you for sharing this @Sujitha
- 2 kudos
- 1510 Views
- 1 replies
- 1 kudos
DLT Medallion Incremental Ingestion Pattern Approach
Hi there, I have a question regarding what would be the "recommended" incremental ingestion approach using DLT to pull raw landing data into bronze and then silver? The original approach I've been considering is to have raw CSV files arrive in a land...
- 1510 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi there, I have a question regarding what would be the "recommended" incremental ingestion approach using DLT to pull raw landing data into bronze and then silver? The original approach I've been considering is to have raw CSV files arrive in a land...
- 1 kudos
