- 741 Views
- 2 replies
- 1 kudos
Resolved! old unwated accounts
I am having trouble removing several accounts that were used for trial purposes. Both AWS and AzureOne of my AWS logins still works; however, when I attempt to manage the account and cancel my "Enterprise Plan" via the Manage Account section, I enco...
- 741 Views
- 2 replies
- 1 kudos
- 1 kudos
Hello @Thayal! You can refer to this post for detailed steps on deleting a Databricks account: https://community.databricks.com/t5/administration-architecture/delete-databricks-account/td-p/87187 Regarding the error about canceling via the account co...
- 1 kudos
- 2027 Views
- 3 replies
- 0 kudos
databricks community edition is unable to sign
i was created a free edition of the databricks but I'm trying to login to the community edition wiht the same email of free edition throwing a error like this; User is not a member of this workspace.Please slove the issue
- 2027 Views
- 3 replies
- 0 kudos
- 0 kudos
Hello @diwakarnayudu! The Community Edition and the Free Edition are separate environments. Since you’ve created an account for the Free Edition, you can access that environment by logging in here: https://www.databricks.com/learn/free-edition.
- 0 kudos
- 285 Views
- 0 replies
- 0 kudos
ML-based profiling of data skew and bottlenecks on Databricks
Automatically detect skew and pipeline issues using ML profiling Data skew is a persistent performance issue in distributed data pipelines. On platforms like Databricks, skewed partitions can quietly degrade performance, inflate compute costs, and d...
- 285 Views
- 0 replies
- 0 kudos
- 404 Views
- 1 replies
- 0 kudos
Terraform error deploying Databricks Asset Bundle
Hi all ,I am deploying a very simple DAB from an Azure DevOps Pipeline with an self hosted agent, there is no error messages but in the Databricks workspace there is nothing deployed and the files of the bundle are uploaded in the workspace. When I p...
- 404 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @armandovl ,Try pointing your Databricks bundle to a system-installed Terraform binary. In your bundle config file, configure it to use the system’s Terraform instead of the bundled one.Also, ensure the Terraform binary is available in the agent’s...
- 0 kudos
- 6039 Views
- 2 replies
- 1 kudos
Delta table definition - Identity column
Hello,Would anyone know if it is possible to create a delta table using Python that includes a column that is generated by default as identity (identity column for which the value inserted can be manually overriden)?There seems to be a way to create ...
- 6039 Views
- 2 replies
- 1 kudos
- 1 kudos
There is a `generatedByDefaultAs` option now, see https://github.com/delta-io/delta/pull/3404.
- 1 kudos
- 457 Views
- 2 replies
- 1 kudos
Resolved! Issue with the size of text in my notebook
I am hoping someone might be able to assist as earlier I thought I had an MS word window focused so did Ctrl +I to make something italics. But I had my browser window focused instead, and pressing the above combination seems to have made the text in ...
- 457 Views
- 2 replies
- 1 kudos
- 1 kudos
Thanks for the quick response. I am think that I may have also had the browser zoomed to 110% for a while and just not realised I had zoomed it in. As looking at my other browser tabs only databricks is zoomed in. Other tabs seem to just be at the de...
- 1 kudos
- 10342 Views
- 3 replies
- 1 kudos
Databricks connect and spark session best practice
Hi all!I am using databricks-connect to develop and test pyspark code pure python (not notebook) files in my local IDE, running on a Databricks cluster. These files are part of a deployment setup with dbx so that they are run as tasks in a workflow.E...
- 10342 Views
- 3 replies
- 1 kudos
- 1 kudos
I personally do something similar by checking an environment variable, the example was for a notebook but should work for a python file as well: import os if not os.environ.get("DATABRICKS_RUNTIME_VERSION"): from databricks.connect import Databr...
- 1 kudos
- 564 Views
- 1 replies
- 0 kudos
Resolved! How Important is High-Quality Data Annotation in Training ML Models?
I've been exploring the foundations of building robust AI/ML systems, and I keep circling back to one crucial element — data annotation. No matter how advanced our models are, the quality of labeled data directly impacts the accuracy and performance ...
- 564 Views
- 1 replies
- 0 kudos
- 0 kudos
Ensuring annotation quality at scale is always a challenge! Here’s what’s worked for my teams:Clear guidelines: We invest time in detailed instructions and regular annotator training to avoid ambiguity.Hybrid approach: We use automated tools for high...
- 0 kudos
- 353 Views
- 0 replies
- 0 kudos
Overview of Dario Schiraldi Deutsche Bank Executive
Hello Community, Dario Schiraldi, an executive at Deutsche Bank, is widely recognized for his strategic vision and in-depth expertise in global financial systems. He expert at optimizing financial services and guiding the bank’s international strateg...
- 353 Views
- 0 replies
- 0 kudos
- 10544 Views
- 15 replies
- 3 kudos
Is it possible to view Databricks cluster metrics using REST API
I am looking for some help on getting databricks cluster metrics such as memory utilization, CPU utilization, memory swap utilization, free file system using REST API.I am trying it in postman using databricks token and with my Service Principal bear...
- 10544 Views
- 15 replies
- 3 kudos
- 884 Views
- 1 replies
- 0 kudos
Databricks workspace in failed state
Hi Community,I had my Databricks workspace up and running and it was managed through terraform, and encryption was enabled through cmk, there were some updation in the code, so I put terraform plan, one of the key changes(replace) it showed me was"az...
- 884 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @sumitkuma49 ,Did you try what the error is suggesting? You could try re-creating the workspace. Once the workspace is created, set up the necessary Key Vault access policies or role assignments. After confirming the permissions are in place, upda...
- 0 kudos
- 339 Views
- 1 replies
- 1 kudos
Resolved! Accessing views using unitycatalog module
Hi, I'm trying to access to views in my catalog in databricks using unitycatalog open source modulewhen I try to do so I get an error message that indicates this is not possible:cannot be accessed from outside of Databricks Compute Environment due to...
- 339 Views
- 1 replies
- 1 kudos
- 1 kudos
Here are helpful tips/tricks: Based on the latest Databricks documentation and internal guides, it is currently not possible to grant external access (via open source Unity Catalog APIs or credential vending) to Unity Catalog views (i.e., objects w...
- 1 kudos
- 6206 Views
- 4 replies
- 0 kudos
Unable to create Iceberg tables pointing to data in S3 and run queries against the tables.
I need to to set up Iceberg tables in Databricks environment, but the data resides in an S3 bucket. Then read these tables by running SQL queries.Databricks environment has access to S3. This is done bysetting up the access by mapping the Instance Pr...
- 6206 Views
- 4 replies
- 0 kudos
- 0 kudos
@JohnsonBDSouza , @PujithaKarnati , @Venkat5 ,There are 3 concepts to use Iceberg format in databricks based on recent updates in DAIS 2025.1) Managed Iceberg tables 2) Foreign Iceberg tables 3) Enabling Iceberg reads on delta tables. Please refer be...
- 0 kudos
- 2938 Views
- 1 replies
- 0 kudos
How to search on empty string on text filter with Lakeview Dashboards
Hi,I have created a lakeview dashboard with a couple of filters and a table. Now I would like to search if a certain filter (column) has an empty string but if I search for ' ' then it goes 'no data'. I am wondering how can I search for an empty stri...
- 2938 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi! Could you get a resolution for this problem ?
- 0 kudos
- 17519 Views
- 6 replies
- 1 kudos
Installed Library / Module not found through Databricks connect LST 12.2
Hi all,We recently upgraded our databricks compute cluster from runtime version 10.4 LST, to 12.2 LST.After the upgrade one of our python scripts suddenly fails with a module not found error; indicating that our customly created module "xml_parser" i...
- 17519 Views
- 6 replies
- 1 kudos
- 1 kudos
Hi @maartenvr , hi @Debayan ,Are there any updates on this? Have you found a solution, or can the problem at least be narrowed down to specific DBR versions? I am on a cluster with 11.3 LTS and deploy my custom packaged code (named simply 'src') as P...
- 1 kudos
