- 11635 Views
- 12 replies
- 35 kudos
Are you part of a Databricks user group in your city/region?
Joining a regional user group is a great way to connect with data and AI professionals near you. These groups bring together practitioners to learn, network, and share real-world experiences — all within your local context. To join a group: Select y...
- 11635 Views
- 12 replies
- 35 kudos
- 35 kudos
@Rishabh_Tiwari appreciate this initiative! I think user groups are the best way to bring together the community as well as to learn, share and grow. I would like to start a local user group in my city since there is none already. Could you please gu...
- 35 kudos
- 909 Views
- 1 replies
- 0 kudos
Prakash Hinduja Geneva (Swiss) fix access denied issues when using DBFS in Databricks Community?
Hello Community, I’m Prakash Hinduja, a financial strategist residing in Geneva, Switzerland (Swiss). My primary focus is on supporting Swiss businesses by crafting tailored financial strategies. These strategies attract global investments and foster...
- 909 Views
- 1 replies
- 0 kudos
- 0 kudos
Helllo @prakashhinduja So the file limit in community edition DBFS limit is 10 GB. Are you trying to upload more than 10 GB?
- 0 kudos
- 5240 Views
- 11 replies
- 4 kudos
Resolved! How to create a widget in SQL with variables?
I want to create a widget in SQL and use it in R later. Below is my code%sqldeclare or replace date1 date = "2025-01-31";declare or replace date2 date ;set var date2=add_months(date1,5); What's the correct syntax of using date2 to create a widget? I ...
- 5240 Views
- 11 replies
- 4 kudos
- 4 kudos
Hi @zc ,Unfortunately, I think in case of sql widgets default value needs to be string literals. So above approach won't work.Regarding your second question about accessing variables decalared in SQL in R cell, you cannot do such a thing. Here's an e...
- 4 kudos
- 2460 Views
- 4 replies
- 12 kudos
Resolved! Want to See More Resolved Posts? Try This Simple Step
In community discussion, it’s common to see a question get a helpful reply, but then the conversation stalls. There is no follow-up, no marked solution, and no real closure. A small but effective way to keep things moving is@mention the person you’re...
- 2460 Views
- 4 replies
- 12 kudos
- 2338 Views
- 5 replies
- 0 kudos
Is Model Registry possible in Databricks Free Edition?
Has anyone registered a Model in Databricks Free Edition? It seems not working or not available in Free Edition.
- 2338 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @xyz999 Have you tried to upgrade to models in Unity Catalog:import mlflowmlflow.set_registry_uri("databricks-uc")
- 0 kudos
- 2425 Views
- 2 replies
- 1 kudos
Resolved! old unwated accounts
I am having trouble removing several accounts that were used for trial purposes. Both AWS and AzureOne of my AWS logins still works; however, when I attempt to manage the account and cancel my "Enterprise Plan" via the Manage Account section, I enco...
- 2425 Views
- 2 replies
- 1 kudos
- 1 kudos
Hello @Thayal! You can refer to this post for detailed steps on deleting a Databricks account: https://community.databricks.com/t5/administration-architecture/delete-databricks-account/td-p/87187 Regarding the error about canceling via the account co...
- 1 kudos
- 3067 Views
- 3 replies
- 0 kudos
Resolved! databricks community edition is unable to sign
i was created a free edition of the databricks but I'm trying to login to the community edition wiht the same email of free edition throwing a error like this; User is not a member of this workspace.Please slove the issue
- 3067 Views
- 3 replies
- 0 kudos
- 0 kudos
Hello @diwakarnayudu! The Community Edition and the Free Edition are separate environments. Since you’ve created an account for the Free Edition, you can access that environment by logging in here: https://www.databricks.com/learn/free-edition.
- 0 kudos
- 1022 Views
- 0 replies
- 0 kudos
ML-based profiling of data skew and bottlenecks on Databricks
Automatically detect skew and pipeline issues using ML profiling Data skew is a persistent performance issue in distributed data pipelines. On platforms like Databricks, skewed partitions can quietly degrade performance, inflate compute costs, and d...
- 1022 Views
- 0 replies
- 0 kudos
- 2512 Views
- 1 replies
- 0 kudos
Terraform error deploying Databricks Asset Bundle
Hi all ,I am deploying a very simple DAB from an Azure DevOps Pipeline with an self hosted agent, there is no error messages but in the Databricks workspace there is nothing deployed and the files of the bundle are uploaded in the workspace. When I p...
- 2512 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @armandovl ,Try pointing your Databricks bundle to a system-installed Terraform binary. In your bundle config file, configure it to use the system’s Terraform instead of the bundled one.Also, ensure the Terraform binary is available in the agent’s...
- 0 kudos
- 8020 Views
- 2 replies
- 1 kudos
Delta table definition - Identity column
Hello,Would anyone know if it is possible to create a delta table using Python that includes a column that is generated by default as identity (identity column for which the value inserted can be manually overriden)?There seems to be a way to create ...
- 8020 Views
- 2 replies
- 1 kudos
- 1 kudos
There is a `generatedByDefaultAs` option now, see https://github.com/delta-io/delta/pull/3404.
- 1 kudos
- 2282 Views
- 2 replies
- 1 kudos
Resolved! Issue with the size of text in my notebook
I am hoping someone might be able to assist as earlier I thought I had an MS word window focused so did Ctrl +I to make something italics. But I had my browser window focused instead, and pressing the above combination seems to have made the text in ...
- 2282 Views
- 2 replies
- 1 kudos
- 1 kudos
Thanks for the quick response. I am think that I may have also had the browser zoomed to 110% for a while and just not realised I had zoomed it in. As looking at my other browser tabs only databricks is zoomed in. Other tabs seem to just be at the de...
- 1 kudos
- 15806 Views
- 3 replies
- 1 kudos
Databricks connect and spark session best practice
Hi all!I am using databricks-connect to develop and test pyspark code pure python (not notebook) files in my local IDE, running on a Databricks cluster. These files are part of a deployment setup with dbx so that they are run as tasks in a workflow.E...
- 15806 Views
- 3 replies
- 1 kudos
- 1 kudos
I personally do something similar by checking an environment variable, the example was for a notebook but should work for a python file as well: import os if not os.environ.get("DATABRICKS_RUNTIME_VERSION"): from databricks.connect import Databr...
- 1 kudos
- 742 Views
- 0 replies
- 0 kudos
Overview of Dario Schiraldi Deutsche Bank Executive
Hello Community, Dario Schiraldi, an executive at Deutsche Bank, is widely recognized for his strategic vision and in-depth expertise in global financial systems. He expert at optimizing financial services and guiding the bank’s international strateg...
- 742 Views
- 0 replies
- 0 kudos
- 3097 Views
- 1 replies
- 1 kudos
Resolved! Accessing views using unitycatalog module
Hi, I'm trying to access to views in my catalog in databricks using unitycatalog open source modulewhen I try to do so I get an error message that indicates this is not possible:cannot be accessed from outside of Databricks Compute Environment due to...
- 3097 Views
- 1 replies
- 1 kudos
- 1 kudos
Here are helpful tips/tricks: Based on the latest Databricks documentation and internal guides, it is currently not possible to grant external access (via open source Unity Catalog APIs or credential vending) to Unity Catalog views (i.e., objects w...
- 1 kudos
- 9679 Views
- 4 replies
- 0 kudos
Unable to create Iceberg tables pointing to data in S3 and run queries against the tables.
I need to to set up Iceberg tables in Databricks environment, but the data resides in an S3 bucket. Then read these tables by running SQL queries.Databricks environment has access to S3. This is done bysetting up the access by mapping the Instance Pr...
- 9679 Views
- 4 replies
- 0 kudos
- 0 kudos
@JohnsonBDSouza , @PujithaKarnati , @Venkat5 ,There are 3 concepts to use Iceberg format in databricks based on recent updates in DAIS 2025.1) Managed Iceberg tables 2) Foreign Iceberg tables 3) Enabling Iceberg reads on delta tables. Please refer be...
- 0 kudos
