- 2426 Views
- 5 replies
- 2 kudos
Resolved! Run failed with error message Unexpected failure while waiting for the cluster
Hi All, Recently all of my databricks jobs are failing due to error:Run failed with error message Unexpected failure while waiting for the cluster (xxxx-xxxxxx-xxxxxxxx) to be ready: Cluster '(xxxx-xxxxxx-xxxxxxxx) is unhealthy.it was all running til...
- 2426 Views
- 5 replies
- 2 kudos
- 2 kudos
My bad , just a silly thing to miss out. Really appreciate your help @SP_6721
- 2 kudos
- 1603 Views
- 1 replies
- 0 kudos
Concurrency in replaceWhere()
Hi Databricks team I had a quick question and would appreciate your guidance. Let’s say I have a Delta table (not partitioned), and I'm using the overwrite mode along with the replaceWhere clause to overwrite data for city = 'LA' and city = 'NY' in t...
- 1603 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @arnavsood ,As per my understanding, even if parallel jobs are using overwrite with replaceWhere to update different rows, file-level conflicts can still occur. That’s because Delta Lake doesn’t provide row-level concurrency by default.Row-level c...
- 0 kudos
- 2751 Views
- 5 replies
- 3 kudos
Resolved! Is it Possible to Install Python Libraries or any Python Wheels on the New Databricks Free Account
Hi Community,I have been informed that it's not possible to install either Python libraries, Python wheels or MAVEN libraries on the new Databricks Free account - It is possible with the old Databrick Community EditionCan someone please confirm that ...
- 2751 Views
- 5 replies
- 3 kudos
- 4588 Views
- 3 replies
- 6 kudos
Resolved! re: dbfs on free edition
Thank you very much for the new free edition.I have a question related to dbfs.Am I to understand that dbfs is disabled in this edition and one needs to bring their own storage. I tried this and failed. What do I need to do in order to be able to use...
- 4588 Views
- 3 replies
- 6 kudos
- 6 kudos
Many thanks, I just realized after creating the post through resource
- 6 kudos
- 2092 Views
- 1 replies
- 0 kudos
Resolved! Licenses Required for a demo.
Our team is looking for 90 day period licenses to integrate Databricks ai functions for a demo. Could you please let us know the procedure to procure them ASAP ?
- 2092 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Mohit787! Please contact Help@databricks.com. The support team will be able to guide you through the next steps.
- 0 kudos
- 2575 Views
- 2 replies
- 1 kudos
Resolved! Community (Legacy) Edition Question
Hello,I have been teaching my Data Warehousing class using the Databricks Community Edition. With the change to the Databricks Free Edition, there are many aspects of my Community Edition notebooks that no longer work in the free Edition. Is there ...
- 2575 Views
- 2 replies
- 1 kudos
- 1 kudos
Hello @OU_Professor! Access to existing Community Edition accounts will remain available for the rest of the year. However, please note that new users attempting to sign up for Community Edition are now redirected to the Free Edition instead.
- 1 kudos
- 5176 Views
- 7 replies
- 10 kudos
Resolved! How can I import multiple Files (stored locally) into Databricks Tables
First of all, Hello Everyone!This is my first post on here. For the past few months, I have been working on my personal Microsoft Azure Blog, that includes some Azure Databricks user guides. Sadly, as I am currently searching for work (that is rathe...
- 5176 Views
- 7 replies
- 10 kudos
- 10 kudos
@giuseppe_esq personally, I'd love to get the Azure certs! I'll definitely be following the blog. Thanks a bunch for linking that . I'm also learning Databricks so do keep in touch. To answer this question:Awesome, thanks again. Sorry if I sound clu...
- 10 kudos
- 1559 Views
- 2 replies
- 3 kudos
Merge issue with column mask delta tables
Facing issue when doing merge of dataframe to delta table which has mask applied on two of the columns.Code DeltaTable.forName(sparkSession=spark,tableOrViewName=f'{catalog}.{schema}.{table_name}').alias('target').merge( new_df.alias('updates'), ...
- 1559 Views
- 2 replies
- 3 kudos
- 3 kudos
It looks like Delta Lake APIs (i.e. DeltaTable... ) are not supported with Row filters and column masks.Please see limitations: https://docs.databricks.com/aws/en/tables/row-and-column-filters#limitations
- 3 kudos
- 944 Views
- 2 replies
- 1 kudos
Need Help Signing up for Databricks via Google Cloud
I have purchased Databricks via Google Cloud but my order is still pending. I emailed support and they mentioned that it is pending because "You have not purchased any of the support contracts (business, enhanced, or production support) to move the c...
- 944 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @amartinez4, based on your requirement, why don't you sign up for the new Databricks Free Edition?https://www.databricks.com/blog/introducing-databricks-free-edition If you'd rather work with the trial version, can you let us know if you've had an...
- 1 kudos
- 2941 Views
- 4 replies
- 2 kudos
Resolved! can load/read file in databricks free edition(which is all new edition replacing community edition)
FL_DATAFRAME = spark.read.format("csv")\ .option("header", "false")\ .option("inferschema", "false")\ .opt...
- 2941 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @na_ra_7 ,In Free Edition dbfs is disabled. I doubt that above approach will work. But you should use Unity Catalog for that purpose anyway. DBFS is depracated pattern of interacting with storage.So, to use volume perform following steps:Go to Cat...
- 2 kudos
- 1574 Views
- 1 replies
- 0 kudos
Resolved! Not able to login
I’m encountering an issue when trying to log in—I'm receiving the error shown below. Previously, I was able to log in, but I noticed that none of my notebooks were appearing in the workspace.Could you please look into this and assist?You are not a me...
- 1574 Views
- 1 replies
- 0 kudos
- 0 kudos
HI @jayeshkadam_98 , If it is organization account and your access is removed from workspace, then there is a chance that you will be facing this issue. Please reach out to your organization databricks admin to help you with the same to check your us...
- 0 kudos
- 2259 Views
- 3 replies
- 3 kudos
Resolved! Databricks community edition login issues with Azure portal login
Hi, I used to log in with Azure Databricks using my Azure portal username (email). I used the same email to sign up for Hi, and I used it to log in to Azure Databricks through my Azure portal username (email). I used the same email to sign up for the...
- 2259 Views
- 3 replies
- 3 kudos
- 3 kudos
Translator That's awesome, Sridhar. Sorry I missed out on reading this.
- 3 kudos
- 1592 Views
- 4 replies
- 3 kudos
*Urgent**** -Unable to login to Account console----Couln't able to do Project work
I have created a free trial subscription for DatabricksI'm unable to login to account console of databricks . Please find the attached error image . please give me the account console access so that I can implement unity catalog . I’ve logged in with...
- 1592 Views
- 4 replies
- 3 kudos
- 3 kudos
Hey @Dataenginerring it suggests the issue might be on the Microsoft/tenancy side.Could you try connecting to databricks with another browser, or through incognito on chrome?
- 3 kudos
- 1748 Views
- 1 replies
- 0 kudos
Resolved! Enable Azure Private Link back-end and front-end connections - Azure Databricks
Hi Team,Can any help me to configure data bricks in azure
- 1748 Views
- 1 replies
- 0 kudos
- 0 kudos
@legendworker Sign Up for Azure Databricks:If you do not have an Azure Databricks account, you can sign up for a free trial to get started.Set Up Your Databricks Workspace:After signing up, you need to set up your Databricks workspace. This involves ...
- 0 kudos
- 5993 Views
- 7 replies
- 1 kudos
Resolved! %run "./Includes/Classroom-Setup"
04-Working-With-Dataframes > Describe a DataFrameCode:%python%run "./Includes/Classroom-Setup" Output:/databricks/python/lib/python3.11/site-packages/IPython/core/interactiveshell.py:2870: UserWarning: Could not open file </Workspace/Users/**********...
- 5993 Views
- 7 replies
- 1 kudos
- 1 kudos
Those scripts do not work in Community Edition. When you take our training, and we supply notebooks with demos and labs those notebooks only work in the context of our training environments (e.g. Vocareum). Hope this helps, Lou.
- 1 kudos
