cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
Yogic24
by • Valued Contributor II
  • 2971 Views
  • 2 replies
  • 1 kudos

Resolved! Regarding Certification renewal process

hi team,Anyone can guide me for certification renewal process?  

Get Started Discussions
Reply
  • 2971 Views
  • 2 replies
  • 1 kudos
View Replies
Latest Reply
daniel_sahal
Databricks MVP
  • 1 kudos

@Yogic24 It's in certification FAQ. https://www.databricks.com/learn/certification/faq#certificationsTo recertify, you will need to take the full current live exam.

  • 1 kudos
1 More Replies
mh-hsn
by • New Contributor III
  • 3613 Views
  • 0 replies
  • 0 kudos

Inconsistent behavior while loading pickle file

I have a pickle file "vectorizer.pkl" and I am currently facing an inconsistent behavior when trying to load that file. Sometimes it gets loaded successfully and sometimes I face an error. Here is how I am trying to load the file:from joblib import l...

Get Started Discussions
datascience
machine learning
pickle
python
Reply
  • 3613 Views
  • 0 replies
  • 0 kudos
mh-hsn
by • New Contributor III
  • 12765 Views
  • 5 replies
  • 8 kudos

python multiprocessing hangs at map on one cluster but works fine on another

I have a simple python script which have been running fine on my cluster but recently the same script gets stuck at map. So I tried creating a new cluster with less resources and tried to run the same script over that and it ran just fine.Here are th...

Get Started Discussions
datascience
machine learning
MAP
multiprocessing
python
Reply
  • 12765 Views
  • 5 replies
  • 8 kudos
View Replies
Latest Reply
jacovangelder
Databricks MVP
  • 8 kudos

I agree with @raphaelblg. Most likely you're running out of memory. Multiprocessing or threadpools unfortunately do not benefit from extra workers as they only run on your driver node. This is very annoying and not a very known fact. Spark driver als...

  • 8 kudos
4 More Replies
nileshtiwaari
by • New Contributor
  • 2092 Views
  • 1 replies
  • 1 kudos

Streaming Query

How to remove duplicates in streaming query on the basis of some id?

Get Started Discussions
Reply
  • 2092 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
daniel_sahal
Databricks MVP
  • 1 kudos

@nileshtiwaari Are you refering to Strucutred Streaming or DLT?In case of Structured Streaming: https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#streaming-deduplicationAbout DLT, here's a thread from a couple of months...

  • 1 kudos
businessloansnz
by • New Contributor
  • 1190 Views
  • 0 replies
  • 0 kudos

Business Loans NZ

Boost Your Business with Unsecured Business Loans in NZ - Apply Now Looking for quick and easy unsecured business loans in New Zealand?For Business Loans NZ, it's crucial to understand the pivotal role they play in supporting businesses of all sizes ...

Get Started Discussions
Reply
  • 1190 Views
  • 0 replies
  • 0 kudos
himoshi
by • New Contributor II
  • 1803 Views
  • 0 replies
  • 0 kudos

Clarification on overwriting in Unity Catalog

Hello, While reviewing Unity Catalog to better understand its limitations, I came across the following statement:Overwrite mode for DataFrame write operations into Unity Catalog is supported only for Delta tables, not for other file formats. The user...

Get Started Discussions
Reply
  • 1803 Views
  • 0 replies
  • 0 kudos
Yaminim
by • Databricks Partner
  • 3335 Views
  • 1 replies
  • 0 kudos

Facing CORS issue while calling Databricks REST API from a react application

I am trying to call the REST API of Databricks from a React(v17) application,  using the following documentation https://docs.databricks.com/api/workspace/introduction . I am getting CORS issue on the APIs and not able to call them. But, when I try t...

Get Started Discussions
Reply
  • 3335 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Tophu
New Contributor II
  • 0 kudos

There was a similar issue resolved regarding cors seen here: https://community.databricks.com/t5/administration-architecture/databricks-rest-apis-cors-issue/td-p/63936 If this is just for your own development and testing you might consider allowing a...

  • 0 kudos
Cloud_Architect
by • Databricks Partner
  • 1323 Views
  • 1 replies
  • 0 kudos

Need help calculating the cost benefits of switching from interactive to job cluster

I need help calculating the cost benefits of switching from interactive to job cluster. Can you help me get some formulas on how to calculate the cost differences in Databricks?

Get Started Discussions
Reply
  • 1323 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
jacovangelder
Databricks MVP
  • 0 kudos

Assuming you're on Azure (otherwise use the AWS/GCP equivalent), did you try the Azure cost calculator? https://azure.microsoft.com/en-us/pricing/details/databricks/Question to ask yourself to get more specific: Do you have an idea how much DBU's you...

  • 0 kudos
Labels