cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

eimis_pacheco
by Contributor
  • 3165 Views
  • 3 replies
  • 1 kudos

Confused with databricks Tips and Tricks - Optimizations regarding partitining

Hello Community,Today I was in Tips and Tricks - Optimizations webinar and I started being confused, they said:"Don't partition tables <1TB in size and plan carefully when partitioning• Partitions should be >=1GB" Now my confusion is if this recommen...

Get Started Discussions
data engineering
performance
  • 3165 Views
  • 3 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

that is partitions on disk.Defining the correct amount of partitions is not that easy.  One would think that more partitions is better because you can process more data in parallel.And that is true if you only have to do local transformations (no shu...

  • 1 kudos
2 More Replies
Nexalyn33
by New Contributor II
  • 993 Views
  • 1 replies
  • 0 kudos

[offisiell] Nexalyn Norge Erfaringer anmeldelser – Nexalyn Ingredienser pris, kjøp

Nexalyn Norge Opplevelser Dose, inntak: I en verden hvor vitalitet og ytelse ofte er synonymt med suksess, er det viktig å opprettholde topp fysisk form. For menn strekker dette seg ofte utover bare kondisjon til områder med vitalitet, virilitet og g...

  • 993 Views
  • 1 replies
  • 0 kudos
Latest Reply
Nexalyn33
New Contributor II
  • 0 kudos

Klikk her for å kjøpe nå fra den offisielle nettsiden til Nexalyn

  • 0 kudos
Newbienewbster
by New Contributor
  • 432 Views
  • 1 replies
  • 1 kudos

How do you analyze performance

Curious to hear how you guys optimize compute. As in how you dig into the details of the Spark execution and improve?

  • 432 Views
  • 1 replies
  • 1 kudos
Latest Reply
mhiltner
Databricks Employee
  • 1 kudos

That is it. Usually, people take the time it takes to run a job/query/process as their KPI.  Then you start to check which processes are taking more time, drilling down one by one. Sometimes it could be a misplaced .cache(), .collect() or display() t...

  • 1 kudos
Data_Analytics1
by Contributor III
  • 2882 Views
  • 2 replies
  • 0 kudos

Getting secret from Key Vault of previous version

Hi,I have added secrets in Azure Key Vault and also updated it few times. I need to access current as well as previous version secret in a data pipeline. dbutils.secrete.get(KeyName, SecretScopeName)This gives me the current version of secret.How can...

  • 2882 Views
  • 2 replies
  • 0 kudos
Latest Reply
johnb1
Contributor
  • 0 kudos

Hi @Retired_mod, @Data_Analytics1 Has a solution this problem been found in the meantime?I need to access a secret with a SPECIFIC VERSION from Azure Key Vault via Databricks Secret Scope. Hence while retrieving the secret I need to pass BOTH AKV sec...

  • 0 kudos
1 More Replies
BricksNewbie
by New Contributor II
  • 1925 Views
  • 1 replies
  • 0 kudos

Data Analysis with Databricks SQL Course Material

Hi Community,I am currently going through Databrick Academy's course for Data Analysis with Databricks SQL.  I have downloaded the DBC course material, however there does not seen to be any material under docs folder.  Can someone please share some l...

  • 1925 Views
  • 1 replies
  • 0 kudos
Latest Reply
BricksNewbie
New Contributor II
  • 0 kudos

Hi Databrick Team, any helping points appreciated! 

  • 0 kudos
businessloansnz
by New Contributor
  • 546 Views
  • 0 replies
  • 0 kudos

Business Loans NZ

Boost Your Business with Unsecured Business Loans in NZ - Apply Now Looking for quick and easy unsecured business loans in New Zealand?For Business Loans NZ, it's crucial to understand the pivotal role they play in supporting businesses of all sizes ...

  • 546 Views
  • 0 replies
  • 0 kudos
Yaminim
by New Contributor
  • 1679 Views
  • 1 replies
  • 0 kudos

Facing CORS issue while calling Databricks REST API from a react application

I am trying to call the REST API of Databricks from a React(v17) application,  using the following documentation https://docs.databricks.com/api/workspace/introduction . I am getting CORS issue on the APIs and not able to call them. But, when I try t...

  • 1679 Views
  • 1 replies
  • 0 kudos
Latest Reply
Tophu
New Contributor II
  • 0 kudos

There was a similar issue resolved regarding cors seen here: https://community.databricks.com/t5/administration-architecture/databricks-rest-apis-cors-issue/td-p/63936 If this is just for your own development and testing you might consider allowing a...

  • 0 kudos
kanishkmalik199
by New Contributor
  • 3310 Views
  • 3 replies
  • 1 kudos

Certification Coupon Voucher Not Received

Hi Team I have attended the webinar long back and completed the survey as well still i have not receive any coupon voucher and because of that not able to give exam . Please look into this isue asap and provide me with the voucher .

  • 3310 Views
  • 3 replies
  • 1 kudos
Latest Reply
Bharathkumar
Databricks Employee
  • 1 kudos

Hi Guilherme, We can see that, whereas you used the email address "guilherme.santos@bridgeconsulting.com.br" to attend the webinar, but you did not complete the survey. So you have not received the voucher code.

  • 1 kudos
2 More Replies
AchintyaSingh
by New Contributor
  • 1188 Views
  • 1 replies
  • 0 kudos

Running JAR jobs in parallel on a cluster

Hi everyone, I'm trying to find out if databricks has support for clusters which can scale out with more drivers to run new jobs in parallel. If not, then is there a work around for this? I've noticed that all-purpose and job compute clusters both fe...

  • 1188 Views
  • 1 replies
  • 0 kudos
Latest Reply
Yeshwanth
Databricks Employee
  • 0 kudos

@AchintyaSingh  Databricks does not support clusters with multiple drivers to run new jobs in parallel. Each Databricks cluster has a single driver node, allowing only one job at a time.Workarounds for Achieving Parallel Job Execution: 1. Multiple Cl...

  • 0 kudos
Ali_Ahmad
by New Contributor II
  • 1363 Views
  • 1 replies
  • 0 kudos

Add Raw Tabless to Unity Catalog?

Hello everyone,Hope someone here can help me out as I am a bit stuck I am currently loading some data from number of sources to parquet using ADF. This ends up in a ADLS2 storage account as .parquet. This is the staging / landing zone area.From there...

  • 1363 Views
  • 1 replies
  • 0 kudos
Latest Reply
" src="" />
This widget could not be displayed.
This widget could not be displayed.
This widget could not be displayed.
  • 0 kudos

This widget could not be displayed.
Hello everyone,Hope someone here can help me out as I am a bit stuck I am currently loading some data from number of sources to parquet using ADF. This ends up in a ADLS2 storage account as .parquet. This is the staging / landing zone area.From there...

This widget could not be displayed.
  • 0 kudos
This widget could not be displayed.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels
Top Kudoed Authors