- 5371 Views
- 3 replies
- 1 kudos
Confused with databricks Tips and Tricks - Optimizations regarding partitining
Hello Community,Today I was in Tips and Tricks - Optimizations webinar and I started being confused, they said:"Don't partition tables <1TB in size and plan carefully when partitioning• Partitions should be >=1GB" Now my confusion is if this recommen...
- 5371 Views
- 3 replies
- 1 kudos
- 1 kudos
that is partitions on disk.Defining the correct amount of partitions is not that easy. One would think that more partitions is better because you can process more data in parallel.And that is true if you only have to do local transformations (no shu...
- 1 kudos
- 1746 Views
- 1 replies
- 0 kudos
Certification exam
Hello Team, Today my exam was scheduled at 7:30 AM. No one contacted me before the exam for any validation/guideline. About one hour after, the proctor suspended my exam. Please check the video. I was constantly looking at the screen only. I have rai...
- 1746 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Databricks community and @Cert-Team,It is more than 24 hours and I did not get any update after my Databricks Professional Exam got suspended.Please help me to sort this out so that I can complete the exam. It is very important for me to complete ...
- 0 kudos
- 3183 Views
- 4 replies
- 1 kudos
Databricks DataEngineering Learning
I am new to Databricks. I am trying to do the lab work given Databricks DataEngineering course, at workbook 4.1 I am getting below error. Please help to resolve.Expected one and only one cluster definition.Edit the config via the JSON interface to re...
- 3183 Views
- 4 replies
- 1 kudos
- 2119 Views
- 1 replies
- 0 kudos
[offisiell] Nexalyn Norge Erfaringer anmeldelser – Nexalyn Ingredienser pris, kjøp
Nexalyn Norge Opplevelser Dose, inntak: I en verden hvor vitalitet og ytelse ofte er synonymt med suksess, er det viktig å opprettholde topp fysisk form. For menn strekker dette seg ofte utover bare kondisjon til områder med vitalitet, virilitet og g...
- 2119 Views
- 1 replies
- 0 kudos
- 0 kudos
Klikk her for å kjøpe nå fra den offisielle nettsiden til Nexalyn
- 0 kudos
- 3392 Views
- 1 replies
- 0 kudos
Vector Database
What is the vector database to generate in DataBricks?
- 3392 Views
- 1 replies
- 0 kudos
- 0 kudos
Not sure if i understood the question. If you want to use Databricks Vector Database, just go to your table > create vector search index. First you need to create a Vector Search Endpoint (compute > vector search), and you need to have an enabled ser...
- 0 kudos
- 1101 Views
- 1 replies
- 1 kudos
How do you analyze performance
Curious to hear how you guys optimize compute. As in how you dig into the details of the Spark execution and improve?
- 1101 Views
- 1 replies
- 1 kudos
- 1 kudos
That is it. Usually, people take the time it takes to run a job/query/process as their KPI. Then you start to check which processes are taking more time, drilling down one by one. Sometimes it could be a misplaced .cache(), .collect() or display() t...
- 1 kudos
- 2208 Views
- 0 replies
- 0 kudos
Creating Zip file on Azure storage explorer
I need to create zip file which will contain csv files which I have created from the dataframe. But I am unable to create valid zip file which will be containing all csv files. Is it possible to create zip file from code in databricks on azure storag...
- 2208 Views
- 0 replies
- 0 kudos
- 3049 Views
- 2 replies
- 2 kudos
New member
Excited to be at Data Summit 2024
- 3049 Views
- 2 replies
- 2 kudos
- 6696 Views
- 2 replies
- 0 kudos
How can i create multiple workspaces in existing single azure databricks resource?
I have an azure databricks resource created in my Azure portal. I want to achieve departmental secracy in single databricks resource. Hence, I am looking for a solution where I can add multiple workspaces to my single Databricks resource. Is it even ...
- 6696 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi, It is possible to create multiple workspace from a single azure account.Go to Azure portal click on Azure Databricks.Click on Create.Fill all the details and your new workspace is ready.
- 0 kudos
- 1029 Views
- 0 replies
- 0 kudos
- 1029 Views
- 0 replies
- 0 kudos
- 978 Views
- 0 replies
- 0 kudos
Data summit 2023
I learned about Unity catalog, LLM features and delta sharing today at Data summit.
- 978 Views
- 0 replies
- 0 kudos
- 1773 Views
- 1 replies
- 0 kudos
Data Summi 2023
I learned about Unity catalog, LLM features and delta sharing today at Data summit.
- 1773 Views
- 1 replies
- 0 kudos
- 0 kudos
Really liked the new nnouncemns on unity catelog
- 0 kudos
- 929 Views
- 0 replies
- 0 kudos
Python spark support
Good to see python as a first class language for spark applications development .
- 929 Views
- 0 replies
- 0 kudos
- 1966 Views
- 1 replies
- 1 kudos
- 1966 Views
- 1 replies
- 1 kudos
- 1 kudos
hello @tharun19
- 1 kudos
- 5173 Views
- 2 replies
- 0 kudos
Getting secret from Key Vault of previous version
Hi,I have added secrets in Azure Key Vault and also updated it few times. I need to access current as well as previous version secret in a data pipeline. dbutils.secrete.get(KeyName, SecretScopeName)This gives me the current version of secret.How can...
- 5173 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod, @Data_Analytics1 Has a solution this problem been found in the meantime?I need to access a secret with a SPECIFIC VERSION from Azure Key Vault via Databricks Secret Scope. Hence while retrieving the secret I need to pass BOTH AKV sec...
- 0 kudos
