- 683 Views
- 1 replies
- 1 kudos
How do you analyze performance
Curious to hear how you guys optimize compute. As in how you dig into the details of the Spark execution and improve?
- 683 Views
- 1 replies
- 1 kudos
- 1 kudos
That is it. Usually, people take the time it takes to run a job/query/process as their KPI. Then you start to check which processes are taking more time, drilling down one by one. Sometimes it could be a misplaced .cache(), .collect() or display() t...
- 1 kudos
- 1670 Views
- 0 replies
- 0 kudos
Creating Zip file on Azure storage explorer
I need to create zip file which will contain csv files which I have created from the dataframe. But I am unable to create valid zip file which will be containing all csv files. Is it possible to create zip file from code in databricks on azure storag...
- 1670 Views
- 0 replies
- 0 kudos
- 2157 Views
- 2 replies
- 2 kudos
New member
Excited to be at Data Summit 2024
- 2157 Views
- 2 replies
- 2 kudos
- 3945 Views
- 2 replies
- 0 kudos
How can i create multiple workspaces in existing single azure databricks resource?
I have an azure databricks resource created in my Azure portal. I want to achieve departmental secracy in single databricks resource. Hence, I am looking for a solution where I can add multiple workspaces to my single Databricks resource. Is it even ...
- 3945 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi, It is possible to create multiple workspace from a single azure account.Go to Azure portal click on Azure Databricks.Click on Create.Fill all the details and your new workspace is ready.
- 0 kudos
- 713 Views
- 0 replies
- 0 kudos
- 713 Views
- 0 replies
- 0 kudos
- 574 Views
- 0 replies
- 0 kudos
Data summit 2023
I learned about Unity catalog, LLM features and delta sharing today at Data summit.
- 574 Views
- 0 replies
- 0 kudos
- 1073 Views
- 1 replies
- 0 kudos
Data Summi 2023
I learned about Unity catalog, LLM features and delta sharing today at Data summit.
- 1073 Views
- 1 replies
- 0 kudos
- 0 kudos
Really liked the new nnouncemns on unity catelog
- 0 kudos
- 551 Views
- 0 replies
- 0 kudos
Python spark support
Good to see python as a first class language for spark applications development .
- 551 Views
- 0 replies
- 0 kudos
- 1383 Views
- 1 replies
- 1 kudos
- 1383 Views
- 1 replies
- 1 kudos
- 1 kudos
hello @tharun19
- 1 kudos
- 3978 Views
- 2 replies
- 0 kudos
Getting secret from Key Vault of previous version
Hi,I have added secrets in Azure Key Vault and also updated it few times. I need to access current as well as previous version secret in a data pipeline. dbutils.secrete.get(KeyName, SecretScopeName)This gives me the current version of secret.How can...
- 3978 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod, @Data_Analytics1 Has a solution this problem been found in the meantime?I need to access a secret with a SPECIFIC VERSION from Azure Key Vault via Databricks Secret Scope. Hence while retrieving the secret I need to pass BOTH AKV sec...
- 0 kudos
- 845 Views
- 0 replies
- 0 kudos
Spark structured streaming
hi,could someone please help me with this code :-input parameter df is a spark structured streaming dataframe def apply_duplicacy_check(df, duplicate_check_columns): if len(duplicate_check_columns) == 0: return None, df valid_df = df.dr...
- 845 Views
- 0 replies
- 0 kudos
- 2689 Views
- 1 replies
- 0 kudos
Data Analysis with Databricks SQL Course Material
Hi Community,I am currently going through Databrick Academy's course for Data Analysis with Databricks SQL. I have downloaded the DBC course material, however there does not seen to be any material under docs folder. Can someone please share some l...
- 2689 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Databrick Team, any helping points appreciated!
- 0 kudos
- 1728 Views
- 3 replies
- 2 kudos
First data AI summit !
Anyone from France ?
- 1728 Views
- 3 replies
- 2 kudos
- 404 Views
- 0 replies
- 0 kudos
- 404 Views
- 0 replies
- 0 kudos
- 525 Views
- 0 replies
- 0 kudos
- 525 Views
- 0 replies
- 0 kudos
