I need to create zip file which will contain csv files which I have created from the dataframe. But I am unable to create valid zip file which will be containing all csv files. Is it possible to create zip file from code in databricks on azure storag...
Excited to be at Data Summit 2024
I have an azure databricks resource created in my Azure portal. I want to achieve departmental secracy in single databricks resource. Hence, I am looking for a solution where I can add multiple workspaces to my single Databricks resource. Is it even ...
Hi, It is possible to create multiple workspace from a single azure account.Go to Azure portal click on Azure Databricks.Click on Create.Fill all the details and your new workspace is ready.
I learned about Unity catalog, LLM features and delta sharing today at Data summit.
I learned about Unity catalog, LLM features and delta sharing today at Data summit.
Really liked the new nnouncemns on unity catelog
Good to see python as a first class language for spark applications development .
hello @tharun19
Hi,I have added secrets in Azure Key Vault and also updated it few times. I need to access current as well as previous version secret in a data pipeline. dbutils.secrete.get(KeyName, SecretScopeName)This gives me the current version of secret.How can...
Hi @Retired_mod, @Data_Analytics1 Has a solution this problem been found in the meantime?I need to access a secret with a SPECIFIC VERSION from Azure Key Vault via Databricks Secret Scope. Hence while retrieving the secret I need to pass BOTH AKV sec...
hi,could someone please help me with this code :-input parameter df is a spark structured streaming dataframe def apply_duplicacy_check(df, duplicate_check_columns): if len(duplicate_check_columns) == 0: return None, df valid_df = df.dr...
Hi Community,I am currently going through Databrick Academy's course for Data Analysis with Databricks SQL. I have downloaded the DBC course material, however there does not seen to be any material under docs folder. Can someone please share some l...
Hi Databrick Team, any helping points appreciated!
Anyone from France ?
Anyone else from Costa Rica
