Databricks

anmol_deep · 06-17-2022

My Azure Databricks workspace was decommissioned. I forgot to copy files stored in the DatabricksRoot storage (dbfs:/FileStore/...).Can the workspace be recommissioned/restored? Is there any way to get my data back?Also, is there any difference betwe...

anmol_deep · 03-24-2022

I have a folder which contains multiple delta tables and some parquet tables. I want to move that folder to another path. When I use dbutils.fs.mv(), it takes an absurd amount of time.

anmol_deep · 06-17-2022

Hello @Arvind Ravish I have submitted a support request to Microsoft support team. (We use Azure). Hopefully they help us recover the data. I will update what happens.

anmol_deep · 04-17-2022

Hi @Kaniz Fatma ! Please convey my request to the development team - Make dbutils.fs commands faster. Implement multithreading/multiprocessing as it seems dbutils.fs commands are single threaded only. If this is not the best place to share feedback,...

anmol_deep · 04-07-2022

Hi @Kaniz Fatma and @Hubert Dudek ! Yes I tried Hubert's suggestions, but it didn't work for me. I was still getting this error. I also tried the df.vaccum(0) command and then tried to delete but even that didn't work. I kept getting the same erro...

anmol_deep · 03-24-2022

I have tried that. It doesn't work and throw the error I mentioned above. (I did add recurse=True). Even if I try to delete using %sh rm -rf, the same error occurs. All files get deleted except this folder: _delta_log. If I try to delete it, it gives...

anmol_deep · 03-24-2022

Thanks @Hubert Dudek !Actually I want to delete the folder. But when I try to do that, I get this error: shaded.databricks.org.apache.hadoop.fs.azure.AzureException: hadoop_azure_shaded.com.microsoft.azure.storage.StorageException: This operation is...

Databricks

User Stats

User Activity

How to restore DatabricksRoot(FileStore) data after Databricks Workspace is decommissioned?

dbutils.fs.mv taking too long with delta table

Re: How to restore DatabricksRoot(FileStore) data after Databricks Workspace is decommissioned?

Re: dbutils.fs.mv taking too long with delta table

Re: dbutils.fs.mv taking too long with delta table

Re: dbutils.fs.mv taking too long with delta table

Re: dbutils.fs.mv taking too long with delta table