cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Is DBFS going to be deprecated?

ArvindDige
New Contributor

Is DBFS going to be deprecated? As I am using /dbfs/FileStore/tables/ location where a jar file is stored, and I am copying this jar file to /databricks/jars locations.

My concerns is as DBFS root and mounts are deprecated, is that mean in coming days the dbfs is going to be removed from Databricks itself? Please find attached screenshot(dbfs.png) about for reference. If this is the case then I have to migrate my source path (/dbfs/FileStore/tables/) of Jar to some other location. 

One of the scenario I am testing is storing the jar in Storage Account and copying it into /databricks/jars/ location, but it is not allowing me to copy the same jar in /databricks/jars location. Can someone help me on this scenario.

2 REPLIES 2

raphaelblg
Contributor III
Contributor III

Hi @ArvindDige

I would let the .jar file in your workspace files or in the Storage Account. When you say "it is not allowing me to copy the same jar in /databricks/jars location" what specifically do you mean? are you getting any errors?



Best regards,

Raphael Balogo
Sr. Technical Solutions Engineer
Databricks

ArvindDige
New Contributor

Hi Raphael,

I am trying below init script to achieve this task, PFA

And getting error as below,

Cluster scoped init script abfss://container@storage.dfs.core.windows.net/init_script.sh failed: Failure to initialize configuration for storage account storage.dfs.core.windows.net: Invalid configuration value detected for fs.azure.account.key, Caused by: Invalid configuration value detected for fs.azure.account.key.

 

Apart from this my main question is, does databricks going to remove support for dbfs? can you please answer this as well.

Thanks,

Arvind Dige

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!