cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Access DataBricks file system and transfer files

kll
New Contributor III

Is there a solution to access the files in DataBricks file system and transfer them to another directory, local or elsewhere. In other words, is there a FileZilla type solution?

where can i find instructions to ssh into the cluster from my mac terminal and then transfer files?

2 REPLIES 2

pvignesh92
Honored Contributor

@Keval Shah​ Hi. You can use Databricks CLI Utility to move or copy your files from DBFS path to local directory. There are a set of steps that you need to do in your MAC to install the CLI utility and set up the connection to your databricks cluster using Config files. Once these are set up, you can able to copy your files between Databricks Cluster and your local machine.

Please refer the below link for the process.

https://docs.databricks.com/dev-tools/cli/index.html

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi, There are different options around this. You can start with https://docs.databricks.com/files/index.html.

Please let us know if this helps.

Also, please tag @Debayan​ with your next response which will notify me. Thank you!

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.