topic Access DataBricks file system and transfer files in Data Engineering

Access DataBricks file system and transfer files

kll — Mon, 03 Apr 2023 04:33:06 GMT

Is there a solution to access the files in DataBricks file system and transfer them to another directory, local or elsewhere. In other words, is there a FileZilla type solution?

where can i find instructions to ssh into the cluster from my mac terminal and then transfer files?

Re: Access DataBricks file system and transfer files

pvignesh92 — Mon, 03 Apr 2023 07:08:01 GMT

@Keval Shah Hi. You can use Databricks CLI Utility to move or copy your files from DBFS path to local directory. There are a set of steps that you need to do in your MAC to install the CLI utility and set up the connection to your databricks cluster using Config files. Once these are set up, you can able to copy your files between Databricks Cluster and your local machine.

Please refer the below link for the process.

https://docs.databricks.com/dev-tools/cli/index.html

Re: Access DataBricks file system and transfer files

Debayan — Mon, 03 Apr 2023 07:21:04 GMT

Hi, There are different options around this. You can start with https://docs.databricks.com/files/index.html.

Please let us know if this helps.

Also, please tag @Debayan with your next response which will notify me. Thank you!