Access DataBricks file system and transfer files
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-02-2023 09:33 PM
Is there a solution to access the files in DataBricks file system and transfer them to another directory, local or elsewhere. In other words, is there a FileZilla type solution?
where can i find instructions to ssh into the cluster from my mac terminal and then transfer files?
- Labels:
-
Access Databricks
-
Transfer Files
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-03-2023 12:08 AM
@Keval Shah Hi. You can use Databricks CLI Utility to move or copy your files from DBFS path to local directory. There are a set of steps that you need to do in your MAC to install the CLI utility and set up the connection to your databricks cluster using Config files. Once these are set up, you can able to copy your files between Databricks Cluster and your local machine.
Please refer the below link for the process.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-03-2023 12:21 AM
Hi, There are different options around this. You can start with https://docs.databricks.com/files/index.html.
Please let us know if this helps.
Also, please tag @Debayan with your next response which will notify me. Thank you!