cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to download zip file from SFTP location and put that file into Azure Data Lake and unzip there ?

hetadesai
New Contributor II

I have zip file on SFTP location. I want to copy that file from SFTP location and put it into Azure Data lake and want to unzip there using spark notebook.

Please help me to solve this.

1 ACCEPTED SOLUTION

Accepted Solutions

Kaniz_Fatma
Community Manager
Community Manager

Hi @heta desaiโ€‹ , Here's how you can copy your file from SFTP location and put it into Azure Data lake.

https://docs.microsoft.com/en-us/azure/data-factory/connector-sftp?tabs=data-factory

View solution in original post

3 REPLIES 3

Kaniz_Fatma
Community Manager
Community Manager

Hi @heta desaiโ€‹ , Here's how you can copy your file from SFTP location and put it into Azure Data lake.

https://docs.microsoft.com/en-us/azure/data-factory/connector-sftp?tabs=data-factory

Hubert-Dudek
Esteemed Contributor III

I would go with @Kaniz Fatmaโ€‹ approach and download data in Data Factory and after is downloaded on success trigger databricks spark notebook. With spark you can read also compressed data so maybe you will not need to do even separate unzip.

Kaniz_Fatma
Community Manager
Community Manager

Hi @heta desaiโ€‹ , Did our suggestions help you?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group