- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-04-2022 02:05 PM
How I can connect sftp server from databricks. So I can write files into tables directly?
- Labels:
-
Databricks notebook
-
SFTP
-
Sftp Server
Accepted Solutions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-13-2022 08:19 AM
The classic solution is to copy data from FTP to ADLS storage using Azure Data Factory, and after the copy is done in the ADF pipeline, trigger the databricks notebook.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-07-2022 12:18 AM
Hi @ARINJAY JAIN , Could you please check if this works: https://community.databricks.com/s/question/0D53f00001lbF65CAE/notebook-for-sftp-server-connectivity...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-15-2023 01:13 AM
Thank you for the link, you made my day.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-13-2022 08:19 AM
The classic solution is to copy data from FTP to ADLS storage using Azure Data Factory, and after the copy is done in the ADF pipeline, trigger the databricks notebook.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-10-2023 11:26 PM
Thank you, I will try it. I hope it works. If you're looking for the best online writing services for your college assignments, be sure to visit https://www.topwritersreview.com/reviews/essayusa/ It's an excellent resource that can help you make an informed decision and achieve your academic goals with confidence.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-24-2023 06:11 AM
Is there a way to copy data from FTP into ADLS using PySpark in a Databricks Notebook (i.e. without ADF)?
The following library (https://github.com/springml/spark-sftp) that some have recommended does not seem to include a PySpark API.