- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-04-2022 02:05 PM
How I can connect sftp server from databricks. So I can write files into tables directly?
- Labels:
-
Databricks notebook
-
SFTP
-
Sftp Server
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-07-2022 12:18 AM
Hi @ARINJAY JAIN , Could you please check if this works: https://community.databricks.com/s/question/0D53f00001lbF65CAE/notebook-for-sftp-server-connectivity...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-15-2023 01:13 AM
Thank you for the link, you made my day.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-13-2022 08:19 AM
The classic solution is to copy data from FTP to ADLS storage using Azure Data Factory, and after the copy is done in the ADF pipeline, trigger the databricks notebook.
My blog: https://databrickster.medium.com/
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-10-2023 11:26 PM
Thank you, I will try it. I hope it works. If you're looking for the best online writing services for your college assignments, be sure to visit https://www.topwritersreview.com/reviews/essayusa/ It's an excellent resource that can help you make an informed decision and achieve your academic goals with confidence.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-24-2023 06:11 AM
Is there a way to copy data from FTP into ADLS using PySpark in a Databricks Notebook (i.e. without ADF)?
The following library (https://github.com/springml/spark-sftp) that some have recommended does not seem to include a PySpark API.
