โ03-10-2022 04:52 AM
I am trying to develop some script using python to access an sftp server without password and all valid public/private keys in a notebook. However I am not getting any such example. All examples has a password in it. Can I get some help?
โ03-10-2022 05:07 AM
@soumen sarangiโ , There is Spark SFTP library https://github.com/springml/spark-sftp
It sepends what is your data there. Sometimes better idea is to set some copy activity (like in Azure Data Factory) to have it in adls/blob mounted in databricks.
โ03-10-2022 05:07 AM
@soumen sarangiโ , There is Spark SFTP library https://github.com/springml/spark-sftp
It sepends what is your data there. Sometimes better idea is to set some copy activity (like in Azure Data Factory) to have it in adls/blob mounted in databricks.
โ08-29-2024 05:47 AM
I am currently using this library in my databricks where i am facing challenge to load the data from sftp
local_path = f'/Workspace/Users/<user.email>/Scard_etl/SFTP_LOCAL/JDL/'
com.springml:spark-sftp_2.11:1.0.3
โ04-17-2022 10:49 AM
https://stackoverflow.com/questions/58562744/how-to-upload-text-file-to-ftp-from-databricks-notebook this example looks good to me. or may be try using data libs. https://www.cdata.com/kb/tech/sftp-jdbc-azure-databricks.rst
โ04-17-2022 10:50 AM
again - I do not have this tested to my lab. so still unofficial. ๐
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group