โ03-10-2022 04:52 AM
I am trying to develop some script using python to access an sftp server without password and all valid public/private keys in a notebook. However I am not getting any such example. All examples has a password in it. Can I get some help?
โ03-10-2022 05:07 AM
@soumen sarangiโ , There is Spark SFTP library https://github.com/springml/spark-sftp
It sepends what is your data there. Sometimes better idea is to set some copy activity (like in Azure Data Factory) to have it in adls/blob mounted in databricks.
โ03-10-2022 05:07 AM
@soumen sarangiโ , There is Spark SFTP library https://github.com/springml/spark-sftp
It sepends what is your data there. Sometimes better idea is to set some copy activity (like in Azure Data Factory) to have it in adls/blob mounted in databricks.
โ08-29-2024 05:47 AM
I am currently using this library in my databricks where i am facing challenge to load the data from sftp
local_path = f'/Workspace/Users/<user.email>/Scard_etl/SFTP_LOCAL/JDL/'
com.springml:spark-sftp_2.11:1.0.3
โ04-17-2022 10:49 AM
https://stackoverflow.com/questions/58562744/how-to-upload-text-file-to-ftp-from-databricks-notebook this example looks good to me. or may be try using data libs. https://www.cdata.com/kb/tech/sftp-jdbc-azure-databricks.rst
โ04-17-2022 10:50 AM
again - I do not have this tested to my lab. so still unofficial. ๐
Passionate about hosting events and connecting people? Help us grow a vibrant local communityโsign up today to get started!
Sign Up Now