topic Re: Connect a SFTP to Databricks in Data Engineering

Connect a SFTP to Databricks

Henrik_ — Thu, 17 Oct 2024 08:47:39 GMT

What would be the best way to set up a connection to a sftp server from Databricks? In Jupyter Lab, this can done from terminal. Of coruse, there are alternatives like using paramiko library. But is there perhaps a more Databricks-ish solution?

Re: Connect a SFTP to Databricks

Panda — Thu, 17 Oct 2024 09:42:22 GMT

@Henrik_ Try using python libraray's like spark-sftp, paramiko

Re: Connect a SFTP to Databricks

Henrik_ — Thu, 17 Oct 2024 10:38:30 GMT

Yes, I know about those libraries. I wonder if there is some in-built function in Databricks to do this.