When I tried to read the SFTP (CSV file) in Databricks I'm getting the below error
"JSchException: Algorithm negotiation fail"
Code:
var df = spark.read
.options(Map("header"->"true",
"host"->"20.118.190.30",
"username"->"user",
"password"->"pass",
"fileFormat"->"csv",
"dfsTempPath"-> "/ftp/tmp/",
"sep"->",",
"treatEmptyValuesAsNulls"->"false")).sftp("/home/user/sftp_test/sample_csv.csv");
Databricks Version: 12.2 LTS
Apache Spark : 3.3.2
Scala : 2.12
Library installed:
com.github.arcizon:spark-filetransfer_2.12:0.3.0
com.jcraft:jsch:0.1.55