Databricks Delta Lake Sink Connector

Bency
New Contributor III

I am trying to use Databricks Delta Lake Sink Connector(confluent cloud ) and write to S3 .

the connector starts up with the following error . Any help on this could be appreciated

org.apache.kafka.connect.errors.ConnectException: java.sql.SQLException: [Simba][SparkJDBCDriver](500593) Communication link failure. Failed to connect to server. Reason: HTTP Response code: 403, Error message: Unknown.

    at io.confluent.connect.databricks.deltalake.DatabricksDeltaLakeSinkTask.deltaLakeConnection(DatabricksDeltaLakeSinkTask.java:253)

    at io.confluent.connect.databricks.deltalake.DatabricksDeltaLakeSinkTask.start(DatabricksDeltaLakeSinkTask.java:88)

    at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:305)

    at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:193)

    at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:184)

    at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234)

    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

    at java.util.concurrent.FutureTask.run(FutureTask.java:266)

    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

    at java.lang.Thread.run(Thread.java:750)

Caused by: java.sql.SQLException: [Simba][SparkJDBCDriver](500593) Communication link failure. Failed to connect to server. Reason: HTTP Response code: 403, Error message: Unknown.

    at com.simba.spark.hivecommon.api.HS2Client.handleTTransportException(Unknown Source)

    at com.simba.spark.spark.jdbc.DowloadableFetchClient.handleTTransportException(Unknown Source)

    at com.simba.spark.hivecommon.api.HS2Client.openSession(Unknown Source)

    at com.simba.spark.hivecommon.api.HS2Client.<init>(Unknown Source)

    at com.simba.spark.spark.jdbc.DowloadableFetchClient.<init>(Unknown Source)

    at com.simba.spark.spark.jdbc.DownloadableFetchClientFactory.createClient(Unknown Source)

    at com.simba.spark.hivecommon.core.HiveJDBCCommonConnection.establishConnection(Unknown Source)

    at com.simba.spark.spark.core.SparkJDBCConnection.establishConnection(Unknown Source)

    at com.simba.spark.jdbc.core.LoginTimeoutConnection$1.call(Unknown Source)

    at com.simba.spark.jdbc.core.LoginTimeoutConnection$1.call(Unknown Source)

    ... 4 more

Caused by: com.simba.spark.support.exceptions.ErrorException: [Simba][SparkJDBCDriver](500593) Communication link failure. Failed to connect to server. Reason: HTTP Response code: 403, Error message: Unknown.

    ... 14 more

Caused by: com.simba.spark.jdbc42.internal.apache.thrift.transport.TTransportException: HTTP Response code: 403, Error message: Unknown

    at com.simba.spark.hivecommon.api.TETHttpClient.handleHeaderErrorMessage(Unknown Source)

    at com.simba.spark.hivecommon.api.TETHttpClient.handleErrorResponse(Unknown Source)

    at com.simba.spark.hivecommon.api.TETHttpClient.flushUsingHttpClient(Unknown Source)

    at com.simba.spark.hivecommon.api.TETHttpClient.flush(Unknown Source)

    at com.simba.spark.jdbc42.internal.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73)

    at com.simba.spark.jdbc42.internal.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)

    at com.simba.spark.jdbc42.internal.apache.hive.service.rpc.thrift.TCLIService$Client.send_OpenSession(TCLIService.java:147)

    at com.simba.spark.hivecommon.api.HS2ClientWrapper.send_OpenSession(Unknown Source)

    at com.simba.spark.jdbc42.internal.apache.hive.service.rpc.thrift.TCLIService$Client.OpenSession(TCLIService.java:139)

    at com.simba.spark.hivecommon.api.HS2ClientWrapper.callOpenSession(Unknown Source)

    at com.simba.spark.hivecommon.api.HS2ClientWrapper.access$1700(Unknown Source)

    at com.simba.spark.hivecommon.api.HS2ClientWrapper$18.clientCall(Unknown Source)

    at com.simba.spark.hivecommon.api.HS2ClientWrapper$18.clientCall(Unknown Source)

    at com.simba.spark.hivecommon.api.HS2ClientWrapper.executeWithRetry(Unknown Source)

    at com.simba.spark.hivecommon.api.HS2ClientWrapper.OpenSession(Unknown Source)