cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Informatica Cloud mapping with Databricks connection failing with java.util.NoSuchElementException

MaheshDR
New Contributor II

Hi Team,

When we tried to configure our source with Databricks table with Databricks connection on Informatica Cloud, we received below error.

We already tried the suggestions mentioned in the below community post which seems to be similar error as ours.

https://community.databricks.com/s/question/0D53f00001HKIEHCA5/while-loading-data-from-blob-to-delta...

The highlighted query is running fine on Databricks SQL editor.

Please review and advise

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.654] [INFO] SQL QUERY: SELECT `hash_key`,`mre_code`,`mre_mrcc` FROM `sitsint`.`eidb_men_mre` WHERE EIDB_MEN_MRE.RECORD_STATUS<>'D'

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.704] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] java.util.NoSuchElementException

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at java.util.StringTokenizer.nextToken(StringTokenizer.java:349)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.simba.spark.jdbc.common.BaseConnectionFactory.acceptsURL(Unknown Source)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.simba.spark.jdbc.common.AbstractDriver.connect(Unknown Source)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at java.sql.DriverManager.getConnection(DriverManager.java:664)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at java.sql.DriverManager.getConnection(DriverManager.java:270)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.adapter.databricksdelta.runtime.adapter.DatabricksdeltaDatabricksdeltaDataConnection.connect(DatabricksdeltaDatabricksdeltaDataConnection.java:124)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.adapter.databricksdelta.runtime.adapter.read.DeltaJdbcReader.initDataSession(DeltaJdbcReader.java:73)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.adapter.databricksdelta.runtime.adapter.DatabricksdeltaDatabricksdeltaDataAdapter.beginDataSession(DatabricksdeltaDatabricksdeltaDataAdapter.java:145)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.cci.runtime.impl.CDataAdapterImpl.read(CDataAdapterImpl.java:195)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.cci.cloud.client.impl.CCIRuntimeDataClientImpl.readData(CCIRuntimeDataClientImpl.java:306)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.cloud.api.adapter.cci.reader.CCIRdrPartitionDriver.run(CCIRdrPartitionDriver.java:322)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.710] [FATAL] databricksdelta_EXCEPTION_OCCURED_205

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.710] [ERROR] The following error occurred: [com.informatica.adapter.sdkadapter.exceptions.AdapterSDKException: [SDK_APP_COM_20000] error [No suitable driver found for EnableArrow=0;UID=token;PWD=dapif35000b8a83f7c61714477a7d4c95f68;UserAgentEntry=Informatica_IICS;]]

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.710] [ERROR] Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.710] [ERROR] Error occured while reading data using CCI Data Adapter com.informatica.cci.runtime.internal.utils.impl.CExceptionImpl: Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> CONNECTOR_10000 [2023-03-30 03:49:33.710] [ERROR] Error Occured while reading data from the source for Transformation - SQ_EIDB_MEN_MRE | Connector Name - databricksdelta - Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] com.informatica.cci.cloud.client.impl.CCIClientExceptionImpl: Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cci.cloud.client.impl.CCIRuntimeDataClientImpl.readData(CCIRuntimeDataClientImpl.java:309)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cloud.api.adapter.cci.reader.CCIRdrPartitionDriver.run(CCIRdrPartitionDriver.java:322)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] Caused by: com.informatica.cci.runtime.internal.utils.impl.CExceptionImpl: Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cci.runtime.impl.CDataAdapterImpl.read(CDataAdapterImpl.java:198)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cci.cloud.client.impl.CCIRuntimeDataClientImpl.readData(CCIRuntimeDataClientImpl.java:306)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] ... 1 more

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] com.informatica.powercenter.sdk.SDKException: Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cloud.api.adapter.cci.reader.CCIRdrPartitionDriver.run(CCIRdrPartitionDriver.java:326)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> SDKS_38200 [2023-03-30 03:49:33.710] Partition-level [SQ_EIDB_MEN_MRE]: Plug-in #606801 failed in run().

TRANSF_1_1_1> DBG_21511 [2023-03-30 03:49:33.711] TE: Fatal Transformation Error.

2 REPLIES 2

Anonymous
Not applicable

@Mahesh D​ :

Based on the error message, it seems that the issue could be related to the JDBC driver used by Informatica Cloud to connect to Databricks.

Here are a few suggestions you can try to troubleshoot the issue:

  1. Ensure that you have the correct JDBC driver version installed in Informatica Cloud to connect to Databricks. You may need to update the driver version to be compatible with your Databricks cluster.
  2. Verify that the Databricks connection properties (such as host, port, and authentication) are correctly configured in Informatica Cloud.
  3. Check that the SQL query is correctly formatted and that it returns valid results when run in Databricks.
  4. Try running the SQL query in a different SQL editor to ensure that it works correctly.
  5. Check the logs for any additional error messages that might provide more information about the issue.
  6. Contact Informatica Cloud support for further assistance.

I hope this helps you resolve the issue. Let me know if you have any further questions or concerns.

Anonymous
Not applicable

Hi @Mahesh D​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!