cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Informatica Cloud mapping with Databricks connection failing with java.util.NoSuchElementException

MaheshDR
New Contributor II

‎03-29-2023 10:03 AM

Hi Team,

When we tried to configure our source with Databricks table with Databricks connection on Informatica Cloud, we received below error.

We already tried the suggestions mentioned in the below community post which seems to be similar error as ours.

https://community.databricks.com/s/question/0D53f00001HKIEHCA5/while-loading-data-from-blob-to-delta...

The highlighted query is running fine on Databricks SQL editor.

Please review and advise

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.654] [INFO] SQL QUERY: SELECT `hash_key`,`mre_code`,`mre_mrcc` FROM `sitsint`.`eidb_men_mre` WHERE EIDB_MEN_MRE.RECORD_STATUS<>'D'

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.704] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] java.util.NoSuchElementException

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at java.util.StringTokenizer.nextToken(StringTokenizer.java:349)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.simba.spark.jdbc.common.BaseConnectionFactory.acceptsURL(Unknown Source)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.simba.spark.jdbc.common.AbstractDriver.connect(Unknown Source)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at java.sql.DriverManager.getConnection(DriverManager.java:664)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at java.sql.DriverManager.getConnection(DriverManager.java:270)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.adapter.databricksdelta.runtime.adapter.DatabricksdeltaDatabricksdeltaDataConnection.connect(DatabricksdeltaDatabricksdeltaDataConnection.java:124)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.adapter.databricksdelta.runtime.adapter.read.DeltaJdbcReader.initDataSession(DeltaJdbcReader.java:73)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.adapter.databricksdelta.runtime.adapter.DatabricksdeltaDatabricksdeltaDataAdapter.beginDataSession(DatabricksdeltaDatabricksdeltaDataAdapter.java:145)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.cci.runtime.impl.CDataAdapterImpl.read(CDataAdapterImpl.java:195)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.cci.cloud.client.impl.CCIRuntimeDataClientImpl.readData(CCIRuntimeDataClientImpl.java:306)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.705] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.705] [ERROR] at com.informatica.cloud.api.adapter.cci.reader.CCIRdrPartitionDriver.run(CCIRdrPartitionDriver.java:322)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.710] [FATAL] databricksdelta_EXCEPTION_OCCURED_205

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.710] [ERROR] The following error occurred: [com.informatica.adapter.sdkadapter.exceptions.AdapterSDKException: [SDK_APP_COM_20000] error [No suitable driver found for EnableArrow=0;UID=token;PWD=dapif35000b8a83f7c61714477a7d4c95f68;UserAgentEntry=Informatica_IICS;]]

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.710] [ERROR] Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> DATABRICKSDELTA_10000 [2023-03-30 03:49:33.710] [ERROR] Error occured while reading data using CCI Data Adapter com.informatica.cci.runtime.internal.utils.impl.CExceptionImpl: Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> CONNECTOR_10000 [2023-03-30 03:49:33.710] [ERROR] Error Occured while reading data from the source for Transformation - SQ_EIDB_MEN_MRE | Connector Name - databricksdelta - Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] com.informatica.cci.cloud.client.impl.CCIClientExceptionImpl: Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cci.cloud.client.impl.CCIRuntimeDataClientImpl.readData(CCIRuntimeDataClientImpl.java:309)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cloud.api.adapter.cci.reader.CCIRdrPartitionDriver.run(CCIRdrPartitionDriver.java:322)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] Caused by: com.informatica.cci.runtime.internal.utils.impl.CExceptionImpl: Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cci.runtime.impl.CDataAdapterImpl.read(CDataAdapterImpl.java:198)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cci.cloud.client.impl.CCIRuntimeDataClientImpl.readData(CCIRuntimeDataClientImpl.java:306)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] ... 1 more

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] com.informatica.powercenter.sdk.SDKException: Read Failed. Internal Error: Adapter BeginDataSession failed

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> JAVA PLUGIN_1762 [2023-03-30 03:49:33.710] [ERROR] at com.informatica.cloud.api.adapter.cci.reader.CCIRdrPartitionDriver.run(CCIRdrPartitionDriver.java:326)

READER_1_1_1> CMN_1761 [2023-03-30 03:49:33.710] Timestamp Event: [Thu Mar 30 03:49:33 2023]

READER_1_1_1> SDKS_38200 [2023-03-30 03:49:33.710] Partition-level [SQ_EIDB_MEN_MRE]: Plug-in #606801 failed in run().

TRANSF_1_1_1> DBG_21511 [2023-03-30 03:49:33.711] TE: Fatal Transformation Error.

Labels:
0 Kudos
2 REPLIES 2

Anonymous
Not applicable

‎04-02-2023 07:02 AM

@Mahesh D​ :

Based on the error message, it seems that the issue could be related to the JDBC driver used by Informatica Cloud to connect to Databricks.

Here are a few suggestions you can try to troubleshoot the issue:

  1. Ensure that you have the correct JDBC driver version installed in Informatica Cloud to connect to Databricks. You may need to update the driver version to be compatible with your Databricks cluster.
  2. Verify that the Databricks connection properties (such as host, port, and authentication) are correctly configured in Informatica Cloud.
  3. Check that the SQL query is correctly formatted and that it returns valid results when run in Databricks.
  4. Try running the SQL query in a different SQL editor to ensure that it works correctly.
  5. Check the logs for any additional error messages that might provide more information about the issue.
  6. Contact Informatica Cloud support for further assistance.

I hope this helps you resolve the issue. Let me know if you have any further questions or concerns.

0 Kudos

Anonymous
Not applicable

‎04-03-2023 11:30 PM

Hi @Mahesh D​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

0 Kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Announcements