Get failed records from Salesforce write target tool in AWS GLUE job

[poorni_sm]

I am working in the AWS GLUE service, where we are trying to migrate data from S3 to salesforce using Salesforce write target tool(Using Salesforce connection). The actual process has to be, once the process is done, the salesforce provides the jobId or the failed record data. But here, the glue job is returning null. Is there a way to get the failed records from the respective job?

[emillion25]

When troubleshooting AWS Glue jobs that return null during data migration from S3 to Salesforce, consider the following questions to better understand the issue:

1. Databricks Integration: How is Databricks integrated into your data processing workflow? This could help pinpoint if the issue is occurring during data preprocessing or elsewhere.
2. EventBridge Usage: Could AWS EventBridge manage this workflow more effectively, especially for monitoring or triggering based on job statuses?
3. Dataset Size: What is the size of your S3 dataset? Large datasets might require optimization in batch processing to improve performance.
4. Salesforce API Handling: Have you checked how the Salesforce Batch/API responses are handled, particularly for failed records? Ensuring that these responses are captured correctly is crucial.

Additionally, ensure that your Salesforce connection settings are correct, and that the AWS Glue service role has the necessary permissions to read from S3. Review your Glue script for accurate data mappings and effective error handling. Enable detailed logging with AWS CloudWatch to identify specific errors or exceptions that might be causing the job to return null.

Lastly, consider running the job on a smaller subset of data and manually inserting records into Salesforce to verify the entire process. Monitoring and alerts via AWS CloudWatch or SNS can also help in promptly addressing job issues.

[jhonm_839]

Thank you so much emillion. This helps me a lot. Keep it up!