GroupBy in a multi node environment

[RajuNagarajan]

I have a group of rows with Information on a nested product calls.

example-

Trxn1-product1-caller1-local1

Trxn1-Product1-local1-local2

Trxn1-Product1-local2-local3

here’s is a expected calls for a product

product1-caller1-local1

Product1-local1-local2

Product1-local2-local3

Product1-local3-local4

Product1-local4-local5

now I need to create one additional record to my dataframe

Trxn1-product1-local3-local4. Picking only this coz, that’s the first missing link in the chain based on where it failed.

Like Trxn1, I have 10000s of them and I need to group these by transaction Id and apply the condition based on the product.

Trying if for loop is taking a

[Kaniz_Fatma]

Hi @ RajuNagarajan! My name is Kaniz, and I'm a technical moderator here. Great to meet you, and thanks for your question! Let's see if your peers on the Forum have an answer to your questions first. Or else I will follow up shortly with a response.