Hi All,

I have a few streaming jobs running but we have been facing an issue related to messaging. We have multiple feeds within the same root rolder i.e. logs/{accountId}/CloudWatch|CloudTrail|vpcflow/yyyy-mm-dd/logs. Hence, the SQS allows to setup only one instance to the folder and we can't use wildcards.

We've tried to setup an eventbridge to filter the messages and consume from autoloader, but with this approach autoloader is not consuming the messages correctly, neither deleting them when reading.

Is there any way to setup autoloader using eventbridge between the SQS and the streamming?

Thanks