Hello,
I think it would be a good idea to have another parameter for the SQS publication: Max Number of Messages.
My scenario is as follows:
Multiple FME Servers are polling new messages from SQS. Each message should trigger a FME Workspace, which will eventually remove the message from the queue if successfull. Basically, a load balancer for FME Server.
Current Status:
If multiple messages enter the queue very fast, the first FME Server to poll for new messages will basically grab all messages. Therefore, you have to work a lot with SQS visibility timeouts and FME queued job expiry times to achieve an equal job distribution.
The parameter MaxNumberOfMessages should be available in the SQS API: https://docs.aws.amazon.com/AWSSimpleQueueService/latest/APIReference/API_ReceiveMessage.html
What do you think?
Kind regards,
Dennis
