I have a issue in which your urgent help is required.
I have a shared FME flow 2023.1 database which is accessed via two nodes. Both nodes have 5 engines each.
When I check from fme flow url I can see all 10 engines ( 5 from each node) available. But if jobs are fired then only 5 engines become available and 5 always show idle.
Please help to resolve this issue as it is stopping us from upgrading to latest FME flow.
Are the 5 idle engines all from one node?
My first idea is that maybe they're not hooked up to job queues, maybe due to a different name. Normally the name of the node is used in the engine name and if the queue assignment is using a different name you can have something like this happening.
Are the 5 idle engines all from one node?
My first idea is that maybe they're not hooked up to job queues, maybe due to a different name. Normally the name of the node is used in the engine name and if the queue assignment is using a different name you can have something like this happening.
Yea, i'd have a look at your engine assignment rules to check they're being correctly assigned to queues
I counterchecked and all 10 engines (node1_Engine1 till node1_Engine5 and node2_Engine1 till node2_Engine5) all are assigned to default queue. I also verified that any job I am submitting is going to default queue. But still only 5 engines actively start processing and 5 remain idle.
Thanks for taking time to answer my query.
I have a doubt if you can help me verify.
Check these two scenarios:
Scenario1: If I submit a job to url https://node1/fmeserver then all 5 engines of node1 are used.
Scenario2: If I submit a job to url https://node2/fmeserver then all 5 engines of node2 are used.
Question1: Is this the correct way to submit jobs for two active nodes sharing same database?
Question2: Should there be a common url which should hit a load balancer and then should assign the jobs to either node1 or node2?
Question3: If the answer to question2 is yes then: My organization has made it clear that they do not have budget for a load balancer server. In that case how should I achieve node1 node2 both active and sharing a same database.
Question4: No matter if I use https://node1/fmeserver or https://node2/fmeserver, I see same jobs and same 10 engines present. That means the database is being shared by both node1 and node2. In this case if job submitted from node1 is not being submitted to node2 engines... could that be a product bug in fme flow 2023.1?
I counterchecked and all 10 engines (node1_Engine1 till node1_Engine5 and node2_Engine1 till node2_Engine5) all are assigned to default queue. I also verified that any job I am submitting is going to default queue. But still only 5 engines actively start processing and 5 remain idle.
Thanks for taking time to answer my query.
I have a doubt if you can help me verify.
Check these two scenarios:
Scenario1: If I submit a job to url https://node1/fmeserver then all 5 engines of node1 are used.
Scenario2: If I submit a job to url https://node2/fmeserver then all 5 engines of node2 are used.
Question1: Is this the correct way to submit jobs for two active nodes sharing same database?
Question2: Should there be a common url which should hit a load balancer and then should assign the jobs to either node1 or node2?
Question3: If the answer to question2 is yes then: My organization has made it clear that they do not have budget for a load balancer server. In that case how should I achieve node1 node2 both active and sharing a same database.
Question4: No matter if I use https://node1/fmeserver or https://node2/fmeserver, I see same jobs and same 10 engines present. That means the database is being shared by both node1 and node2. In this case if job submitted from node1 is not being submitted to node2 engines... could that be a product bug in fme flow 2023.1?
It sounds like you need to go back to the drawing board re. your setup. I think you may have inadvertently mixed some things up so that you have basically two separate FME Flow installs, each with 5 engines, but both can see (but not use) the 5 engines of the other one. This presumably also means you have 2 serial numbers.
It should be possible to have just one FME Flow install with some of its engines located on another machine. That's covered in the FME Flow Administrator guide (look for the Distributed Engine sections)
Thanks for sharing the guide.
I have single serial number which has all 10 licenses