The scenario is : An httpCaller inside a costum with parellism active to send requests in parallel.
Im trying to find if there is a way to have a featureWriter or any other writing solution inside a parallel costum so that it writes the results/ httpCaller responses as they get processed by each parallel child fmeworker.
As far as i understand FME queues all results of each child fmeworker into an internal buffer and when all its done it outputs results out of the costum to proceed on the pipeline.
Happens that, sometimes parallism crashes with ERROR like below not beeing able to keep track of what was done previously .
I tried to wrap a featureWriter inside the parallel costum transf hopping that it would write the results in realtime during the parallel process into a database, but it looks like it stills writing only at the end of all child processes end sucessfully.
im using FME 2018.1 Build 18547 - WIN64
2019-10-03 10:46:58| 960.1| 28.3|ERROR |Error in child process '0', exited with code '1'
2019-10-03 10:46:58| 960.1| 0.0|INFORM|Translation FAILED with 3 error(s) and 0 warning(s) (0 feature(s) output)
2019-10-03 10:46:58| 960.1| 0.0|INFORM|FME Session Duration: 11 hours 45 minutes 24.2 seconds. (CPU: 862.2s user, 96.5s system)
