Hi,
I have an FME server job submitter workbench. A creator submits the jobs, then goes to a job waiter and logfile retriever.
In order to not tie up an engine with the submitting bench due to the job waiter, in 2016 I write job metadata to a spread sheet using a feature writer and then output to another job submitter that has the job waiter inside that set to run last.
If that job submitter detects any failures, it will attempt to rerun that bench once more (and only once more).
I want to be able to write more metadata to the same spreadsheet, and have the bench that runs a second attempt at failures, dynamically run what the spreadsheet says to be run again. What we do now is copy the original Submitter bench, and then use a manually defined attribute filter to match workbench names from the spreadsheet to do the second run.
Anyone have any ideas on how I can achieve this? Thinking HTTP caller with some of the system server parameters exposed from the original Submitter on server. But some of the server parameters are blank or will fail the bench if I expose them (FME_SERVER_DEST_DIR for example).
What would be ideal is having the Job Submitter transformer allow for "repository name", "selected item name" (workbench_name.fmw), "wait for job", "job priority", "job tag" to be set by attributes
Then by default use "As Specified in Workspace and Parameters" and by default use the parameters set when published.
Thanks,
Aaron
Edit 1:
I've been successful using the HTTP caller with manually grabbing the DIRECT URL EXAMPLE from the workspace on the server.
However I would need to be able to dynamically retrieve the direct url example for each bench run.
But even this method is not ideal because a Job ID is not retrieved in the end (to check if success or fail and email accordingly) and the bench running the HTTP caller (using get method) still needs to wait for the a response before finishing the workspace (thus still tying up 2 engines).