Skip to main content
Question

FME server doesn't create log for failed workbench

  • April 11, 2024
  • 9 replies
  • 187 views

rob_m_esriuk
Contributor
Forum|alt.badge.img+5

We have a server running many jobs and one of them normally runs successfully and a log can be reviewed but at other times the job fails and when i access it i get the message Error: The log file for job ID "######" does not exist.

I’ve seen the post in FME Server 2019 Error: The log file for job ID "2613" does not exist and we have plenty of disk space, the job frequently works successfully, other jobs are still creating log files. I’ve checked all the suggestions in that post.

The failed job is recorded as running for a couple of seconds but without the log I have no insight into why it is failing

9 replies

hkingsbury
Celebrity
Forum|alt.badge.img+51
  • Celebrity
  • April 11, 2024

How are you triggering the job? I’ve had similar issues when a scheduled job runs, but couldn’t view the logs. Manually running it through Flow then alerted me to a custom transformer missing


todd_davis
Supporter
Forum|alt.badge.img+21
  • Supporter
  • April 12, 2024

You need to look at the “Result Data” on the Log page, as it will likely explain that the process has not started for a reason (and thus why the log hasn’t even started to be created)


rob_m_esriuk
Contributor
Forum|alt.badge.img+5
  • Author
  • Contributor
  • April 23, 2024
hkingsbury wrote:

How are you triggering the job? I’ve had similar issues when a scheduled job runs, but couldn’t view the logs. Manually running it through Flow then alerted me to a custom transformer missing

Hi

I don’t think anything is missing, this job normally runs to completion but when it doesn’t there is no log. The job is triggered through an automation, when i submit it manually it works - but then that is the norm anyway.


rob_m_esriuk
Contributor
Forum|alt.badge.img+5
  • Author
  • Contributor
  • April 23, 2024
todd_davis wrote:

You need to look at the “Result Data” on the Log page, as it will likely explain that the process has not started for a reason (and thus why the log hasn’t even started to be created)

This is running in server, there is no “result Data”, indeed no log at all!


todd_davis
Supporter
Forum|alt.badge.img+21
  • Supporter
  • April 23, 2024

Result data is part of the log page in FME Flow, rather than part of the log file. For instance:

 


rob_m_esriuk
Contributor
Forum|alt.badge.img+5
  • Author
  • Contributor
  • April 24, 2024
todd_davis wrote:

Result data is part of the log page in FME Flow, rather than part of the log file. For instance:

 

Thanks for that, it doesn’t give much away…. 

And the log file doesn’t exist on disk


rob_m_esriuk
Contributor
Forum|alt.badge.img+5
  • Author
  • Contributor
  • August 7, 2024

Now raised with Safe support. Engine is failing at the same time but not for every job submission


jonvelco
Contributor
Forum|alt.badge.img+3
  • Contributor
  • January 21, 2025

I’m seeing the same behavior.  I have an automation that runs every 5 minutes and sometimes it fails but there’s no log file created. 

Folder where logs are saved - notice the missing file for 62491

 


rob_m_esriuk
Contributor
Forum|alt.badge.img+5
  • Author
  • Contributor
  • January 22, 2025
jonvelco wrote:

I’m seeing the same behavior.  I have an automation that runs every 5 minutes and sometimes it fails but there’s no log file created. 

Folder where logs are saved - notice the missing file for 62491

 

When we looked in the server logs there was a corresponding engine failure and I was offered a potential fix by SAFE….

By setting these parameters to 1 the jobs will restart after every run. This can lead to a clean engine and prevent any issues with previously loaded dll's and Python interpreters.  The restart of the engines should take less than a second. Even if this isn't a long term solution it would be great if we can test this to refine the issue.
In: C:\Program Files\FMEFlow\Server\fmeServerConfig.txt
 
MAX_TRANSACTION_RESULT_SUCCESSES=1
MAX_TRANSACTION_RESULT_FAILURES=1”

We have a very busy server and obviously there is an overhead in this as the engine restart takes resources. However I did try it and setting the parameters to 1 seemed to fix the problem  but according to the logs this added about .5s to the task. Reverting the parameter values caused the failures to reappear.

Ultimately the failing job was doing a huge amount of work at startup with many readers and filtering in the workbench. I replaced them with SQL Creators with quite complex but efficient SQL to pre-filter the rows and reduce the read overhead considerably. Not only did the issue disappear but also the workbench ran considerably faster.

 

Hope this helps

Rob

 


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings