Question

Workspace runs with service account in Desktop but not completely in FME Server

  • 12 November 2021
  • 2 replies
  • 9 views

Badge +5

Have two workspaces that when I run it under my account or the service account on the server, it runs fine, published to FME Server and set up automation. It APPEARS to run (one workspace checks for the latest zip file in a directory on a file share and then copies to the resources directory and unzips on the server - this works as it should under both accounts and in FME server when run separately thru Run Workspace). The second workspace is to process the data that was unzipped and place in the resources directory - the files are separated into two directories due to how the vendor supplies the data for download - the script will read this data via either account. It will operate as expected when run with Workbench. Running via Server it processes, but when I look at the output data, not all of it is there! The csv files appear to be appending to the tables in the SDE. The graphic data doesn't even show that it attempted to write to the feature class. I'm stumped. The graphic data is being run thru a clipper to exclude any that are not within our jurisdiction. The output is then joined to the data from the Events csv file and has fme_db_operation of Insert added as a column if the call doesn't already exist in the SDE (fme_db_operation of update if it does exist). I'm using change detector, maybe I should use CRCcalculator and tests instead?

 

Excerpt from the log file run by FME Server.

 

  • 2021-11-15 13:07:26 | =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
  • 2021-11-15 13:07:26 | Features Read Summary
  • 2021-11-15 13:07:26 | =-=-=-=--=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
  • 2021-11-15 13:07:26 | CSV 21200
  • 2021-11-15 13:07:26 | CityLimits_GIS 1
  • 2021-11-15 13:07:26 | TrafficCrashData 26928 This data is in the SDE that is being appended to
  • 2021-11-15 13:07:26 | s4_mapped_crashes 18567 This is the data to be processed and appended there would be a number lower than this to be appended due to a clipper using the City Limits
  • 2021-11-15 13:07:26 | ===============================================================
  • 2021-11-15 13:07:26 | Total Features Read 66696
  • 2021-11-15 13:07:26 | =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-==-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
  • 2021-11-15 13:07:26 | =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
  • 2021-11-15 13:07:26 | Features Written Summary These are the csv files, they are writing to the SDE with the same user as the graphic data
  • 2021-11-15 13:07:26 | =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
  • 2021-11-15 13:07:26 | Signal4_BikeTyping 31
  • 2021-11-15 13:07:26 | Signal4_Driver 6185
  • 2021-11-15 13:07:26 | Signal4_Events 3472
  • 2021-11-15 13:07:26 | Signal4_NonMotorist 112
  • 2021-11-15 13:07:26 | Signal4_Passenger 2579
  • 2021-11-15 13:07:26 | Signal4_PedTyping 43
  • 2021-11-15 13:07:26 | Signal4_Vehicle 6817
  • 2021-11-15 13:07:26 | Signal4_Violation 1961
  • 2021-11-15 13:07:26 | ================================================================
  • 2021-11-15 13:07:26 | Total Features Written 21200
  • 2021-11-15 13:07:26 | =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
  • 2021-11-15 13:07:26 | Translation was SUCCESSFUL with 1 warning(s) (21200 feature(s) output)
  • 2021-11-15 13:07:27 | FME Session Duration: 45.2 seconds. (CPU: 33.3s user, 2.3s system)
  • 2021-11-15 13:07:27 | END - ProcessID: 20744, peak process memory usage: 1371720 kB, current process memory usage: 152452 kB

 

Any help out there?

Thanks,

Lorinda


2 replies

Userlevel 4
Badge +26

My only suggestion is to throw in a few loggers into the worksapce to help see where data are (and aren't) going in the workflow. There is also 1 warning in the log, perhaps that holds a clue.

Differences on FME Server and FME Desktop problems are annoying.

Badge +5

Hmm.. Logger doesn't show anything out of the ordinary. Interestingly, after adding the logger, it worked once, appending the data, then it didn't after that, then it might. VERY intermittent. The warning is that some of the columns in the csvs are truncated - nothing serious.

Guess I need to get with Tech Support. I've tried to compress the db since I've been running it so many times, have tried resetting the connection file - it is the data owner for the SDE.

Reply