Skip to main content
Question

AGOL reader only read 2k out of approx 50k records but there was no error in the logfile

  • January 7, 2026
  • 1 reply
  • 21 views
markcoopersdc
Contributor
Forum|alt.badge.img+6

We have a workbench that runs daily via windows task scheduler which reads data from an Oracle database and ArcGIS Online and then writes to SQL Server. The process has run for some time but the other day there were some issues with the output dataset.

 

On viewing the log file, it appeared that only 2000 of aprximately 50,000 records were read from AGOL. However, there were no error messages to say that it han’t read the whole file.

 

Is there an easy way to build something into the workbench to sent a notification email to check that the whole file has been read in to prevent this issue happening again?

 

Thanks

      1 reply

      sammy
      Supporter
      Forum|alt.badge.img+24
      • sammySupporter
      • Supporter
      • January 7, 2026

      I had a similar issue with my portal feature service reader.

      Like you my process ran daily and was stable but then I had a one-off where it didn’t read everything in and then messed up the output because of that. No errors for my issue either.

      I ended up using http caller and terminator as  workaround.

      See my last comment on the thread here:

       

      The map is not the territory.

      Community Stats

      32,310
      Posts
      122,609
      Replies
      40,012
      Members

      Latest FME

      Terms & ConditionsCookie settingsAccessibility statement
      A product of
      Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.