Skip to main content
Question

Optimizing ArcGIS Online Writer to avoid time out error 504


messagemauri
Contributor
Forum|alt.badge.img+6

Currently using FME 2018 Desktop. I have a workbench using the AGOL Writer to write a large data set to an ArcGIS Online Feature Service layer as follows:

Writer mode: INSERT

Truncate First: Yes

Features per request set to 1000

When executing the workbench, sometimes it works and sometimes it Fails and gives the output time out error 504.

What's the best approach to optimize the AGOL Writer or the workbench to avoid timeout issues with AGOL?

 

Thank you.

 

 

 

4 replies

lars_de_vries
Forum|alt.badge.img+10

In such cases I do the following:

  1. I reauthenticate the AGOL web connection through Tools > FME options > Web connections > right mouse click on connection and select 'reauthenticate'.
  2. You can set the 'Features per request' lower to e.g. 500.

If it still fails, you might want to use another approach, because it will be hard to trace which features (sets) have been uploaded and which haven't.

I'm such cases you could prepare the sets in different tables or databases. Next you can create a new workspace with a WorkspaceRunner. The WorkspaceRunner can call the original workspace. With the new workspace you make sure every dataset is provided.

In the last scenario you'll have a good control of which sets have been written and which ones haven't. Now it is much easier to retry the ones that have failed.


messagemauri
Contributor
Forum|alt.badge.img+6
  • Author
  • Contributor
  • June 21, 2019
lars_de_vries wrote:

In such cases I do the following:

  1. I reauthenticate the AGOL web connection through Tools > FME options > Web connections > right mouse click on connection and select 'reauthenticate'.
  2. You can set the 'Features per request' lower to e.g. 500.

If it still fails, you might want to use another approach, because it will be hard to trace which features (sets) have been uploaded and which haven't.

I'm such cases you could prepare the sets in different tables or databases. Next you can create a new workspace with a WorkspaceRunner. The WorkspaceRunner can call the original workspace. With the new workspace you make sure every dataset is provided.

In the last scenario you'll have a good control of which sets have been written and which ones haven't. Now it is much easier to retry the ones that have failed.

Thank you @lars_de_vries! Will give it a shot.


runneals
Contributor
Forum|alt.badge.img+20
  • Contributor
  • June 21, 2019

It's a known issue. Believed to be caused by Amazon Cloudfront caching. Working with esri support and development to resolve. Follow this thread for updates: https://knowledge.safe.com/questions/84687/arcgis-online-readerwriter-error-code-503.html


messagemauri
Contributor
Forum|alt.badge.img+6
  • Author
  • Contributor
  • June 21, 2019
runneals wrote:

It's a known issue. Believed to be caused by Amazon Cloudfront caching. Working with esri support and development to resolve. Follow this thread for updates: https://knowledge.safe.com/questions/84687/arcgis-online-readerwriter-error-code-503.html

Thanks for the update link


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings