Skip to main content
Archived

True Looper

Related products:Transformers
  • October 25, 2019
  • 1 reply
  • 5 views

I'd like to see a Creator that can take in a list, SQL Statement, etc... That will grab the first item and FULLY run through the whole workspace and then go back to the beginning , grab next and do again. I have massive amounts of shape files on an S3 bucket that I need to grab one at a time and process. The server wouldn't need a huge harddrive as I can delete before getting next item. Seems like a simple thing to do, but has been very tough to do. I still can't do it effectively.

This post is closed to further activity.
It may be a question with a best answer, an implemented idea, or just a post needing no comment.
If you have a follow-up or related question, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

jdh
Contributor
Forum|alt.badge.img+28
  • Contributor
  • October 25, 2019

The classic way to do that is with a controller workspace and a worker workspace. The worker workspace processes the data and has as a parameter the file to process. The controller workspace contains a Directory and File Pathnames reader and a workspaceRunner. This triggers the worker space once for every feature read in by the pathnames reader.

 

 

Alternatively, you can use batch deploy.

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings