I have a model that has to select rows(points) out of a large collection of large csv files. To encrease performance I want to go throught them one by one. What is the best way to do this?
Question
How to go through large set of csv files
+31- Influencer
You can select multiple files to read at one time in the dropdown of the reader/parameter.
+5- Contributor
Thanks for your replay! this does work. But I have found that workspacerunner also works to go through them one by one
+31- Influencer
Thanks for your replay! this does work. But I have found that workspacerunner also works to go through them one by one
WorkspaceRunner does use a little more overhead, as it is opening a separate process for each input. But as long as it's working for you. That's the beauty of FME...multiple ways to arrive at the destination.👍
Login to the community
No account yet? Create an account
An FME Account is required to contribute
LoginEnter your E-mail address. We'll send you an e-mail with instructions to reset your password.