Question

How to go through large set of csv files

W

I have a model that has to select rows(points) out of a large collection of large csv files. To encrease performance I want to go throught them one by one. What is the best way to do this?

3 replies

dustin
Rank
Userlevel 3
Badge +26

You can select multiple files to read at one time in the dropdown of the reader/parameter.image

W

Thanks for your replay! this does work. But I have found that workspacerunner also works to go through them one by one

 

dustin
Rank
Userlevel 3
Badge +26

Thanks for your replay! this does work. But I have found that workspacerunner also works to go through them one by one

 

WorkspaceRunner does use a little more overhead, as it is opening a separate process for each input. But as long as it's working for you. That's the beauty of FME...multiple ways to arrive at the destination.👍

Reply


Community Stats

28,731
Posts
109,530
Replies
36,565
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.