Skip to main content
Question

How to go through large set of csv files


wrijs
Contributor
Forum|alt.badge.img+3
  • Contributor

I have a model that has to select rows(points) out of a large collection of large csv files. To encrease performance I want to go throught them one by one. What is the best way to do this?

3 replies

dustin
Influencer
Forum|alt.badge.img+30
  • Influencer
  • May 8, 2023

You can select multiple files to read at one time in the dropdown of the reader/parameter.image


wrijs
Contributor
Forum|alt.badge.img+3
  • Author
  • Contributor
  • May 23, 2023

Thanks for your replay! this does work. But I have found that workspacerunner also works to go through them one by one

 


dustin
Influencer
Forum|alt.badge.img+30
  • Influencer
  • May 23, 2023
wrijs wrote:

Thanks for your replay! this does work. But I have found that workspacerunner also works to go through them one by one

 

WorkspaceRunner does use a little more overhead, as it is opening a separate process for each input. But as long as it's working for you. That's the beauty of FME...multiple ways to arrive at the destination.👍


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings