Question

Reading CSV file via directory path and FeatureReader - Get Duplicate records.


Hello everyone,

 

I used "featureReader" to read all CSV files from a specific directory via DirectoryPath and it works fine with me but I am surprised a little bit why I got duplicate data.

 

For example, if I have 3 files, it counts the read 9. What is the best way to ready all CSV files fast and quickly?

 

Do you advise to enable the cache files?

 


5 replies

Userlevel 5
Badge +29

How many features do you have going into the featureReader? If you have three features going in, you are asking FME to perform that read three times, hence the duplicates

Hi,

I am having the same issue. I have a directory reader to extract gdb from multiple folders. Then I feed the result to a FeatureReader but everything is duplicated. In my example, I have 2 features going from the reader to Feature reader which is correct in my case since there are two gdbs. I don't understand why FME would be executing the Feature Reader twice? Isn't it just reading each gdb ONCE? Otherwise, how are we supposed to program it not to double output data?

first reader outputs 2 gdbfeatureReader outputs doubled 

Kind regards,

Anne-Marie

 

 

Badge +7

Hi,

I am having the same issue. I have a directory reader to extract gdb from multiple folders. Then I feed the result to a FeatureReader but everything is duplicated. In my example, I have 2 features going from the reader to Feature reader which is correct in my case since there are two gdbs. I don't understand why FME would be executing the Feature Reader twice? Isn't it just reading each gdb ONCE? Otherwise, how are we supposed to program it not to double output data?

first reader outputs 2 gdbfeatureReader outputs doubled 

Kind regards,

Anne-Marie

 

 

Same issue with FeatureReader here. Any solution to this? Thanks.

Userlevel 3
Badge +26

Same issue with FeatureReader here. Any solution to this? Thanks.

@sigbono​ Can you provide some specifics of what you are seeing? It seems the previous issues were due to multiple features being fed to the FeatureReader.

Badge +7

Same issue with FeatureReader here. Any solution to this? Thanks.

@dustin​ This might be the case. I just added a Tester to filter out the specific path and the issue was solved.

Reply