Skip to main content
Question

Read CSV as a _list

A
Forum|alt.badge.img

Hi Community,

Is it possible to read a csv file as a _list already from CSV Reader or is there another list (element) reader that can be used?

 

Reason is that i have a very large CSV file containing 24 million rows, and i'm generating a list after it's been read in through the CSV reader.

 

Would be great if it were possible to read a txt/csv file as a list from start to avoid the additional time spent on generating the list.

 

Cheers

andre

2 replies

davtorgh
Contributor
Forum|alt.badge.img+11
  • davtorghContributor
  • Contributor
  • December 4, 2020

Hi @andre​ ,

 

you are basically requesting to anticipate the list construction, but I think this only shifts the workload and does not solve the performance problem.

A
Forum|alt.badge.img
  • andre
  • Author
  • December 4, 2020
davtorgh wrote:

Hi @andre​ ,

 

you are basically requesting to anticipate the list construction, but I think this only shifts the workload and does not solve the performance problem.

yeah, i get what you referring to.. it only took 58 minutes to process so not too bad considering the performance

Reply


Helpful Members This Week

Community Stats

31,525
Posts
119,505
Replies
39,152
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.