Skip to main content
  • EN

Hi,

How can I split a large dataset into multiple CSV datasets?

I have to split them so that each record contains max 5 million datas (rows).

I have about 25 mils of data. So need to have about 5 separated CSVs.

How can I set the writer (or reader) or maybe which transformer ta add to splitt them after writing 5 mils of them?

Thanks a lot!

Look at the custom transformer grouper - you can set this to 5 million and use the group count to fan out your csv

Reply


Community Stats

31,821
Posts
120,862
Replies
39,452
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.