Hi,
How can I split a large dataset into multiple CSV datasets?
I have to split them so that each record contains max 5 million datas (rows).
I have about 25 mils of data. So need to have about 5 separated CSVs.
How can I set the writer (or reader) or maybe which transformer ta add to splitt them after writing 5 mils of them?
Thanks a lot!
Best answer by ebygomm
Look at the custom transformer grouper - you can set this to 5 million and use the group count to fan out your csv
+39Look at the custom transformer grouper - you can set this to 5 million and use the group count to fan out your csv
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
