Skip to main content
  • EN
I have a CSV output file which is currently 54mb. 

 

I need to upload it in a system which has a limit of 5mb. 

 

 

Is there a way of limiting the writer to 5mb limit and then write to another CSV. 

 

 

i.e. I want to get 11 csv's of the same data. Ideally with a counter in the name i.e. upload1, upload2, etc.

 

 

Is there a way of either setting a writter parameter or a transformer to do this? 

 

 

 

Hi,

 

 

one way to do it:
  • find out approximately how many lines it takes to get 5MB
  • use a ModuloCounter set to this number (or slightly lower to be conservative)
  • use _modulo_count as a basis for a feature fanout

 

David
Many thanks. 

Reply


Community Stats

30,108
Posts
114,295
Replies
37,743
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.