Question

How to read multiple csv with dynamic URL ?

  • 12 November 2019
  • 4 replies
  • 4 views
G

Hello I have a problem,

I try to read multiple csv from an URL that changes.

An exemple of URL :

I tried to use an HTTPCaller and it works but I don't know how to treat the result. I don't find any transformer that can help me to translate this string "csv" into a list of attribute.

If someone can help me it could be great please.

 

 

Here are two images of what I get with httpcaller :

4 replies

ebygomm
Rank
Userlevel 1
Badge +21

You can use the httpcaller to save the response to a file(s) and then use a featurereader to read the csv file(s) back in.

G

You can use the httpcaller to save the response to a file(s) and then use a featurereader to read the csv file(s) back in.

Mmh it could work but I save all the csv into one file ?

ebygomm
Rank
Userlevel 1
Badge +21

Mmh it could work but I save all the csv into one file ?

I'd save to multiple files, they can always be deleted later. The other option is to use an attribute exploder to split by line, followed by another attribute exploder to split at the semi colon, then rename the resulting list elements as per the csv structure.

G

I'd save to multiple files, they can always be deleted later. The other option is to use an attribute exploder to split by line, followed by another attribute exploder to split at the semi colon, then rename the resulting list elements as per the csv structure.

Ok actually your first answer worked pretty well. Thank you very much !

Reply


Community Stats

28,723
Posts
109,511
Replies
36,559
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.