Question

httpfetcher but with POST?

  • 10 September 2013
  • 4 replies
  • 1 view
G
Badge
Hi,

 

I would like to use the httpfetcher to grab a websites source html. But since it does not support POST, I am limited to only reciveving the first 512 signs..

 

Any workaround available?

4 replies

david_r
Rank
Userlevel 4
Hi,

 

 

I've never tried it myself, but have you looked at the HTTPUploader transformer? It supports POST and will (as far as I can tell) store the reponse data in an attribute, much like the HTTPFetcher.

 

 

David
fmelizard
Rank
Userlevel 4
Badge +13
Hi,

 

 

Beside the HTTP fetcher I dont really see any other option.

 

Can you provide a link to one of the websites?

 

 

Itay
david_r
Rank
Userlevel 4
If you can't get the HTTPUploader to work, your best bet might be to use a PythonCaller and the excellent urllib2 module. This would perhaps entail a bit more work than you might have hoped for, but would give you a lot of flexibility.

 

 

David
G
Badge

Hi guys,

 

unfortuainly i didnt get the HTTPUploader to work..

 

So python seems to be the way to go here.

 

Thank you

Reply


Community Stats

28,669
Posts
109,364
Replies
36,531
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.