Skip to main content
Question

httpfetcher but with POST?

  • September 10, 2013
  • 4 replies
  • 5 views

Forum|alt.badge.img
Hi,

 

I would like to use the httpfetcher to grab a websites source html. But since it does not support POST, I am limited to only reciveving the first 512 signs..

 

Any workaround available?

4 replies

david_r
Evangelist
  • September 10, 2013
Hi,

 

 

I've never tried it myself, but have you looked at the HTTPUploader transformer? It supports POST and will (as far as I can tell) store the reponse data in an attribute, much like the HTTPFetcher.

 

 

David

fmelizard
Contributor
Forum|alt.badge.img+17
  • Contributor
  • September 10, 2013
Hi,

 

 

Beside the HTTP fetcher I dont really see any other option.

 

Can you provide a link to one of the websites?

 

 

Itay

david_r
Evangelist
  • September 10, 2013
If you can't get the HTTPUploader to work, your best bet might be to use a PythonCaller and the excellent urllib2 module. This would perhaps entail a bit more work than you might have hoped for, but would give you a lot of flexibility.

 

 

David

Forum|alt.badge.img
  • Author
  • September 11, 2013

Hi guys,

 

unfortuainly i didnt get the HTTPUploader to work..

 

So python seems to be the way to go here.

 

Thank you

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings