Skip to main content
Question

httpfetcher but with POST?

  • September 10, 2013
  • 4 replies
  • 17 views

Forum|alt.badge.img
Hi,

 

I would like to use the httpfetcher to grab a websites source html. But since it does not support POST, I am limited to only reciveving the first 512 signs..

 

Any workaround available?
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

4 replies

david_r
Celebrity
  • September 10, 2013
Hi,

 

 

I've never tried it myself, but have you looked at the HTTPUploader transformer? It supports POST and will (as far as I can tell) store the reponse data in an attribute, much like the HTTPFetcher.

 

 

David

fmelizard
Safer
Forum|alt.badge.img+21
  • Safer
  • September 10, 2013
Hi,

 

 

Beside the HTTP fetcher I dont really see any other option.

 

Can you provide a link to one of the websites?

 

 

Itay

david_r
Celebrity
  • September 10, 2013
If you can't get the HTTPUploader to work, your best bet might be to use a PythonCaller and the excellent urllib2 module. This would perhaps entail a bit more work than you might have hoped for, but would give you a lot of flexibility.

 

 

David

Forum|alt.badge.img
  • Author
  • September 11, 2013

Hi guys,

 

unfortuainly i didnt get the HTTPUploader to work..

 

So python seems to be the way to go here.

 

Thank you