Skip to main content
Question

httpfetcher but with POST?

  • Sep 10, 2013 11:05 AM UTC
  • 4 replies
  • 40 views

Forum|alt.badge.img
Hi,

 

I would like to use the httpfetcher to grab a websites source html. But since it does not support POST, I am limited to only reciveving the first 512 signs..

 

Any workaround available?
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

4 replies

david_r
Celebrity
  • Sep 10, 2013 11:23 AM UTC
Hi,

 

 

I've never tried it myself, but have you looked at the HTTPUploader transformer? It supports POST and will (as far as I can tell) store the reponse data in an attribute, much like the HTTPFetcher.

 

 

David

fmelizard
Safer
Forum|alt.badge.img+22
  • Safer
  • Sep 10, 2013 1:01 PM UTC
Hi,

 

 

Beside the HTTP fetcher I dont really see any other option.

 

Can you provide a link to one of the websites?

 

 

Itay

david_r
Celebrity
  • Sep 10, 2013 2:20 PM UTC
If you can't get the HTTPUploader to work, your best bet might be to use a PythonCaller and the excellent urllib2 module. This would perhaps entail a bit more work than you might have hoped for, but would give you a lot of flexibility.

 

 

David

Forum|alt.badge.img
  • Author
  • Sep 11, 2013 4:03 PM UTC

Hi guys,

 

unfortuainly i didnt get the HTTPUploader to work..

 

So python seems to be the way to go here.

 

Thank you