Skip to main content
Question

HTMLExtractor using basic login


I'm very new to FME and am trying to extract some data from a webpage. The page requires a basic login. I can use httpFetcher to connect to the page but how do I then extract the table elements from the response body?

 

 

2 replies

david_r
Celebrity
  • April 19, 2018

I would recommend that you use the HTTPCaller to retrieve the HTML document, it's much easier to specify authentication parameters there. You can then send the resulting HTML to the HTMLExtractor in an attribute. Example HTTPCaller setup for basic auth:

In the HTMLExtractor, get the contents from the _response_body attribute, e.g:


danilo_fme
Evangelist
Forum|alt.badge.img+44
  • Evangelist
  • April 19, 2018
david_r wrote:

I would recommend that you use the HTTPCaller to retrieve the HTML document, it's much easier to specify authentication parameters there. You can then send the resulting HTML to the HTMLExtractor in an attribute. Example HTTPCaller setup for basic auth:

In the HTMLExtractor, get the contents from the _response_body attribute, e.g:

Nice explanation @david_r !!!

 


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings