Skip to main content
Question

Trying to extract URL from website [tried HTTPCaller / HTMLExtractor)

  • February 11, 2020
  • 3 replies
  • 15 views
E
Forum|alt.badge.img

Hi all,

 

 

I'm trying to extract an URL from this website: https://www.acehardware.com/store-details/16798

 

 

<a target="_blank" rel="noopener" href="https://maps.google.com/maps?ll=46.859727,-122.845546&amp;z=12&amp;t=m&amp;hl=en-US&amp;gl=US&amp;mapclient=apiv3" title="Open this area in Google Maps (opens a new window)" style="position: static; overflow: visible; float: none; display: inline;"><div style="width: 66px; height: 26px; cursor: pointer;"><img alt="" src="https://maps.gstatic.com/mapfiles/api-3/images/google4.png" draggable="false" style="position: absolute; left: 0px; top: 0px; width: 66px; height: 26px; user-select: none; border: 0px; padding: 0px; margin: 0px;"></div></a>

 

- I've tried the HTTPCaller but the specific URL is not showing in the output.

 

- Also tried the HTMLExtractor (both href and div a), getting a lot of data but not the URL I'm looking for.

 

 

I have a feeling it's quite nested in the website - is there a way to extract it?

 

 

 

Cheers,

 

Ed

 

 

 

3 replies

afavaccio
Forum|alt.badge.img+2
  • afavaccio
  • February 11, 2020

@edhere I've found a similar URL, have a look at the attached fmw. HTH.

htmlextractor.fmw

E
Forum|alt.badge.img
  • edhere
  • Author
  • February 11, 2020
afavaccio wrote:

@edhere I've found a similar URL, have a look at the attached fmw. HTH.

htmlextractor.fmw

Hi @afavaccio,

 

 

Thanks for your response. I am able to get the same URL as you have.

 

Unfortunately, that is not the URL I'm looking for - I'm trying to get the one with the coordinates.

 

It seems it's well hidden. :-(
afavaccio
Forum|alt.badge.img+2
  • afavaccio
  • February 13, 2020
edhere wrote:

Hi @afavaccio,

 

 

Thanks for your response. I am able to get the same URL as you have.

 

Unfortunately, that is not the URL I'm looking for - I'm trying to get the one with the coordinates.

 

It seems it's well hidden. :-(

Hi @edhere,

I guess, but I could be wrong, that the URL you are looking for is generated by a JavaScript when the page is rendered in the browser so in the HTTP response body there isn't any trace about it.

Reply


Helpful Members This Week

Community Stats

31,536
Posts
119,559
Replies
39,174
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.