Hi FME ninjas,
I'm using the HTTPCaller to call a website containing multiple URLs in its HTML.
I'm trying to extract all the URLs that have below format, based on these I'd like to create and attribute (URL) that shows all unique urls as features.
What I have:
What I want:
Does this make any sense ;-) ?
Thanks,
Eduard
Best answer by nielsgerrits
**Update**
With the addition of @takashi, something like this might be what you need.
**Original**
Looks like this question?
HtmlExtractor, a[href] as CSS Selector. Does this work in your situation? Did not try yet...
+60**Update**
With the addition of @takashi, something like this might be what you need.
**Original**
Looks like this question?
HtmlExtractor, a[href] as CSS Selector. Does this work in your situation? Did not try yet...
**Update**
With the addition of @takashi, something like this might be what you need.
**Original**
Looks like this question?
HtmlExtractor, a[href] as CSS Selector. Does this work in your situation? Did not try yet...
Yes, the HTMLExtractor does the trick. You can extract the URLs as a list attribute directly with this setting.
Mmm... I can't seem to get any data using above HTMLExtractors.
Can you perhaps have a look?
This is the page I'm trying to read: https://www.primera.nl/winkels/
My workbench so far:
Cheers,
Ed
Mmm... I can't seem to get any data using above HTMLExtractors.
Can you perhaps have a look?
This is the page I'm trying to read: https://www.primera.nl/winkels/
My workbench so far:
Cheers,
Ed
Yes I can.
+60Yes, the HTMLExtractor does the trick. You can extract the URLs as a list attribute directly with this setting.
Learned something new today, thanks.
Thank you @nielsgerrits / @takashi for your quick responses.
I have exploded the URL list and I now have the data I was looking for.
Best,
Ed
+35Oh oh... I forgot to explode the list huh?
With the following settings I get a list of 511 shops.
Indeed with a ListExploder. I always forget it is called that.
With the following settings I get a list of 511 shops.
Indeed with a ListExploder. I always forget it is called that.
I currently have 493.
I will try your approach, thanks for sharing.
Mmm... I can't seem to get any data using above HTMLExtractors.
Can you perhaps have a look?
This is the page I'm trying to read: https://www.primera.nl/winkels/
My workbench so far:
Cheers,
Ed
Some pattern matching are available in CSS selector expression. For example, this setting extracts only URLs which begin with "https". See here to learn more: CSS Selector Reference
a[href^="https"]In addition, you can also download the source HTML directly with the HTMLExtractor.
