I'm trying to extract all of the data from a table that lives on a webpage along with the hyperlinks that are embedded inside of one of the columns. The HTML table reader is only able to return the data that is displayed on the webpage, not the hyperlinks that are present. On the flip side, I can only get the HTMLExtractor transformer to collect the first record in the table. Attached is my workbench... what can I do to collect all of the records in the table?
Solved
Extract table from webpage and hyperlinks in table
Best answer by caracadrian
@Chris Warren You are on the right track.
By modifying your workspace a bit you can obtain the desired result.
Set your second HTMLExtractor to Output: Return List Attribute
Add ListExploders for every list that you need than merge the list via FeatureMerger using one of them as a Requestor and the rest as Suppliers, Join On _element_index, set it to Process Duplicate Suppliers.
Than you can continue to your Attribute Splitter.
By setting a ListExploder for every list you can obtain something like this:
+23- Enthusiast
Hi @johnscreekga ,
One way I think would work would be to set the output in the HTMLExtractor to return a list. Then you could explode the list items and join by the element index. That should return all items in the table.
+23- Contributor
- Best Answer
@Chris Warren You are on the right track.
By modifying your workspace a bit you can obtain the desired result.
Set your second HTMLExtractor to Output: Return List Attribute
Add ListExploders for every list that you need than merge the list via FeatureMerger using one of them as a Requestor and the rest as Suppliers, Join On _element_index, set it to Process Duplicate Suppliers.
Than you can continue to your Attribute Splitter.By setting a ListExploder for every list you can obtain something like this:
caracadrian wrote:
@Chris Warren You are on the right track.
By modifying your workspace a bit you can obtain the desired result.
Set your second HTMLExtractor to Output: Return List Attribute
Add ListExploders for every list that you need than merge the list via FeatureMerger using one of them as a Requestor and the rest as Suppliers, Join On _element_index, set it to Process Duplicate Suppliers.
Than you can continue to your Attribute Splitter.By setting a ListExploder for every list you can obtain something like this:
@Chris Warren and @caracadrian ... thank you both so much for the push in the right direction. I never would have thought of this on my own.
Reply
Rich Text Editor, editor1
Editor toolbars
Press ALT 0 for help
Helpful Members This Week
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.