I'm trying to extract all of the data from a table that lives on a webpage along with the hyperlinks that are embedded inside of one of the columns. The HTML table reader is only able to return the data that is displayed on the webpage, not the hyperlinks that are present. On the flip side, I can only get the HTMLExtractor transformer to collect the first record in the table. Attached is my workbench... what can I do to collect all of the records in the table?
Page 1 / 1
Hi @johnscreekga ,
One way I think would work would be to set the output in the HTMLExtractor to return a list. Then you could explode the list items and join by the element index. That should return all items in the table.
@Chris Warren You are on the right track.
By modifying your workspace a bit you can obtain the desired result.
Set your second HTMLExtractor to Output: Return List Attribute
Add ListExploders for every list that you need than merge the list via FeatureMerger using one of them as a Requestor and the rest as Suppliers, Join On _element_index, set it to Process Duplicate Suppliers.
Than you can continue to your Attribute Splitter.
By setting a ListExploder for every list you can obtain something like this:
@Chris Warren You are on the right track.
By modifying your workspace a bit you can obtain the desired result.
Set your second HTMLExtractor to Output: Return List Attribute
Add ListExploders for every list that you need than merge the list via FeatureMerger using one of them as a Requestor and the rest as Suppliers, Join On _element_index, set it to Process Duplicate Suppliers.
Than you can continue to your Attribute Splitter.By setting a ListExploder for every list you can obtain something like this:
@Chris Warren and @caracadrian ... thank you both so much for the push in the right direction. I never would have thought of this on my own.