Skip to main content
  • EN

So I am having some issue's in pulling the table data from www.nextgenstats.nfl.com.

I have tried the HTMLTable reader, and I keep receiving an error message when trying to connect to it. Any suggestions would be great!

Hi @jasonberneathy what error message are you recieving?

Hi @jasonberneathy what error message are you recieving?

hello @lizsanderson So trying to connect to this table at: https://nextgenstats.nfl.com/stats/passing#yards

 

I keep recieving a "Failed to retrieve feature types." Error...

 

With the following listed in the log.

 

HTML Table Reader: Could not open HTML file 'https://nextgenstats.nfl.com/stats/passing#yards' for reading. ' ' : 'No such file or directory'

 

followed by:

 

Failed to obtain any schemas from reader 'HTMLTABLE' from 1 dataset. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information.

 

 

If you just need the data for one time a workaround for you could be the following. The Table is accessible in the console /inspector of your browser (i used firefox for this try). I got the information you needed by going to the options - developer - inspector. Then go to the section you want and right click on it and choose edit as html and save the text. After this you can parse the data in FME and get it back into the same structure.

https://developer.mozilla.org/nl/docs/Tools/Page_Inspector/How_to/Open_the_Inspector

If you just need the data for one time a workaround for you could be the following. The Table is accessible in the console /inspector of your browser (i used firefox for this try). I got the information you needed by going to the options - developer - inspector. Then go to the section you want and right click on it and choose edit as html and save the text. After this you can parse the data in FME and get it back into the same structure.

https://developer.mozilla.org/nl/docs/Tools/Page_Inspector/How_to/Open_the_Inspector

Thank you for your answer, and it would work as a temporary solution. However I would like to pull this data in real time (since it changes from week to week) when running the workbench rather than creating a bunch of HTML files to run the workbench.

 

 

Hi @jasonberneathy what error message are you recieving?

I had a look at the URL also...same error. Seems it isn't finding any Tables. I always thought this only worked with static content but I see reviewing the help that it should work with content that is created on the fly.
I had a look at the URL also...same error. Seems it isn't finding any Tables. I always thought this only worked with static content but I see reviewing the help that it should work with content that is created on the fly.
Although I'm not sure if it would raise that error message, is it actually a HTML "table" the web page is creating? Or are they creating something that looks like a table, but isn't a HTML table tag?

 

Although I'm not sure if it would raise that error message, is it actually a HTML "table" the web page is creating? Or are they creating something that looks like a table, but isn't a HTML table tag?

 

It appears to be pulling the data from json. However I am unaware of how to access it remotely with FME.

 

 

It appears to be pulling the data from json. However I am unaware of how to access it remotely with FME.

 

 

Hi, you can find the JSON link in Firefox/Chrome dev console with request type XHR. (https://appapi.ngs.nfl.com/statboard/passing?season=2017&seasonType;=REG)

 

Then in FME use JSON reader, put the JSON link for JSON source dataset, then Schema Scan mode to JSON Query, and add one Feature Type 'json_featuretype' with Query 'jsons"stats"]
  • '

     

     

    • Reply


    Community Stats

    30,193
    Posts
    114,604
    Replies
    37,855
    Members
    Terms & ConditionsCookie settings
    A product of
    Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.