Skip to main content

I have successfully used readers that point to download links for datasets in the past. I have a situation I am up against now where using this method does not work. I have two different links I am trying to read from:

 

Link 1:

http://gis.co.slope.nd.us/

This link takes you to a map viewer with a button that allows you to download either a geopackage or a shapefile of the dataset. However, when I try to right click on the download button, there is not an option to copy the URL of the button itself, so I am not able to use a reader to download then process the data.

 

Link 2

https://adams.offroadsoftware.com/php/downloadShape.php?isbnai=4e57016981c3155bb6834af1ce0389aed3460eb0343d94d01e8379a88138b68e

 

When I click this link it downloads a zipped geopackage without taking me to a web page. Similarly, I cannot get a reader to successfully read this link.

 

Does anyone have any advice/tips/solutions for either of the above two items? Thank you in advance!

 

 

For Link one it looks like the data is being compiled based on a request. As a tip you can open up the develper tap in your browser and look at the network traffic when you hit the butten. You will likely see some kind of query. (URL + some settings) The settings are set based on user the user input like published parameters in an FME workspace so the the download url is not static

Here's a screen shot of what I mean from looking at link 1

dev_tab_F12_networkHere at the top or the right window you can see the base URL. At the bottom are the request parameters. If you switch the view from "From Data" to "View Source" you can see the end part of the URL

 

Here's the build URL:

http://gis.co.slope.nd.us/php/downloadShape.php?whichextent=partial&srid=4269&downloadformat=gpkg&qlay=Parcels&mapext=1776921.3923182443%2B214140.65157750345%2B2144638.607681756%2B365909.3484224966&map=%2FLibrary%2FWebServer%2F1038087%2Fmapfiles%2Fbase.map&download=Download+Data

 

There is another method. Just because we have the URL here unfortunately when putting it in a Reader FME removes all the stuff off the end and adds a .gpkg extension to the URL.

 

What you want to use here is an HTTPCaller transformer to first download the file and then read the downloaded file with a FeautreReader.

Example Attached.

The HTTPCaller method will probably work for link 2 as well

 

Good Luck

 

 


Both sites you've listed appear to have been develop by off road software. I would try to contact off road software and ask if they offer an API to their websites and data sources (usually a REST API).


Reply