Skip to main content

Assume we have a well populated PostGIS database with lots of metadata about raster and feature based data. (we are using FME Server, to farm the cloud and other sources and build the PostGIS database).

Now we need a friendly user interface for search and download.

What open source technologies would one use to create a end-user friendly catalog search and download system (web based).

Something similar to what is located at: https://catalog.data.gov/dataset

(I realize they just provide pointers to the original source, we would be caching the rasters and the feature in a datalake, and using PostGIS for the catalog/index)
yea, the data.gov uses ESRI, but let's take that off the table.)

 

If I had to do it by hand, I would use Leaflet or OpenLayers, but since this is such a common need, I wonder if someone has not already put that together).

Hi @ygutfreund

 

 

I had a quick look on google and found these two:

 

http://pycsw.org/

 

http://docs.geoserver.org/stable/en/user/services/csw/index.html

 

 

I know Geoserver is fairly popular, but haven't used it myself to create a CSW.

 

Also these may not provide the front end you're after, but instead create the backend services. However, they may be worth exploring.

 


Hi @ygutfreund

 

 

I had a quick look on google and found these two:

 

http://pycsw.org/

 

http://docs.geoserver.org/stable/en/user/services/csw/index.html

 

 

I know Geoserver is fairly popular, but haven't used it myself to create a CSW.

 

Also these may not provide the front end you're after, but instead create the backend services. However, they may be worth exploring.

 

I am pretty happy with fme server for the backend. Can geonetwork be combined with fme?

 

 


Hi,

In addition to the examples above you could try GeoNetwork, which is an Open Source catalogue portal very similar to data.gov and has been quite popular in Europe for similar applications. It also ties in well to GeoServer/PostGIS, and you can integrate it into a data publishing workflow with FME via its CSW/APIs easily.


Hi,

In addition to the examples above you could try GeoNetwork, which is an Open Source catalogue portal very similar to data.gov and has been quite popular in Europe for similar applications. It also ties in well to GeoServer/PostGIS, and you can integrate it into a data publishing workflow with FME via its CSW/APIs easily.

Any pointers or examples on what you mean by integrating geo network with fme? Since geonetwork appears to be a self contained full solution.

 

 


I am pretty happy with fme server for the backend. Can geonetwork be combined with fme?

 

 

I think then you'd have to build your own front end then making lots of calls to FME Server either through directurl or REST API. We do have this article, however it hasn't been updated in a while: https://knowledge.safe.com/articles/1056/integration-example-for-ogc-csw-data-catalog-and-r.html

Hi @ygutfreund

 

 

I had a quick look on google and found these two:

 

http://pycsw.org/

 

http://docs.geoserver.org/stable/en/user/services/csw/index.html

 

 

I know Geoserver is fairly popular, but haven't used it myself to create a CSW.

 

Also these may not provide the front end you're after, but instead create the backend services. However, they may be worth exploring.

 

Don’t need. Full csw, very comfortable with rest.

 

 


Don’t need. Full csw, very comfortable with rest.

 

 

In that case, we have the REST API training course which would be worth exploring and the documentation, which should give you the tools to use FME Server in your own front end.

 

 


In that case, we have the REST API training course which would be worth exploring and the documentation, which should give you the tools to use FME Server in your own front end.

 

 

I am pretty comfortable with the FME REST interface. But this will be my first FME server project. I have done a lot with Leaflet as a interface in the past, I also don't need to copy the CSW interface, in fact, I prefer to do something where we can do some Analytics & Transformation requests of the Server, and then get notices when done. So this sounds like the way to go. I see GeoNetwork as "sort:" of a more closed and fixed solution, but I might be missing something.

 

 

 


Hi,

In addition to the examples above you could try GeoNetwork, which is an Open Source catalogue portal very similar to data.gov and has been quite popular in Europe for similar applications. It also ties in well to GeoServer/PostGIS, and you can integrate it into a data publishing workflow with FME via its CSW/APIs easily.

If your using FME to manage your data flow line, it means that you can publish metadata updates or new records direct to the GeoNetwork catalogue via its API's. The Knowledge article Jen has referenced below should be a good example as Degree is very similar to GeoNetwork. Though working with XML has got a lot easier since the article was written the approach it uses is still relevant.

 

 

So I've used a flow that that would have FME take a new dataset load it to PostGIS, then using their API's create the relevant entries in GeoServer to publish the layer and also create a metadata record to the required standard and then publish this from FME into GeoNetwork. FME essentially orchestrates the different applications as part of the publication and update routines and the whole process can be automated as well.

 

 

Depending on how familiar you are with OGC/CSW services it can take a little while to get your head round as they are a bit more complex than REST but the OGC website has full documentation and once you have the design pattern for each request its very easy.

 


Reply