Skip to main content
Solved

NOAA AVHRR raster data


Forum|alt.badge.img

Hi All,

I have been given some NOAA AVHRR files to read.... (High Resolution Picture Transmission (HRPT) 1KM Level 1B apparently) i can read them in this software called HRPT Reader. Has anyone come across reading anything like this in FME. The client wants Sea Surface Temp info out of the RASTER. I have tried in fme 2017 but nothing seems to work. I can supply the file (it has not extension) if anyone wants a look . FILE

Any thoughts appreicated

Thanks Steve

Best answer by jdh

HRPT is a binary format, the official structure is described in https://www1.ncdc.noaa.gov/pub/data/satellite/publications/podguides/TIROS-N%20thru%20N-14/pdf/NCDCPOD2.pdf

A simplified overview is available http://www.sat.dundee.ac.uk/hrptformat.html

While it is possible to create a custom format reader in FME using the SDK, it's complicated (See https://knowledge.safe.com/articles/798/developing-a-new-format-readerwriter-with-the-fme.html for a starting place).

 

 

In FME you are probably better off using a python caller with either gdal or mpop

see http://www.pytroll.org/quickstart_avhrr.html for a mpop AVHRR tutorial

Personally I would check with the client as to the need to read HRPT data specifically, as opposed to the processed Sea Surface Temperature datasets in NetCDF like https://podaac.jpl.nasa.gov/dataset/AVHRR_SST_METOP_B-OSISAF-L2P-v1.0?ids=Sensor&values;=AVHRR&search;=Sea%20Surface%20Temperature

 

View original
Did this help you find an answer to your question?

8 replies

itay
Supporter
Forum|alt.badge.img+17
  • Supporter
  • March 20, 2017

Hi,

Not sure this helps but according to the doc's gdal can also read this format, possibly you can use that to convert into a format that FME can read.

Hope this helps.


jdh
Contributor
Forum|alt.badge.img+28
  • Contributor
  • Best Answer
  • March 20, 2017

HRPT is a binary format, the official structure is described in https://www1.ncdc.noaa.gov/pub/data/satellite/publications/podguides/TIROS-N%20thru%20N-14/pdf/NCDCPOD2.pdf

A simplified overview is available http://www.sat.dundee.ac.uk/hrptformat.html

While it is possible to create a custom format reader in FME using the SDK, it's complicated (See https://knowledge.safe.com/articles/798/developing-a-new-format-readerwriter-with-the-fme.html for a starting place).

 

 

In FME you are probably better off using a python caller with either gdal or mpop

see http://www.pytroll.org/quickstart_avhrr.html for a mpop AVHRR tutorial

Personally I would check with the client as to the need to read HRPT data specifically, as opposed to the processed Sea Surface Temperature datasets in NetCDF like https://podaac.jpl.nasa.gov/dataset/AVHRR_SST_METOP_B-OSISAF-L2P-v1.0?ids=Sensor&values;=AVHRR&search;=Sea%20Surface%20Temperature

 


Forum|alt.badge.img
  • Author
  • March 20, 2017

Many Thanks Guys. I will try and go with jdh's idea of using the netCDF data instead. Thanks again

Steve


Forum|alt.badge.img
  • Author
  • March 20, 2017
jdh wrote:

HRPT is a binary format, the official structure is described in https://www1.ncdc.noaa.gov/pub/data/satellite/publications/podguides/TIROS-N%20thru%20N-14/pdf/NCDCPOD2.pdf

A simplified overview is available http://www.sat.dundee.ac.uk/hrptformat.html

While it is possible to create a custom format reader in FME using the SDK, it's complicated (See https://knowledge.safe.com/articles/798/developing-a-new-format-readerwriter-with-the-fme.html for a starting place).

 

 

In FME you are probably better off using a python caller with either gdal or mpop

see http://www.pytroll.org/quickstart_avhrr.html for a mpop AVHRR tutorial

Personally I would check with the client as to the need to read HRPT data specifically, as opposed to the processed Sea Surface Temperature datasets in NetCDF like https://podaac.jpl.nasa.gov/dataset/AVHRR_SST_METOP_B-OSISAF-L2P-v1.0?ids=Sensor&values;=AVHRR&search;=Sea%20Surface%20Temperature

 

Hi jdh, i tried to open the NetCDF in FME 2017 data inspector and only got errors.

 

"not recognized as a supported file format"

 

were you able to open these SST NetCDF files from JPL in fme ?

 

 

Thanks Again,

 

 

Steve

 

 


jdh
Contributor
Forum|alt.badge.img+28
  • Contributor
  • March 20, 2017
goatboy wrote:
Hi jdh, i tried to open the NetCDF in FME 2017 data inspector and only got errors.

 

"not recognized as a supported file format"

 

were you able to open these SST NetCDF files from JPL in fme ?

 

 

Thanks Again,

 

 

Steve

 

 

What version of NetCDF did you download? the jpl offers both v3 and v4, but FME only supports up to V3.6.2 . I had no issue reading a version 3 nc file downloaded via the OPeNDAP Server.

 

 


Forum|alt.badge.img
  • Author
  • March 20, 2017
jdh wrote:
What version of NetCDF did you download? the jpl offers both v3 and v4, but FME only supports up to V3.6.2 . I had no issue reading a version 3 nc file downloaded via the OPeNDAP Server.

 

 

perfect, thanks

 

 


Forum|alt.badge.img
  • Author
  • March 20, 2017
jdh wrote:
What version of NetCDF did you download? the jpl offers both v3 and v4, but FME only supports up to V3.6.2 . I had no issue reading a version 3 nc file downloaded via the OPeNDAP Server.

 

 

Hi jdh, a couple more questions for you.... :-)

 

 

Using the jpl opendap server i select the variables i want (sea_surface_temperature). i leave nj and ni empty ??

 

To get data for x location select lat and long and provide the coordinates:

 

 

northernmost_latitude: -52.6559982 (nj)

 

southernmost_latitude: -71.1429977 (ni)

 

easternmost_longitude: 9.40999985 (nj)

 

westernmost_longitude: -54.0480003 (ni)

 

then export the netcdf v3 ... . is this the process you would go thru to export data for an area of interest you have ?

 

 

Also, sst units are kelvin, add 273 to get Celsius ? do i need to use the scale factor of 0.01 ? my results are strange temps ...

 

 

thanks steve

 

 


jdh
Contributor
Forum|alt.badge.img+28
  • Contributor
  • March 20, 2017
jdh wrote:
What version of NetCDF did you download? the jpl offers both v3 and v4, but FME only supports up to V3.6.2 . I had no issue reading a version 3 nc file downloaded via the OPeNDAP Server.

 

 

Those questions are probably better asked to I've only ever assisted students in obtaining the data, never actually used it myself.

 

 


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings