Skip to main content
I'm processing county-wide imagery and for large counties it takes up to 16 hours to produce output. My workflow is as follows:

 

 

Input(MrSid) - Reproject - Clip to area of interest(up to 80% of county) - Tile (2 by 2) - Output (JP2).

 

 

Reprojecting, clipping and tiling seems to go fast. If writing to JP2 is the problem then I'm out of luck because that's the format we need.

 

 

Any tips are greatly appreciated.

 

 

Thanks.

 

I'm using FME 2012 build 12212 by the way.
Hi,

 

 

To name a few changes, I would set the input coordinate system on the reader  (in combination with setting the writer to the desired coordinate system) will eliminate the need for the reprojection in the workflow.

 

 

Secondly, use the reader parameters search envelop, search envelop coordinate system and clip to search envelop (eliminates the need to clip).

 

 

On the writer side there is not much to gain, if possible consider resampling.

 

 

Hope this helps.
Itay,

 

 

I didn't know it was possible to reproject like that, i will give it a try. I still have to do the clipping because i'm using odd shaped polygons.

 

 

Thanks a lot.
Hi,

 

 

Despite that I would still open only the region of the raster that is of interest, with the search envelop parameter, this will shorten the clipping time.

 

 

Itay
Hi,

 

 

to isolate whether it is the JP2 writer that is slowing down your process, try to redirect the result to an FFS file. See in the Navigator panel, under Workspace parameters / Destination redirect.

 

 

Look at the last few lines of the log to compare the running times with output to FFS and JP2.

 

 

You can also try to set the JP2 writer compression level to 0 (=no compression) to see if there's any improvement.

 

 

David
David,

 

 

It was the JP2 writer. I'm doing a second clipping after tiling, this way the script does not have to write unncesessary no-data areas. It makes some images go faster than others, it depends on their shape.

 

 

I still need to figure out how to set the compression.

 

 

Thanks a lot for the tip. 
Hi,

 

 

thanks for the feedback, very helpful for those searching these forums later.

 

 

To set the compression level, open the writer feature type properties and look under the tab Format parameters:

 

 

 

 

David
Hi,

 

 

Mind you the higher the compression the less is the image quality.
Hi, jesuspisto.

 

I also wonder do you mind to do some compression work to your project? But once you have done that, the resolution of your work will be decreased. However, doing some compression work can save a lot of time for you. You can read some tutorials about it and makea better decision. I hope you success. Good luck.

Reply