Skip to main content
Question

How to optimise PostGIS DB Reader performance, currently I run out of memory.

  • December 9, 2020
  • 0 replies
  • 18 views
T

Another learning FME question:

 

I have a postGIS table with 1.6million records.

I have 264 features from a lot of post process from another dataset.

 

Each 264 features have been split to 4 extent coordinates.

 

I need to understand the nearest neighbouring shape from the 1.6 million record PostGIS database (single table) for each 4 coordinates.

 

This means that FME Desktop attempts to cache the 1.6 million PostGIS records so it can then complete the nearest neighbour checks. I get 25% of the way through before I run out of memory and to be perfectly honest, I am slightly impressed my dinky laptop got this far.

 

How would I go about changing this flow to increase performance?

 

hj 

Many thanks

 

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

Community Stats

32,154
Posts
122,047
Replies
39,812
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.