Skip to main content
Question

FeatureReader from PostGIS

W
Forum|alt.badge.img

Hello,

I'm using featureReader and then i write results to GML format using dynamic writer. When I read from dataset which contains around 20 mln of rows after ~30 min I get (in job logs):

Internal Error: [READERR] Read error

Questions:

1. Where can I find more detailed description of that error?

2. Maybe it is DB timeout? If so is there any workaround for that? I don't think that it will be possible to change connection timeout on DB server to higher value.

Thanks for help :)

EDIT:

Also when I run it locally I have other exception after ~3hrs: InsufficientMemoryAvailable

:/

5 replies

redgeographics
Celebrity
Forum|alt.badge.img+49

Do you have a little bit more information regarding the log? This is a very generic message.

And yes, it could be the database timeout, you can set that in the database server configuration (but that may be locked down in your environment, in which case you'll need to talk to your dba) or you could try experimenting with the Number Of Records To Fetch At A Time parameter (in the Advanced section of the PostGIS reader parameters), setting that to a lower value should do the trick.

W
Forum|alt.badge.img
  • witos
  • Author
  • August 3, 2018
redgeographics wrote:

Do you have a little bit more information regarding the log? This is a very generic message.

And yes, it could be the database timeout, you can set that in the database server configuration (but that may be locked down in your environment, in which case you'll need to talk to your dba) or you could try experimenting with the Number Of Records To Fetch At A Time parameter (in the Advanced section of the PostGIS reader parameters), setting that to a lower value should do the trick.

Hello, thank you. In the logs on fme web portal there is nothing more about it. Also in the featureReader I can't see option for setting Number of records to fetch at a time :/

 

 

redgeographics
Celebrity
Forum|alt.badge.img+49
witos wrote:
Hello, thank you. In the logs on fme web portal there is nothing more about it. Also in the featureReader I can't see option for setting Number of records to fetch at a time :/

 

 

Check the Advanced section of the reader parameters screen:

 

 

W
Forum|alt.badge.img
  • witos
  • Author
  • August 3, 2018
redgeographics wrote:
Check the Advanced section of the reader parameters screen:

 

 

Ok, it is in 2018, in 2016 version I can't see it :)

 

 

W
Forum|alt.badge.img
  • witos
  • Author
  • August 3, 2018
redgeographics wrote:
Check the Advanced section of the reader parameters screen:

 

 

Ok I tried it locally, I can see that over the time it consumes more and more memory and it finishes with error:

 

 

InsufficientMemoryAvailable

 

Reply


Helpful Members This Week

Community Stats

31,330
Posts
118,863
Replies
38,957
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.