Skip to main content
Question

NullAttributeRemover out-of-memory errors

  • April 22, 2013
  • 1 reply
  • 42 views
A
Forum|alt.badge.img
Greetings,

 

 

I’ve been trying to use the NullAttributeRemover transformer (from the FME Store) to loop through a dataset with a large number of both fields and records.  It relies on Python to do the heavy lifting and gives me a Python out-of-memory error after processing about 120,000 records, less than 10% of what I need to process.  I tried to throw in some garbage collection and deleting variables and lists but to no avail.

 

 

Thanks in advance,

 

Alan
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

david_r
Celebrity
  • david_rCelebrity
  • April 22, 2013
Hi Alan,

 

 

that is strange, it as far as I can tell the PythonCaller isn't storing any information between the features, nor should it be a blocking transformer.

 

 

Could you post the relevant lines from the log as well as the string you've entered for the attributes to check?

 

 

For information, I've experienced memory problems with FME that logged Python errors to the log, although the PythonCaller was not the source of the error.

 

 

David

Community Stats

32,851
Posts
124,590
Replies
41,426
Members
Terms & ConditionsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.