Question

NullAttributeRemover out-of-memory errors

  • 22 April 2013
  • 1 reply
  • 3 views

Badge
Greetings,

 

 

I’ve been trying to use the NullAttributeRemover transformer (from the FME Store) to loop through a dataset with a large number of both fields and records.  It relies on Python to do the heavy lifting and gives me a Python out-of-memory error after processing about 120,000 records, less than 10% of what I need to process.  I tried to throw in some garbage collection and deleting variables and lists but to no avail.

 

 

Thanks in advance,

 

Alan

1 reply

Userlevel 4
Hi Alan,

 

 

that is strange, it as far as I can tell the PythonCaller isn't storing any information between the features, nor should it be a blocking transformer.

 

 

Could you post the relevant lines from the log as well as the string you've entered for the attributes to check?

 

 

For information, I've experienced memory problems with FME that logged Python errors to the log, although the PythonCaller was not the source of the error.

 

 

David

Reply