Skip to main content
  • EN
Greetings,

 

 

I’ve been trying to use the NullAttributeRemover transformer (from the FME Store) to loop through a dataset with a large number of both fields and records.  It relies on Python to do the heavy lifting and gives me a Python out-of-memory error after processing about 120,000 records, less than 10% of what I need to process.  I tried to throw in some garbage collection and deleting variables and lists but to no avail.

 

 

Thanks in advance,

 

Alan
Hi Alan,

 

 

that is strange, it as far as I can tell the PythonCaller isn't storing any information between the features, nor should it be a blocking transformer.

 

 

Could you post the relevant lines from the log as well as the string you've entered for the attributes to check?

 

 

For information, I've experienced memory problems with FME that logged Python errors to the log, although the PythonCaller was not the source of the error.

 

 

David

Reply


Community Stats

30,157
Posts
114,473
Replies
37,802
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.