Skip to main content
Archived

FMEServer/Cloud - reduce memory footprint when idle

Related products:FME Form
  • April 22, 2020
  • 1 reply
  • 10 views

sigtill
Supporter
Forum|alt.badge.img+25

Is it possible to try to reduce the memory footprint used when FME Server / Cloud is running idle? Ie have no jobs?

The starter instance of FME Cloud seems to use 2,7GB RAM when "no work is done" - is it possible to squeeze this down by 10%? 40%?

Might be a good internal hackathon.

The reason for doing so would be to make more memory available for the tasks themselves and avoid these frequent issues when you hit the roof on the lower-memory computers:


2020-04-22 17:02:43|  16.4|  0.0|INFORM|ResourceManager: Optimizing Memory Usage.  Please wait... 2020-04-22 17:02:43|  16.5|  0.0|WARN  |ResourceManager: Freed 683495 bytes of vector data (memory decreased by 1256384 bytes) 2020-04-22 17:02:43|  16.5|  0.0|WARN  |ResourceManager: Freed 42565632 bytes of raster data (memory decreased by 42566352 bytes) 2020-04-22 17:02:43|  16.5|  0.0|WARN  |After freeing memory: tcmalloc GetStats 2020-04-22 17:02:43|  16.5|  0.0|WARN  |------------------------------------------------ MALLOC:      834246680 (  795.6 MiB) Bytes in use by application MALLOC: +            0 (    0.0 MiB) Bytes in page heap freelist MALLOC: +     28814680 (   27.5 MiB) Bytes in central cache freelist MALLOC: +     10370640 (    9.9 MiB) Bytes in transfer cache freelist MALLOC: +     18742336 (   17.9 MiB) Bytes in thread cache freelists MALLOC: +      4796608 (    4.6 MiB) Bytes in malloc metadata MALLOC:   ------------ MALLOC: =    896970944 (  855.4 MiB) Actual memory used (physical + swap) MALLOC: +    971071488 (  926.1 MiB) Bytes released to OS (aka unmapped) MALLOC:   ------------ MALLOC: =   1868042432 ( 1781.5 MiB) Virtual address space used MALLOC: MALLOC:          17172              Spans in use MALLOC:              3              Thread heaps in use MALLOC:           8192              Tcmalloc page size ------------------------------------------------ Call ReleaseFreeMemory() to release freelist memory to the OS (via madvise()).
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

stewartatsafe
Safer
Forum|alt.badge.img+9

This is essentially the memory footprint of FME Server as there are no other apps running on the FME Cloud instance except the PostGIS database. FME Server is comprised of a number of processes: FME Server Core, Process Monitor, WebSocket service, database, subscription watchers, Redis, etc. There was a push a few years ago to only instantiate processes only when they are required. In short, I don't think this is going to be easy to lower.

The Starter instance is really meant for non-production or very light workflows, and this is why.