Skip to main content
Open

Parallel Processing - Choose number of cores/sub-processes to use

Related products:Integrations

virtualcitymatt
Celebrity

When using the Parallel processing option in FME the number of threads always depends on the number of cores of the machine. For example 'Moderate' is one process per core on the machine. If your machine has a tonne of core you can potentially get a tonne of threads. This is really nice on one hand but on the other hand maybe you want to restrict the process to just a few threads. Especially if the process is memory intensive and the machine perhaps doesn't have enough to support so many parallel threads.


If you want to restrict your process to a certain number of threads then you need to do a few backflips in order to figure out which level or parallel processing to use and in the end the least you can use is half the number of available cores.


It would be pretty nice to be able to just specify the number of parallel processes you want to be able to use.

2 replies

rtess
Contributor
Forum|alt.badge.img+1
  • Contributor
  • April 25, 2024

In addition, it also would be helpful to limit the number of threads so you don’t use all your licenses on one process. If I use any sort of parallelism in FME, the minimal parallelism still will use 16 threads, using up all my licenses. 


stevenjh
Contributor
Forum|alt.badge.img+5
  • Contributor
  • June 9, 2025

Making this easier to manage would be great as it also seems to impact ‘how parallel’ you can get with other licensing dependencies.
ArcObjects/FGDB and parallel processing issues | Community

 


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings