Skip to main content
Open

Parallel Processing - Choose number of cores/sub-processes to use

Related products:Integrations
  • July 17, 2023
  • 1 reply
  • 48 views
virtualcitymatt
danilo_fme
thijsknapen
rtess
littlefictions
+2
  • virtualcitymatt
    virtualcitymatt
  • danilo_fme
    danilo_fme
  • thijsknapen
    thijsknapen
  • rtess
    rtess
  • littlefictions
    littlefictions
  • davisblack
    davisblack
  • geoportalcartog
    geoportalcartog

virtualcitymatt
Celebrity

When using the Parallel processing option in FME the number of threads always depends on the number of cores of the machine. For example 'Moderate' is one process per core on the machine. If your machine has a tonne of core you can potentially get a tonne of threads. This is really nice on one hand but on the other hand maybe you want to restrict the process to just a few threads. Especially if the process is memory intensive and the machine perhaps doesn't have enough to support so many parallel threads.


If you want to restrict your process to a certain number of threads then you need to do a few backflips in order to figure out which level or parallel processing to use and in the end the least you can use is half the number of available cores.


It would be pretty nice to be able to just specify the number of parallel processes you want to be able to use.

1 reply

rtess
Contributor
Forum|alt.badge.img+1
  • Contributor
  • April 25, 2024

In addition, it also would be helpful to limit the number of threads so you don’t use all your licenses on one process. If I use any sort of parallelism in FME, the minimal parallelism still will use 16 threads, using up all my licenses. 


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings