Skip to main content
Solved

Does FME Flow limit Python used in a Python Caller to One Core per Engine?

  • November 9, 2023
  • 2 replies
  • 30 views
ryanuthoff
Contributor
Forum|alt.badge.img+4

I believe currently each FME Flow engine only uses one core per engine. Meaning each workspace that is being ran is only utilizing one CPU core.

 

My question is does this also apply to Python ran through a Python Caller in the workspace when being ran in FME Flow?

 

For example, I have a Python caller running an Esri tool and set the parallel processing of the tool to be 5 (meaning the Esri tool will use 5 cores).

 

Does this mean the Python will use all 5 cores? Or does FME Flow still limit the Python from only being able to use one core?

Best answer by david_r

You're right that one engine = one CPU core.

Regarding the Esri tool, I would say it fully depends on how Esri has implemented their parallel processing. But technically, I think there should be nothing in FME preventing Esri Python from using additional CPUs. I think your best bet is to inspect the running processes while executing the Esri tool. On Windows, this could be either the Task Manager or something more advanced, like the Process Explorer.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

david_r
Celebrity
  • david_rCelebrity
  • Best Answer
  • November 9, 2023

You're right that one engine = one CPU core.

Regarding the Esri tool, I would say it fully depends on how Esri has implemented their parallel processing. But technically, I think there should be nothing in FME preventing Esri Python from using additional CPUs. I think your best bet is to inspect the running processes while executing the Esri tool. On Windows, this could be either the Task Manager or something more advanced, like the Process Explorer.

ryanuthoff
Contributor
Forum|alt.badge.img+4
  • ryanuthoffContributor
  • Author
  • Contributor
  • November 9, 2023

You're right that one engine = one CPU core.

Regarding the Esri tool, I would say it fully depends on how Esri has implemented their parallel processing. But technically, I think there should be nothing in FME preventing Esri Python from using additional CPUs. I think your best bet is to inspect the running processes while executing the Esri tool. On Windows, this could be either the Task Manager or something more advanced, like the Process Explorer.

Thank you! I assumed that was the case, but wanted to verify.

Community Stats

32,120
Posts
121,954
Replies
39,772
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.