Skip to main content
Solved

Does FME Flow limit Python used in a Python Caller to One Core per Engine?

ryanuthoff
Contributor
Forum|alt.badge.img+4

I believe currently each FME Flow engine only uses one core per engine. Meaning each workspace that is being ran is only utilizing one CPU core.

 

My question is does this also apply to Python ran through a Python Caller in the workspace when being ran in FME Flow?

 

For example, I have a Python caller running an Esri tool and set the parallel processing of the tool to be 5 (meaning the Esri tool will use 5 cores).

 

Does this mean the Python will use all 5 cores? Or does FME Flow still limit the Python from only being able to use one core?

Best answer by david_r

You're right that one engine = one CPU core.

Regarding the Esri tool, I would say it fully depends on how Esri has implemented their parallel processing. But technically, I think there should be nothing in FME preventing Esri Python from using additional CPUs. I think your best bet is to inspect the running processes while executing the Esri tool. On Windows, this could be either the Task Manager or something more advanced, like the Process Explorer.

View original
Did this help you find an answer to your question?

2 replies

david_r
Celebrity
  • david_rCelebrity
  • Best Answer
  • November 9, 2023

You're right that one engine = one CPU core.

Regarding the Esri tool, I would say it fully depends on how Esri has implemented their parallel processing. But technically, I think there should be nothing in FME preventing Esri Python from using additional CPUs. I think your best bet is to inspect the running processes while executing the Esri tool. On Windows, this could be either the Task Manager or something more advanced, like the Process Explorer.

ryanuthoff
Contributor
Forum|alt.badge.img+4
  • ryanuthoffContributor
  • Author
  • Contributor
  • November 9, 2023
david_r wrote:

You're right that one engine = one CPU core.

Regarding the Esri tool, I would say it fully depends on how Esri has implemented their parallel processing. But technically, I think there should be nothing in FME preventing Esri Python from using additional CPUs. I think your best bet is to inspect the running processes while executing the Esri tool. On Windows, this could be either the Task Manager or something more advanced, like the Process Explorer.

Thank you! I assumed that was the case, but wanted to verify.

Reply


Helpful Members This Week

Community Stats

31,322
Posts
118,830
Replies
38,954
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.