I have an requirement where to write an xml file with around 12MB, which is taking almost 30 mins in a 16GB ram server. Is there any alternatives
Question
XML Templater is slow while writing huge xml file
+2- Safer
Hi @bhargavait ,
Just to confirm are you only seeing this behaviour on FME Server or on Desktop as well? Can you also let us know what build of FME you are using or upload the log file so we can have a look?
If you'd prefer, we can create a support case for this so one of our experts can look into this with you?
Hi @chrisatsafe
Same behavior either in desktop or in server. I am attaching log for desktop which has 16GB RAM and FME2016. I have extracted part of the log and has uploaded. Let me know if this is sufficient to help?
What I try to do in the workspace:
I use multiple sql executors to extract data from table and fed to xml templater, once the data is received the tempalter will start processing and takes huge time to write the next log line. example, all features received at 03:02:08, but the next log line is at 04:41:29
And the time varies depedning on the no of features being fed to xmltemplater.
+2- Safer
Hi @chrisatsafe
Same behavior either in desktop or in server. I am attaching log for desktop which has 16GB RAM and FME2016. I have extracted part of the log and has uploaded. Let me know if this is sufficient to help?
What I try to do in the workspace:
I use multiple sql executors to extract data from table and fed to xml templater, once the data is received the tempalter will start processing and takes huge time to write the next log line. example, all features received at 03:02:08, but the next log line is at 04:41:29
And the time varies depedning on the no of features being fed to xmltemplater.
I looked through our system and it appears there were some slowdowns in past versions of the XMLTemplater. By any chance would you be able to try this in a more recent version of FME? It doesn't have to be 2020, 2018 or newer should work as there was a fix implemented starting 2018 (build 18096+).
I understand you won't be able to test this on server but it's worth trying it on desktop to see if you still experience the same issues. Please be sure to right click on the XMLTemplater and choose Upgrade Transformer if it is available. Also note, you can have multiple builds of FME installed on your machine for testing so there is no need to uninstall 2016.1.
I looked through our system and it appears there were some slowdowns in past versions of the XMLTemplater. By any chance would you be able to try this in a more recent version of FME? It doesn't have to be 2020, 2018 or newer should work as there was a fix implemented starting 2018 (build 18096+).
I understand you won't be able to test this on server but it's worth trying it on desktop to see if you still experience the same issues. Please be sure to right click on the XMLTemplater and choose Upgrade Transformer if it is available. Also note, you can have multiple builds of FME installed on your machine for testing so there is no need to uninstall 2016.1.
Hi Chris,
I can clearly see an improvement but still its a lot(40 minutes for execution of XMLTemplater), I used FME 2018 Build 18295 in a standalone pc. Please find attached log for more information.
Is there any improvement that can still be done? or any chance of improvement in latest version. The same case for JSONTemplater as well, The higher the features in child/parent templates, the slower it is to generate the output.
I looked through our system and it appears there were some slowdowns in past versions of the XMLTemplater. By any chance would you be able to try this in a more recent version of FME? It doesn't have to be 2020, 2018 or newer should work as there was a fix implemented starting 2018 (build 18096+).
I understand you won't be able to test this on server but it's worth trying it on desktop to see if you still experience the same issues. Please be sure to right click on the XMLTemplater and choose Upgrade Transformer if it is available. Also note, you can have multiple builds of FME installed on your machine for testing so there is no need to uninstall 2016.1.
Small addition to my statement, the above result is from 8GB machine(FME2018) as that of 16GB RAM(FME2016) in the past.
+2- Safer
I looked through our system and it appears there were some slowdowns in past versions of the XMLTemplater. By any chance would you be able to try this in a more recent version of FME? It doesn't have to be 2020, 2018 or newer should work as there was a fix implemented starting 2018 (build 18096+).
I understand you won't be able to test this on server but it's worth trying it on desktop to see if you still experience the same issues. Please be sure to right click on the XMLTemplater and choose Upgrade Transformer if it is available. Also note, you can have multiple builds of FME installed on your machine for testing so there is no need to uninstall 2016.1.
Possible that there has been some improvement in more recent builds as well. Want to try in the latest beta or official release? If it's still slow, we'll open a support case and file an issue to see if our team can address the problem.
I looked through our system and it appears there were some slowdowns in past versions of the XMLTemplater. By any chance would you be able to try this in a more recent version of FME? It doesn't have to be 2020, 2018 or newer should work as there was a fix implemented starting 2018 (build 18096+).
I understand you won't be able to test this on server but it's worth trying it on desktop to see if you still experience the same issues. Please be sure to right click on the XMLTemplater and choose Upgrade Transformer if it is available. Also note, you can have multiple builds of FME installed on your machine for testing so there is no need to uninstall 2016.1.
Hi Chris,
yes, I shall download the latest version once and will keep you posted
Login to the community
No account yet? Create an account
An FME Account is required to contribute
LoginEnter your E-mail address. We'll send you an e-mail with instructions to reset your password.