Question

Hello, - What are the best settings to read a large XML-file (650Mb) on FME server? - Is there a better way to read this XML file? o XML flattener will hold with Optimizing Memory Usage o Shorter XML files (300Mb) run without any problems. tha

  • 9 November 2022
  • 2 replies
  • 8 views

Badge +2

Hello,

- What are the best settings to read a large XML-file (650Mb) on FME server?

- Is there a better way to read this XML file? 

o XML flattener will hold with Optimizing Memory Usage 

o Shorter XML files (300Mb) run without any problems.

thanks 

 

I have the details placed in a document.

 

thanks for your help


2 replies

Userlevel 5
Badge +29

I'm not surprised that FME is struggling to read that, that file would have ~650 million characters in it. I'm sure most programs would struggle trying to read that.

 

In the software producing that, can you force it to split out into smaller files?

Badge +2

Hi,

I can not split the file unfortunately. It will cost too much time and I may cause mistakes.

So

  • I asked the softwareproducer to reduce the number of items: they shall investigate my request.
  • I asked for more memory on my machine FME-server and more space to load temp files.

I have good hopes these two requests will solve the reading of large xml-files.

 

For now: many thanks for your reply.

Reply