Hi there,
I have a translation between Microstation DGN files and AutoCAD DWG files where there can be as many as 6000 files at a time, but I'm encountering memory resource issues. I want to avoid splitting this translation into a child process with a WorkspaceRunner or JobSubmitter where it will process 1 file at a time.
- I'm using FeatureReader-DGN and tried with FeatureWriter-DWG / DWG Writer.
- FME_TEMP points to a 2 TB drive and the translation accumulated 350 GB of temp files like these before crashing with another TB free:
FME_OBJC_MultiWriter_1518629821107_13172_1
...
FME_OBJC_MultiWriter_1518629821107_13172_235 - Virtual memory is set to automatic paging on the same drive
- I have 16 GB RAM
- DGN file sizes range from 13 KB to 29 MB
- FME 2016.1.3.2 #16717 WIN64
FME seems to accumulate all the features from all the files before it writes out a single feature to a physical file. Is there a way to maybe (1) batch up the list files so that n-number-of-files are processed at a time, or (2) get the writers to output a full file before the reader reads the next file?
Attaching a sample workspace.
Thank you.
