Skip to main content
  • EN

FME 2017.0, CSV2 Reader reading 10 million records from 2 CSVs: X:\\Folder\\MyZIP_*.zip\\Data\\*_AA.csv,X:\\Folder\\MyZip_*.zip\\Data\\*_BB.csv

It worked fine for a while, then suddenly stopped working.

I tried making sure I wasn't in the Zip file in Windows Explorer, rebooted, and purged temporary files, but nothing solved the problem. So I had a look in FME_TEMP and found a few files and folders still there. After closing FME, I deleted most of the contents of FME_TEMP (I kept some FMXs). After that, the Workspace started working again! I wondered if the problem was a folder called something like FME_TempFileStore which was too big to go in the recycle bin.

So it seems that purging temporary files doesn't purge everything. Not sure if this is a bug or intended behaviour but I thought I'd share this as a tip if you find something has stopped working for apparently no reason. Obviously care needs to be taken when deleting stuff from FME_TEMP, particularly in a production environment.

Feels like we need to investigate this. I'll ask the team to check into this situation.

Feels like we need to investigate this. I'll ask the team to check into this situation.

Thanks @daleatsafe

 

Unfortunately I can't tell you exactly what steps led to this scenario as I was doing various things related and unrelated to this before I cleared out the temp files.

 

Reply


Community Stats

30,132
Posts
114,380
Replies
37,769
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.