Skip to main content
Question

TIP: Suddenly FME won't read CSV file(s) in Zip file


tim_wood
Contributor
Forum|alt.badge.img+8

FME 2017.0, CSV2 Reader reading 10 million records from 2 CSVs: X:\\Folder\\MyZIP_*.zip\\Data\\*_AA.csv,X:\\Folder\\MyZip_*.zip\\Data\\*_BB.csv

It worked fine for a while, then suddenly stopped working.

I tried making sure I wasn't in the Zip file in Windows Explorer, rebooted, and purged temporary files, but nothing solved the problem. So I had a look in FME_TEMP and found a few files and folders still there. After closing FME, I deleted most of the contents of FME_TEMP (I kept some FMXs). After that, the Workspace started working again! I wondered if the problem was a folder called something like FME_TempFileStore which was too big to go in the recycle bin.

So it seems that purging temporary files doesn't purge everything. Not sure if this is a bug or intended behaviour but I thought I'd share this as a tip if you find something has stopped working for apparently no reason. Obviously care needs to be taken when deleting stuff from FME_TEMP, particularly in a production environment.

2 replies

fmelizard
Safer
Forum|alt.badge.img+18
  • Safer
  • April 22, 2017

Feels like we need to investigate this. I'll ask the team to check into this situation.


tim_wood
Contributor
Forum|alt.badge.img+8
  • Author
  • Contributor
  • April 27, 2017
fmelizard wrote:

Feels like we need to investigate this. I'll ask the team to check into this situation.

Thanks @daleatsafe

 

Unfortunately I can't tell you exactly what steps led to this scenario as I was doing various things related and unrelated to this before I cleared out the temp files.

 


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings