Skip to main content
Question

TIP: Suddenly FME won't read CSV file(s) in Zip file

  • April 20, 2017
  • 2 replies
  • 59 views
tim_wood
Contributor
Forum|alt.badge.img+8

FME 2017.0, CSV2 Reader reading 10 million records from 2 CSVs: X:\\Folder\\MyZIP_*.zip\\Data\\*_AA.csv,X:\\Folder\\MyZip_*.zip\\Data\\*_BB.csv

It worked fine for a while, then suddenly stopped working.

I tried making sure I wasn't in the Zip file in Windows Explorer, rebooted, and purged temporary files, but nothing solved the problem. So I had a look in FME_TEMP and found a few files and folders still there. After closing FME, I deleted most of the contents of FME_TEMP (I kept some FMXs). After that, the Workspace started working again! I wondered if the problem was a folder called something like FME_TempFileStore which was too big to go in the recycle bin.

So it seems that purging temporary files doesn't purge everything. Not sure if this is a bug or intended behaviour but I thought I'd share this as a tip if you find something has stopped working for apparently no reason. Obviously care needs to be taken when deleting stuff from FME_TEMP, particularly in a production environment.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

fmelizard
Safer
Forum|alt.badge.img+22
  • fmelizardSafer
  • Safer
  • April 22, 2017

Feels like we need to investigate this. I'll ask the team to check into this situation.

tim_wood
Contributor
Forum|alt.badge.img+8
  • tim_woodContributor
  • Author
  • Contributor
  • April 27, 2017

Feels like we need to investigate this. I'll ask the team to check into this situation.

Thanks @daleatsafe

 

Unfortunately I can't tell you exactly what steps led to this scenario as I was doing various things related and unrelated to this before I cleared out the temp files.

 

Community Stats

32,623
Posts
123,817
Replies
40,987
Members
Terms & ConditionsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.