Skip to main content
Solved

Does FME support ZIP64?

  • November 29, 2018
  • 7 replies
  • 11 views

takashi
Contributor
Forum|alt.badge.img+19

Just a confirmation on FME specifications.

Does FME support "ZIP64" (allowing to create larger than 4GB archive) on every 64-bit platform - Windows, Linux and MacOS - for writing features into a destination archive?

Best answer by fmelizard

We use the same compression library for all the writers as is used in the File Copy. So therefore I believe that yes, all the FME writers will support ZIP64 across all platforms. The team advises that we've not tested if individual files being zipped can be greater than 4GB, so take care if you're in that situation.

View original
Did this help you find an answer to your question?

7 replies

f.kemminje
Contributor
Forum|alt.badge.img+11
  • Contributor
  • November 29, 2018

currently not I think. you can include your idea.


takashi
Contributor
Forum|alt.badge.img+19
  • Author
  • Contributor
  • November 30, 2018

Hi @fkemminje, thanks for your response.

I tested to archive a folder containing many sub-folders and files into a single zip file with the File Copy writer, FME 2018.1.0.3 64-bit running on Windows. The total size of the original sub-folders/files was about 23GB.

Result, the File Copy writer was able to compress the sub-folders/files into a single 12GB zip file. So I think at least the File Copy writer supports ZIP64, on Windows.

I would like to know if it's guaranteed that every writer supports ZIP64 on every platform, not only the File Copy writer on Windows.


gio
Contributor
Forum|alt.badge.img+15
  • Contributor
  • November 30, 2018

zip 64 can go up to 2^64 ...and is old(?2004-ish)16 exabytes that's quite something.

But I read that current winzip limitation 64 bit system is..16exabytes.

Seems you can indeed stuff large amounts of data in current winzip.


takashi
Contributor
Forum|alt.badge.img+19
  • Author
  • Contributor
  • November 30, 2018

Thanks for your input, @gio.

It seems that Windows Explorer (Vista or later) supports ZIP64. If FME for Windows would always use the same library as Windows Explorer to archive destination datasets, we could consider that FME does support ZIP64 on Windows.

How about on Linux? Does it depend on version of the zip command installed into the system?

I hope someone from Safe can clarify this.


fmelizard
Contributor
Forum|alt.badge.img+17
  • Contributor
  • Best Answer
  • November 30, 2018

We use the same compression library for all the writers as is used in the File Copy. So therefore I believe that yes, all the FME writers will support ZIP64 across all platforms. The team advises that we've not tested if individual files being zipped can be greater than 4GB, so take care if you're in that situation.


fmelizard
Contributor
Forum|alt.badge.img+17
  • Contributor
  • November 30, 2018
takashi wrote:

Hi @fkemminje, thanks for your response.

I tested to archive a folder containing many sub-folders and files into a single zip file with the File Copy writer, FME 2018.1.0.3 64-bit running on Windows. The total size of the original sub-folders/files was about 23GB.

Result, the File Copy writer was able to compress the sub-folders/files into a single 12GB zip file. So I think at least the File Copy writer supports ZIP64, on Windows.

I would like to know if it's guaranteed that every writer supports ZIP64 on every platform, not only the File Copy writer on Windows.

We use the same compression library for all the writers as is used in the File Copy. So therefore I believe that yes, all the FME writers will support ZIP64 across all platforms. The team advises that we've not tested if individual files being zipped can be greater than 4GB, so take care if you're in that situation.


takashi
Contributor
Forum|alt.badge.img+19
  • Author
  • Contributor
  • November 30, 2018
fmelizard wrote:

We use the same compression library for all the writers as is used in the File Copy. So therefore I believe that yes, all the FME writers will support ZIP64 across all platforms. The team advises that we've not tested if individual files being zipped can be greater than 4GB, so take care if you're in that situation.

Thanks for your answer. For now, it's enough to know that all writers support ZIP64 on every platform.


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings