Question
Having trouble reading OS Open Names. This product is supplied as multiple (headerless) CSVs packed into multiple sets of zipped folders. I want to create a single reader and assign column names.
Having trouble reading OS Open Names. This product is supplied as multiple (headerless) CSVs packed into multiple sets of zipped folders. I want to create a single reader and assign column names.
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
Typical zip file name ... "opname_csv_nz.zip" ... within each zipped folder the data files I'm after live in a sub-folder called DATA all with names of the form AANN.csv
Confusingly/annoyingly there is also another sub-folder called DOC which contains CSV files I don't want.
So what I want the reader to do is delve into each of the ZIP folders (there are 9), dig down into the DATA folder in each case and suck out all the CSVs (up to 25 in each DATA folder) and spit them out into a single data stream.
Hi,
consider doing all the unpacking in a startup script. Here are some tips to get you started recursively unpacking a zip-file using Python:
http://stackoverflow.com/questions/10902409/recursively-unzip-archives-store-filename-extracted-contents-in-dictionary
David
Hi,
I suppose that the zip contains hierachy foloder structure, but is not recursively zipped.
If my understanding is right, this Dataset setting might help you.
-----
C:\\<directory path>\\*.zip\\**\\DATA\\*.csv
-----
See also here.
Reading from a Zip File (http://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Desktop_Help.htm#../Subsystems/FME_Workbench/Content/Workbench/zip_files_reading.htm)
Takashi