Skip to main content
Question

Reading multiple files in a filemap

  • January 29, 2019
  • 4 replies
  • 37 views
L
Forum|alt.badge.img

Hello,

I periodically load the latest version of topographic data (shape format) from many municipalities in our GIS system. The data is loaded per topographic object (for example: a workbench for buildings, an other workbench for roads, ...). Each workbench loads the data for all municipalities together.

 

The first time the data was loaded the source contained 94 shape files (94 municipalities). The second time this was 92 (9 old deleted and 7 new added).

 

I have adjusted the change in the data manually (update features and connect the new ones), a work that does take some time. Should the number of municipalities change again next time, the reader must be updated again.

 

Is there a possibility to automatically read all shape files (which can change in number and file name) in one and the same folder, without the need to make manual adjustments?

 

 

Thanks!

Luc

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

4 replies

redgeographics
Celebrity
Forum|alt.badge.img+62

You can set the reader to read all files in a directory, click the little triangle button to the right of the [...] button where you select the source data.

However, this will generate only one feature type for all your input shapefiles, which may not be the best solution when they've got different schema's. Can you tell us a bit more about your data?

FME rocks! \m/
L
Forum|alt.badge.img
  • lucvdberghe
  • Author
  • January 30, 2019

Hi,

All functions have the same schema's, so I tested the function you described. This works perfectly!

Thanks a lot for your help!

Luc

PS: I have added some screenshots to clarify the settings. What I am not sure of, is whether the 'Identical Schema' button should be ticked. The result remains the same if it is checked or not, even if a feature in the folder has a different schema.

 

redgeographics
Celebrity
Forum|alt.badge.img+62

Hi,

All functions have the same schema's, so I tested the function you described. This works perfectly!

Thanks a lot for your help!

Luc

PS: I have added some screenshots to clarify the settings. What I am not sure of, is whether the 'Identical Schema' button should be ticked. The result remains the same if it is checked or not, even if a feature in the folder has a different schema.

 

Good to hear it's working out for you. You're right, the Identical Schema option doesn't seem to have any effect. @Mark2AtSafe, can you check what it's supposed to do?

FME rocks! \m/
mark2atsafe
Safer
Forum|alt.badge.img+59
  • mark2atsafeSafer
  • Safer
  • January 30, 2019

Good to hear it's working out for you. You're right, the Identical Schema option doesn't seem to have any effect. @Mark2AtSafe, can you check what it's supposed to do?

@redgeographics and @lucvdberghe - It's not very clear at all (sorry) but "Identical Schema" is just a time-saving mechanism, not one that affects the workspace.

So if you are reading 10,000 files you can check the box and FME will assume the first file holds the correct schema and not scan the other 9,999. If the box is unchecked it will scan all 10,000 files to see what it thinks the schema should be.

If 9,999 files have the same schema, and one is different, then it would go with the majority for the schema definition.

So don't check the option if the 1 different file is the first one!

FME Evangelist to the Rich and Famous!!

Community Stats

32,207
Posts
122,305
Replies
39,891
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.