Skip to main content

Authoring

Creating and organizing workspaces. How to use Workbench.

  • 3,152 Posts
  • 12,958 Replies
3152 Posts
A
anandak
asked in Authoring
When is Python Script parameter executed?

I have a reader, a tester and an attributefilewriter. I have defined a python script private parameter to connect to a database and perform a set of db transactions. The python script is reading all the feature types from the reader and performing some operation. I can see that the python script is executed at the end of the translation after the attributefilewriter writes the data. Is this the normal behavior? When is the python script executed? Is it before or after the translation I have checked that the python script parameter is executed only once and it is not being executed for each incoming feature. Also please clarify if this is the case.

100
A
P
paul21
asked in Authoring
Is anybody still using FME Workbench 2007

Is anybody still using FME Workbench 2007

61
fmelizard
Contributor
R
roy
asked in Authoring
Concurrent invocation of a workbench ?

Does FME server support concurrent invocation of a given workbench. To be specific is it possible to invoke the same workbench from N # of systems at the same given instance of time .

90
mark2atsafe
Safer
S
steve
asked in Authoring
Inconsistent results when batch running

We have an FME workbench with over 50 transformers that does a CAD to GIS ETL of rooms/polygons. When I run each CAD file individually, I get the correct results but when I do a batch run (using the "prompt and run" method) with either an entire folder or adding files individually, I get varying results. For example, I have 5 CAD files for a building in one folder (one file for each floor in the building). When I run the files individually, I get 1242 polygons which is the correct number. When I do a batch run as described above, I get varying number of polygons. The number varies each time it is run so if I batch run ten times, I get ten different number of polygons (i've gotten 1078, 1140, 1025, 1149, etc.). Any input on what could be causing this/how to fix it? Thank you

150
S
A
anandak
asked in Authoring
Custom Reusable Validation

I need to perform a validation check on particular columns of all the participating tables in a Oracle database and log the validation errors in another logger table. I want to make a generic custom transformer for this so that it can be reused in several workbenches. All other workbenches will import the custom transformer, connect the reader and specify the feature attributes that needs to be checked (e.g. null check). If the passing features have null values for the specified attributes, it will be logger in a logger table. Is this possible in FME? Any pointers conforming to best performance will be helpful.

90
david_r
Evangelist
P
paul21
asked in Authoring
FME Workbench 2007

My company will not move forward on using FME Workbench 2013 until it is confirmed as working well with our newest version of GE Smallworld. I'm always converting geometry data from AutoCAD Map into GE Smallworld data. I have to save the ACAD file as a version 2000 so Smallworld can read it. Can anybody tell me if there is a FME Workbench 2007 manual that I can find so I can better understand how the transfer of data from ACAD to GE Smallworld is setup? I would appreciate this greatly for the help! Paul21,

130
david_r
Evangelist
A
amit
asked in Authoring
Generating writer sub-folder when using the dynamic schema

Hi everyone, If I'm using the Dynamic Schema to write out, can I create a sub-folder based on input formats or elsewhere? I've got a workbench I want to publish to FME server, it's quite basic. It takes shp files, runs them through a GeometryFilter and then adds appropritate statistics, i.e. for points it add the coordinates, for polygons it adds areas, etc. They write out to three different destination folders using dynamic schema: \\data\\Tasks\\Geometry_Statistics\\Writer\\Points \\data\\Tasks\\Geometry_Statistics\\Writer\\Polylines \\data\\Tasks\\Geometry_Statistics\\Writer\\Polygons These all appear as published parameters in FME server, what I'd like to do is have it so users can just specify: \\data\\Tasks\\Geometry_Statistics\\Writer\\ with FME doing the rest, i.e. dynamically creating the sub-folders. I've worked out you can link the destination to a parameter, but I can't see how you can make that parameter kind of dynamic, i.e. choose between geometry and therefore folder na

450
A
gemini
Contributor
geminiContributor
asked in Authoring
Shutdown Python Script

Trying to copy an SQL file to an external FTP site. Using FME 2013. Here is the script: import fmeobjects import ftplib import os import glob # FTP Section print 'Connecting to FTP Site...' # Connect to FTP site s = ftplib.FTP('ftpsite','city@ftpsite','password') # Point to file to send f = open('Z:\\DataExport\\FME\\Other_Exports\\Export\\REALTY_LISTINGS_DATA_test.SQL','r') # Send the file to FTP site print 'Sending file...' s.storbinary('REALTY_LISTINGS_DATA_test.SQL', f) print 'Finished Sending file.' # Close file and FTP connection f.close() s.quit() I'm getting the following error, why? Python Exception <error_perm>: 500 ? Error executing string `import fmeobjects I am assuming Python is installed with FME. Do I have to do something else to make this work. Never used Python before. Copied most of this from a sample. Thanks.

250
gemini
Contributor
M
mark_f
asked in Authoring
Oracle Writers Sequenced Columns Parameter With Fanout

Hi, Wondering if there is a solution to this problem: When using the 'Sequenced Table Columns' Format Parameter on the Oracle Writers (allows you to specify an Attribute and Sequence to populate that Attribute with the next value from the sequence) but I couldn't use it with a Fan Out. If all Feature Types used the same Sequence that would be OK. But if one Sequence per Feature Type I couldn't get it to work. Any suggestions?

2711
M
A
artwork21
asked in Authoring
Add data column AND populate by sub directory name

Hello, I have a bunch of mapinfo line.tab files that I want to merge together. Each .tab file is in a seperate sub directory e.g. /test/one/line.tab /test/two/line.tab /test/three/line.tab I want to add a 'dir' text column to each layer before merging that is populated with the files sub directory name e.g. line.tab layer in the one directory will have a new column added 'dir' and be populated with value 'one' line.tab layer in the two directory will have a new column added 'dir' and be populated with value 'two' ...etc I see that hte AttributeCreator transformer can populate data columns, however I'm unsure how to get the data in the format as stated above. thank you

52
david_r
Evangelist
A
artwork21
asked in Authoring
Using DuplicateRemover - keep original attributes

Hello, I have a simple workbench script that reads in one shapefile. Using the DuplicateRemover I remoev all features that have a exact value. My writer is going to another shapefile. How do I keep the original columns/attribute values of the orginal input shapefile why removing the duplicate features. thanks

72
fmelizard
Contributor
D
dai
asked in Authoring
Loop Counter

Hello everyone: Now I have an excel,the item in it has fild " ID ?GID... "?the“ ID” sometimes has same value.if the “ID” is unique ?set “GID = 1”?And if there are two items have same “ID“?set the first item's "GID = 1",set the second‘s “GID = 2“? I use the DuplicateRemover one after another can sove it?But I want use a Loop then there's somthing wrong . the Loop features can't be check by the DuplicateRemover ,they all transom output from the duplicate cort? Any one can tell me something about this

170
D
A
alang
asked in Authoring
Looping Through Fields

Hello FMErs, I have a dataset with a large number of attributes I want to write to KML. Since most of the fields for any one record will be empty I'd like to check each field of each record and remove the field if it does not contain data. The search criteria for each field are the same so I'd like to loop the attributes from an array of some sort. I've looked at lists and looping in custom transformers but I can't quite see a path. Any suggestions would be greatly appreciated, Alan

134
A
frantsch
Contributor
frantschContributor
asked in Authoring
Engine control by FME Console command parameter

We have more than one FME Engine installed on our FME Server host. The Engines have different Versions, e.g. one Engine is 2012 and one 2013. This is inevitable in order to keep older workbenches functioning due to a lacking downward compatibility. So far with FME 2012 Server I was able to define on which of the engines a service will be run by assigning a parameter such as 'tm_fmeInstance Engine1' on the FME Server Console command (line). With FME 2013 Server this does no loger work. How am I to control the engine on which a service will be executed?

116
M
mhab
Contributor
mhabContributor
asked in Authoring
FME 2013 SP1 What's new Build Numbers

Hello My question refers to the What's New Info which comes with FME 2013 SP1 The What's New in the "latest" official FME 2013 says for the latest change: BUILD 13264 20130207 The What's New for FME 2013 SP1 starts with the oldest entry: BUILD 13400 20121109 and ends with the latest entry: BUILD 13448 20130319 My questions: Why is Build 13400 from Nov. 2012 when Build 13264 is from Feb 2013 ? I thought Build numbers are counted upwards ;-) What happened between 13264 and 13400 ? I' m sure there is a simple answer, but still I am confused ... Michael

110
mhab
Contributor
jan
Contributor
janContributor
asked in Authoring
TopologyBuilder in 2013 is very slow

I have tested the TopologyBuilder in FME 2012, FME 2013 and FME 2013 Server (64bit). Processing the data of approx 3milj. lines (street network) in FME 2012 takes approx. 5 hours. With FME 2013 it takes over 22 hours and in FME server it takes over 50 hours (has not reache the end yet). I noticed that the transformer has been rewritten in the new FME version (since it is different from before). I suppose it is a bug! Does anyone know of some other way to build the topology with FME?

80
david_r
Evangelist
G
gerbz
asked in Authoring
Group and ungroup Feature Types in reader groups in the Navigator Pannel

Hi, I would like how to group and ungroup feature types from reader groups in the navigator pannel I have a 150 shape files in a work bench split over about 40 groups (Readers), however I would like to alter the readers are grouped without breaking the work bench model. Presently they are in the groups based on what shape files i selected to add a single time Thanks Matt

300
G
C
canpernano
asked in Authoring
Make Workbench call to prompt for parameters

Hello: I have this code on my python shutdown script. I am invoking a second workbench, but I would like FME to prompt for the parameters upon execution, so the second workbench runs with its own parameters, according to whatever the client decides to enter: import pyfme import os import subprocess logger = pyfme.FMELogfile() fmeExecutable = os.path.normpath(FME_MacroValues['FME_HOME'])+'\\fme.exe' workBench = os.path.normpath(FME_MacroValues['Workbench_To_Run']) # initiate materialized view refresh if changes to either source if FME_TotalFeaturesWritten > 0: logger.log('Eecutable '+ fmeExecutable) logger.log('Updates detected, executing materialized view refresh script - ' + workBench) args = [fmeExecutable, workBench] p = subprocess.Popen(args) Unfortunately, the call to the second workbench runs with the default parameters, and never prompts for values. How can I : - Make FME to prompt for the parameters in the second workbench or: - Prompt for the parameters in the first workbench

94
C
G
giskis
asked in Authoring
Looping a transformer?

Hi I have a custom transformer F(a,b) I wish to 'chain' or loop an unknown number of times. (Its a customized raster overlay basically putting b on top of a) Example For six inputs features (images): 1,2,3,4,5,6 the followin should be done: result = 1 result = F(result,2) result = F(result,3) result = F(result,4) result = F(result,5) result = F(result,6) bangs head in wall :p How can this be achived? best regards!

100
G
F
francois
asked in Authoring
ListFromFilteredKvpList

Can you document this transformer? The help text only says: ListFromFilteredKvpList Creates a new list with all element which match a filter condition. FME Function Used: @Tcl2 Keyword: Lists

80
davideagle
Contributor
T
travis_k
asked in Authoring
FME_EnocodeText error on parameter

I'm trying to run a batch process using the cmd prompt and am stuck on an FME_EncodeText error for my input source shapefile. The workspace just reads in a shapefile datasource then converts it to various formats and fanouts based on basename. Any ideas Y:\\web_processing\\Projects\\Teranet\\postgis_clipper>fme.exe shp_parcel2multi_2013_02_18.fmw --src_shp Y:\\web_processing\\Projects\\Teranet\\postgis_clipper\\parcel_tiles_2013_03\\parcels_1\\parcel174355474302013tera\\Label.shp --FEATURE_TYPES "" --kml_fanout_directory parcel_tiles_2013_03_fme_kml --dwg_fanout_directory parcel_tiles_2013_03_fme_dwg --dgn_fanout_directory parcel_tiles_2013_03_fme_dgn Feature Manipulation Engine 2009 (20090106 - Build 5658) FME Professional (node locked-crc) Permanent License. Machine host name is: server17 Copyright (c) 1994 - 2009 Safe Software Inc. INCLUDE -- failed to evaluate TCL expression ` set encodedVal [FME_EncodeText { Y:\\web_processing\\Projects\\Teranet\\postgis_clipper\\parcel_tiles_2013

120
T
C
canpernano
asked in Authoring
Shutdown Python Script - Runtime errors

Hello: I am trying to implement this portion of Python code on my shutdown script, but I don't get it to work: import pyfme import fmeobjects import os import subprocess logger = pyfme.FMELogfile() fmeExecutable = os.path.normpath(FME_MacroValues['FME_Executable']) workBench = os.path.normpath(FME_MacroValues['Workbench_To_Run']) # update the File Change and Population logs if translation successful if str(FME_Status) == "True": myWorkbench.updateFileChangeLog(FME_MacroValues['FMW']) myWorkbench.updatePopulationLog(FME_FeaturesWritten) # initiate materialized view refresh if changes to either source if FME_TotalFeaturesWritten > 0: logger.log('Updates detected, executing materialized view refresh script - ' + workBench) args = [fmeExecutable, workBench] p = subprocess.Popen(args) -- Runtime errors: FME_END_PYTHON: evaluating python script from string... Python Exception <KeyError>: 'FME_Executable' Error executing string `import pyfme import os import subprocess I have seen several exa

120
C
C
canpernano
asked in Authoring
Invoking WorkspaceRunner upon completion of FME processing

Hello: I have two FME programs: 1) Loads data in one spatial table 2) Loads data in another spatial table I would like to : - Keep these scripts independent, so script 1 can run on demand and to its thing, and - Script 2) can call script 1), for extra processing. My problem is, how do I invoke Script 1) from Script 2)? They both do different data processing, but it will be great if one can call the other. I am struglling with how to invoke Script 1, because there is no way "to trigger" its processing. I would like that, once Script 2 is done, it automatically triggers Script 1. Is this possible to do? I have been trying to do this with WorkspaceRunner, but I don`t get it to "run" Thanks again. Richard.

3011
C
E
elhastino
asked in Authoring
Nested Custom Transformers

Kia-ora all, I am trying to use FME to implement a pseudo regression analysis. I have a workbench that performs a core process that comes up with 1 output value to tell me how well various parameters are corellated to a known result. This depends on a bunch of parameters (8 in all), and I need to run through testing each possible combination of parameters (256), turning them on and off, to find the best combination. Now I can create this scenario quite well with nested custom transformers, with each one just setting a parameter to 0 moving to the next nest level, then setting to 1 etc. Last level of nests is the bit where the core processing actually happens. This effectively loops through all 256 possibiities, without technically looping in FME. But I am discovering that this is probably not the most efficient way to do it, as each extra nest adds a load of time to actually working in workbench, as presumably it always has to think of how anything I do affects any nests underneath it.

390
E
owen
owen
asked in Authoring
Tagging all features with an attribute

Hi, Me again. I want to use the date and time the workspace is run as the output file name. At the moment, I am using a creator, timestamper and featuremerger to add the datetime attribute, then using fanout dataset on the datetime. This seems a bit of a clumsy way of doing it, as the featuremerger is slow when processing lots of features. Can anyone think of a better way? Really I want to tag all features with the same value. I could do this by creating a published parameter, but cant think how to populate it with date/time. Thanks, Owen

100
F

Most helpful members this week

Badge winners

  • English Speaker
    ntaplinhas earned the badge English Speaker
  • Welcome Back
    ntaplinhas earned the badge Welcome Back
  • FME Form Basic Training
    selasikhas earned the badge FME Form Basic Training
  • FME Form Basic Training
    johnny_ajrhas earned the badge FME Form Basic Training
  • Integrate Spatial Data
    vmerguhas earned the badge Integrate Spatial Data
Show all badges
30,846
Posts

Popular tags

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.