- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Authoring

Authoring

Creating and organizing workspaces. How to use Workbench.

3,044 Posts
12,606 Replies

When you subscribe we will email you when there is a new topic in this category

3044 Posts

nic_ranContributor

Importing published parameter configuration value order

Hi, I'm importing configuration values for a "Choice or Text" published parameter. The imported values are coming from a database and the list is fairly long. I'd like the imported values to be sorted alphabetically but can't figure out a way to do it automatically. I tried adding an "order by" statement to the where clause, e.g. 1=1 order by column_name but it had no effect. I know that I could manually edit the .fmw file with a text editor but my list of imported values is long and will likely need to be updated on a fairly regular basis. Anyone have any thoughts on this? thanks, Nic

11 years ago

joaarmst

asked in Authoring

Exporting ArcGIS Metadata using a List

Hi Everyone, I just had a question regarding exporting ArcGIS Metadata using a List. We recently found this wonderful article on how to pass a list of layers to a FME Reader (http://fmepedia.safe.com/articles/How_To/Pass-a-List-of-Tables-or-Layers-to-an-FME-Reader-using-Python-Scripted-Parameters) and it works amazing, the trouble is that the metadata is not brought along with it. The location where you normally would set metadata to come accross is where this python script needs to go. Any help would be greatly appreciated Thanks!

FME Write to Excel with Custom Template

I am creating a extract process and I am needing to populate a existing template from Excel with data. The main issue is the template has 4 header rows, so I need to start writing data on Row 5. Has anyone had sucess in working with custom formats for Excel like this?

Variable Reader/dynamic Schema

Hey FME'rs I'm struggling a little bit with using trying to build in a variable reader schema. I've built the workbench where it prompts the user for the source shape file. I received a sample of the schema but there is a good chance of a different shapefile schema being input. I have tried working with the knowledge base but I'm coming up short. The output is a known schema I've created after the analysis. Does anyone have any ideas?

Need to set user parameter at shutdown for next run

Hi, I want to call same workbench again based on some feature at shutdown. I achieved this through a python shutdown script but the problem is i also want to set the user parameter for the next run. I tried but each time the workbench runs again, i takes the default value of parameter. Is there any way to set the parameter at shutdown so that next time when workbench runs it picks the value i set ? Any help would be appreciated. Thanks in advance.

Parameter in reader URL for an XML feed

The subject sort of says it all. I'm trying to setup a workbench process anyone in our team can run, or that I can work out how to automate. Basically I'm retreiving data from an XML feed that takes 2 querystring variables, one has to be the current date in the format (dd/mm/YY), the other I can make static as the number of days history of events to be retrieved. I would be grateful if anyone can advise hoe I can do this in Workbench, or if there's a method for doing it in Python (bearing in mind I'm a newbie @ Python). Thanks.

170

11 years ago

francis_mContributor

asked in Authoring

FME Quick Translator - prompt

Hi FME user, I created a workbench FMW (script) in FME Desktop. The purpose of this script is to translate Oracle data to KMZ. The tool is then delivered to my client in the FME format (FME Desktop, Save the file as: FME instead of fmw). This file is then used with FME Quick Translator. My client asked if it was possible to change the name of the prompt window FME Quick Translator. The pop-up window with the user settings is called fmequicktranslator and I wonder if it is possible to change the name to something else? an idea?

110

11 years ago

philippebEnthusiast

asked in Authoring

Save AttributeCreator parameter

I don't think that it is possible right now but with the new AttributeCreator adding the TestFilter and StringConcatenator, It would be cool that we can save our conditional values for an attribute or all of them. I have made a list of filters and concatenate strings into it, but if I would like to reuse it into an other workbench or just to be sure that all the work I have done into this transformer is saved (I have made an invalid test into the AC and all my work was gone after running my workbench! Hopefully i had the undo button!), I would like to have a file that I could select to load all my parameters rapidly. That was my suggestion of the day. Thank you.

11 years ago

fmelizardContributor

asked in Authoring

Should Attributes in Parameters be pointers?

I want to ask the community about "expected behaviour" of something. I use AttributeCreator to create Failed_Reason - it contains a value "1" (number one). So at this point @Value(Failed_Reason) = 1. This goes into a customTransformer. The customTransformer has a PublicParameter which points to Failed_Reason as an attribute using the "Attribute" type. Here's where things get confusing. Inside the customTransformer, if I use the ParameterFetcher, to return $(Parameter) I get "Failed_Reason" as a text string! Not 1. I get the same result if I pull it directly into a StringConcatenator for instance. So $(Parameter) = "Failed_Reason" (utf-8) On the other hand, if I put the parameter into a 2DPointReplacer, it works. But it gets worse! If I place an empty "attributeKeeper" before the 2DPointReplacer (so all attributes are now removed), it stops working. Why? Well, because the attributeKeeper is remov

11 years ago

fmelizardContributor

asked in Authoring

Output grouping

I have three writers (CSV, Shape, MITAB) that I want to output to the same directory. However, I want that directory to be specified within the workspace at runtime based on the fme_basename of the input. So for example: Inputs: random_dataset_1.csv random_dataset_2.xls Outputs: c:\\outputs\\random_dataset_1\\bad_data.shp c:\\outputs\\random_dataset_1\\bad_data.TAB c:\\outputs\\random_dataset_1\\bad_data.csv c:\\outputs\\random_dataset_2\\bad_data.shp c:\\outputs\\random_dataset_2\\bad_data.TAB c:\\outputs\\random_dataset_2\\bad_data.csv How can I do this? There isn't a "parameterWriter". I think I saw someone about using special fme_ attributes, but I can't recall what nor find them. Thanks.

11 years ago

vdey

asked in Authoring

Batch Deploy in FME 2013

Hi, I am new to FME. I am trying to do a batch processing to convert shapefiles to JSOn files. All my shape files are in current directory, e.g., C:\\Users\\username\\Documents\\Projects I am trying to convert each of them into a separate json file in a folder C:\\Users\\username\\Documents\\Projects\\JSON I used dataset fanout after selecting all the shapefiles as input but it is returning only json file corresponding to the first shapefile. I also used file->batch deploy by selecting the source folder with *.shp as wild card and destination as above and deselected retain basename. But it is also giving only the output from first file. Please help me out where I am wrong or if you need information. Thanks, Vivek

Legacy Data Processing

Hello, I am new to FME and I have been trying to run a process that was created by someone else. Most of the process works but when the the last process runs I get this error "An error occurred while attempting to stop an edit session. The error number from ArcObjects is: '-2147024809'. The error message from ArcObjects is: {ArcGIS product not specified. You must first bind to an ArcGIS version prior to using any ArcGIS components.} Some error has occurred during shutdown of the writer, see previous error Some error has occurred during shutdown of the writer, see previous error A fatal error has occurred." I have tried to look this error up on google and several other sources but my inexperience with FME and it's processes have me stummped at where to look. I am very familiar with ESRI and geoprocessing and looking at our databases things seem correct. I am processing to a File Geodatabase off of a versioned SDE GDB. Is there anyone who could point me in t

Hi, if I to a reader add a Schemamapper where I add a couple of attributes, and after the Schemamapper I add another transformer, why aren't the attributes shown after my Schemamapping? Is there any way to visualize them beneath the next transformer's symbol? When adding a visualizer to the Schemamapper it's possible to see the attributes. So they exists but don't want to be seen in the attribute list in the desktop under the next transformer. Weird.

620

11 years ago

reservoirdogSupporter

asked in Authoring

deployed Batch runs very slow as scheduled task

Hello community! I have 7 Batches (created via Batch deploy), that read spatial data from an oracle 10 database into SQLite. The biggest user takes, when batch is started manually, about 18 minutes. When this batch is started using windows scheduler, it takes up to 3 hours! Same for all the others. I'm using FME 2013 SP1 Oracle Edition on Windows Server 2012. neither the oracle server nor the fme server is under heavy load. (1-5% cpu). scheduled task are started as same user which starts manually the batches. (admin, highest privileges). Is there an option to tell each task its priority? is there a problem when batchfiles and tclfiles are located on desktop? (workspace are located in user\\documents\\my fme workspaces) would be thankful for any advice. best regards, chris.

1370

11 years ago

jhawksContributor

asked in Authoring

FME Server 2013 Web form question

Why is the "Show Developer information" code/form so different (and worse) than the form on the configure page. The configure page has check boxes for layers and a drop down menu for formats, but the show developer code has none of that. Can we get the code for configure form (which does't show up in view source).

11 years ago

hrinne

asked in Authoring

Error in child process '0', exited with code '1'

Hi! Im processeing a massive amount of data and the script always crashes at the same place: 2013-04-22 21:06:03|12759.7| 4.8|INFORM|0> PolygonDissolveFactory: Processing 1000 polygon(s) in tile 2566 of 3531 in round 1 Error in child process '0', exited with code '1' It occurs when dissolving with parallel processing. Any idea what it might be? crappy geometries or something related to the parallel processes? /Henrik

Custom Transformer Parameter not being set

I am using FME 2011 and having a problem passing through a calculated expression to a published parameter in a custom transformer. Here is what i am doing (which is not working). in my main workspace i have 2 published parameters that are used to compute a new value (i.e. param1*param2). I use the parameter fetcher to grab the 2 parameters, and then the expression builder to compute the new attribute. I then set this to a published parameter in a customer tranformer. In this custom transformer, this parameter is linked directly to one of the parameters in the Generalizer tranformer. When i run i get an immediate crash saying that the Generalizer cannot covert a null string. When i look at in the inspector, i see my new computed value set to @value(newexpressionattribute) when it shoudl have an integer that was computed (i.e. param1*param2). I am sure it is something simple. Any help would be appreciated.

11 years ago

anandak

asked in Authoring

When is Python Script parameter executed?

I have a reader, a tester and an attributefilewriter. I have defined a python script private parameter to connect to a database and perform a set of db transactions. The python script is reading all the feature types from the reader and performing some operation. I can see that the python script is executed at the end of the translation after the attributefilewriter writes the data. Is this the normal behavior? When is the python script executed? Is it before or after the translation I have checked that the python script parameter is executed only once and it is not being executed for each incoming feature. Also please clarify if this is the case.

Is anybody still using FME Workbench 2007

11 years ago

roy

asked in Authoring

Concurrent invocation of a workbench ?

Does FME server support concurrent invocation of a given workbench. To be specific is it possible to invoke the same workbench from N # of systems at the same given instance of time .

11 years ago

steve

asked in Authoring

Inconsistent results when batch running

We have an FME workbench with over 50 transformers that does a CAD to GIS ETL of rooms/polygons. When I run each CAD file individually, I get the correct results but when I do a batch run (using the "prompt and run" method) with either an entire folder or adding files individually, I get varying results. For example, I have 5 CAD files for a building in one folder (one file for each floor in the building). When I run the files individually, I get 1242 polygons which is the correct number. When I do a batch run as described above, I get varying number of polygons. The number varies each time it is run so if I batch run ten times, I get ten different number of polygons (i've gotten 1078, 1140, 1025, 1149, etc.). Any input on what could be causing this/how to fix it? Thank you

Custom Reusable Validation

I need to perform a validation check on particular columns of all the participating tables in a Oracle database and log the validation errors in another logger table. I want to make a generic custom transformer for this so that it can be reused in several workbenches. All other workbenches will import the custom transformer, connect the reader and specify the feature attributes that needs to be checked (e.g. null check). If the passing features have null values for the specified attributes, it will be logger in a logger table. Is this possible in FME? Any pointers conforming to best performance will be helpful.

My company will not move forward on using FME Workbench 2013 until it is confirmed as working well with our newest version of GE Smallworld. I'm always converting geometry data from AutoCAD Map into GE Smallworld data. I have to save the ACAD file as a version 2000 so Smallworld can read it. Can anybody tell me if there is a FME Workbench 2007 manual that I can find so I can better understand how the transfer of data from ACAD to GE Smallworld is setup? I would appreciate this greatly for the help! Paul21,

Generating writer sub-folder when using the dynamic schema

Hi everyone, If I'm using the Dynamic Schema to write out, can I create a sub-folder based on input formats or elsewhere? I've got a workbench I want to publish to FME server, it's quite basic. It takes shp files, runs them through a GeometryFilter and then adds appropritate statistics, i.e. for points it add the coordinates, for polygons it adds areas, etc. They write out to three different destination folders using dynamic schema: \\data\\Tasks\\Geometry_Statistics\\Writer\\Points \\data\\Tasks\\Geometry_Statistics\\Writer\\Polylines \\data\\Tasks\\Geometry_Statistics\\Writer\\Polygons These all appear as published parameters in FME server, what I'd like to do is have it so users can just specify: \\data\\Tasks\\Geometry_Statistics\\Writer\\ with FME doing the rest, i.e. dynamically creating the sub-folders. I've worked out you can link the destination to a parameter, but I can't see how you can make that parameter kind of dynamic, i.e. choose between

400

11 years ago

geminiContributor

asked in Authoring

Shutdown Python Script

Trying to copy an SQL file to an external FTP site. Using FME 2013. Here is the script: import fmeobjects import ftplib import os import glob # FTP Section print 'Connecting to FTP Site...' # Connect to FTP site s = ftplib.FTP('ftpsite','city@ftpsite','password') # Point to file to send f = open('Z:\\DataExport\\FME\\Other_Exports\\Export\\REALTY_LISTINGS_DATA_test.SQL','r') # Send the file to FTP site print 'Sending file...' s.storbinary('REALTY_LISTINGS_DATA_test.SQL', f) print 'Finished Sending file.' # Close file and FTP connection f.close() s.quit() I'm getting the following error, why? Python Exception <error_perm>: 500 ? Error executing string `import fmeobjects I am assuming Python is installed with FME. Do I have to do something else to make this work. Never used Python before. Copied most of this from a sample. Thanks

210

11 years ago

Page 119 / 122

Badge winners

kenortey8has earned the badge Teacher (Grey)
edwardhas earned the badge Integrate Data with the FME Platform Training
kailinatsafehas earned the badge Enchanted by Attributes
gazmanhas earned the badge Welcome Back
miguelhacarhas earned the badge Spanish Speaker

Show all badges

30,351: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.