Creating and organizing workspaces. How to use Workbench.
Recently active
I want to ask the community about "expected behaviour" of something. I use AttributeCreator to create Failed_Reason - it contains a value "1" (number one). So at this point @Value(Failed_Reason) = 1. This goes into a customTransformer. The customTransformer has a PublicParameter which points to Failed_Reason as an attribute using the "Attribute" type. Here's where things get confusing. Inside the customTransformer, if I use the ParameterFetcher, to return $(Parameter) I get "Failed_Reason" as a text string! Not 1. I get the same result if I pull it directly into a StringConcatenator for instance. So $(Parameter) = "Failed_Reason" (utf-8) On the other hand, if I put the parameter into a 2DPointReplacer, it works. But it gets worse! If I place an empty "attributeKeeper" before the 2DPointReplacer (so all attributes are now removed), it stops working. Why? Well, because the attributeKeeper is remov
I have three writers (CSV, Shape, MITAB) that I want to output to the same directory. However, I want that directory to be specified within the workspace at runtime based on the fme_basename of the input. So for example: Inputs: random_dataset_1.csv random_dataset_2.xls Outputs: c:\\outputs\\random_dataset_1\\bad_data.shp c:\\outputs\\random_dataset_1\\bad_data.TAB c:\\outputs\\random_dataset_1\\bad_data.csv c:\\outputs\\random_dataset_2\\bad_data.shp c:\\outputs\\random_dataset_2\\bad_data.TAB c:\\outputs\\random_dataset_2\\bad_data.csv How can I do this? There isn't a "parameterWriter". I think I saw someone about using special fme_ attributes, but I can't recall what nor find them. Thanks.
Hi, I am new to FME. I am trying to do a batch processing to convert shapefiles to JSOn files. All my shape files are in current directory, e.g., C:\\Users\\username\\Documents\\Projects I am trying to convert each of them into a separate json file in a folder C:\\Users\\username\\Documents\\Projects\\JSON I used dataset fanout after selecting all the shapefiles as input but it is returning only json file corresponding to the first shapefile. I also used file->batch deploy by selecting the source folder with *.shp as wild card and destination as above and deselected retain basename. But it is also giving only the output from first file. Please help me out where I am wrong or if you need information. Thanks, Vivek
Hello, I am new to FME and I have been trying to run a process that was created by someone else. Most of the process works but when the the last process runs I get this error "An error occurred while attempting to stop an edit session. The error number from ArcObjects is: '-2147024809'. The error message from ArcObjects is: {ArcGIS product not specified. You must first bind to an ArcGIS version prior to using any ArcGIS components.} Some error has occurred during shutdown of the writer, see previous error Some error has occurred during shutdown of the writer, see previous error A fatal error has occurred." I have tried to look this error up on google and several other sources but my inexperience with FME and it's processes have me stummped at where to look. I am very familiar with ESRI and geoprocessing and looking at our databases things seem correct. I am processing to a File Geodatabase off of a versioned SDE GDB. Is there anyone who could point me in t
Hi, if I to a reader add a Schemamapper where I add a couple of attributes, and after the Schemamapper I add another transformer, why aren't the attributes shown after my Schemamapping? Is there any way to visualize them beneath the next transformer's symbol? When adding a visualizer to the Schemamapper it's possible to see the attributes. So they exists but don't want to be seen in the attribute list in the desktop under the next transformer. Weird.
Hello community! I have 7 Batches (created via Batch deploy), that read spatial data from an oracle 10 database into SQLite. The biggest user takes, when batch is started manually, about 18 minutes. When this batch is started using windows scheduler, it takes up to 3 hours! Same for all the others. I'm using FME 2013 SP1 Oracle Edition on Windows Server 2012. neither the oracle server nor the fme server is under heavy load. (1-5% cpu). scheduled task are started as same user which starts manually the batches. (admin, highest privileges). Is there an option to tell each task its priority? is there a problem when batchfiles and tclfiles are located on desktop? (workspace are located in user\\documents\\my fme workspaces) would be thankful for any advice. best regards, chris.
Why is the "Show Developer information" code/form so different (and worse) than the form on the configure page. The configure page has check boxes for layers and a drop down menu for formats, but the show developer code has none of that. Can we get the code for configure form (which does't show up in view source).
Hi! Im processeing a massive amount of data and the script always crashes at the same place: 2013-04-22 21:06:03|12759.7| 4.8|INFORM|0> PolygonDissolveFactory: Processing 1000 polygon(s) in tile 2566 of 3531 in round 1 Error in child process '0', exited with code '1' It occurs when dissolving with parallel processing. Any idea what it might be? crappy geometries or something related to the parallel processes? /Henrik
I am using FME 2011 and having a problem passing through a calculated expression to a published parameter in a custom transformer. Here is what i am doing (which is not working). in my main workspace i have 2 published parameters that are used to compute a new value (i.e. param1*param2). I use the parameter fetcher to grab the 2 parameters, and then the expression builder to compute the new attribute. I then set this to a published parameter in a customer tranformer. In this custom transformer, this parameter is linked directly to one of the parameters in the Generalizer tranformer. When i run i get an immediate crash saying that the Generalizer cannot covert a null string. When i look at in the inspector, i see my new computed value set to @value(newexpressionattribute) when it shoudl have an integer that was computed (i.e. param1*param2). I am sure it is something simple. Any help would be appreciated.
I have a reader, a tester and an attributefilewriter. I have defined a python script private parameter to connect to a database and perform a set of db transactions. The python script is reading all the feature types from the reader and performing some operation. I can see that the python script is executed at the end of the translation after the attributefilewriter writes the data. Is this the normal behavior? When is the python script executed? Is it before or after the translation I have checked that the python script parameter is executed only once and it is not being executed for each incoming feature. Also please clarify if this is the case.
Is anybody still using FME Workbench 2007
Does FME server support concurrent invocation of a given workbench. To be specific is it possible to invoke the same workbench from N # of systems at the same given instance of time .
We have an FME workbench with over 50 transformers that does a CAD to GIS ETL of rooms/polygons. When I run each CAD file individually, I get the correct results but when I do a batch run (using the "prompt and run" method) with either an entire folder or adding files individually, I get varying results. For example, I have 5 CAD files for a building in one folder (one file for each floor in the building). When I run the files individually, I get 1242 polygons which is the correct number. When I do a batch run as described above, I get varying number of polygons. The number varies each time it is run so if I batch run ten times, I get ten different number of polygons (i've gotten 1078, 1140, 1025, 1149, etc.). Any input on what could be causing this/how to fix it? Thank you
I need to perform a validation check on particular columns of all the participating tables in a Oracle database and log the validation errors in another logger table. I want to make a generic custom transformer for this so that it can be reused in several workbenches. All other workbenches will import the custom transformer, connect the reader and specify the feature attributes that needs to be checked (e.g. null check). If the passing features have null values for the specified attributes, it will be logger in a logger table. Is this possible in FME? Any pointers conforming to best performance will be helpful.
My company will not move forward on using FME Workbench 2013 until it is confirmed as working well with our newest version of GE Smallworld. I'm always converting geometry data from AutoCAD Map into GE Smallworld data. I have to save the ACAD file as a version 2000 so Smallworld can read it. Can anybody tell me if there is a FME Workbench 2007 manual that I can find so I can better understand how the transfer of data from ACAD to GE Smallworld is setup? I would appreciate this greatly for the help! Paul21,
Hi everyone, If I'm using the Dynamic Schema to write out, can I create a sub-folder based on input formats or elsewhere? I've got a workbench I want to publish to FME server, it's quite basic. It takes shp files, runs them through a GeometryFilter and then adds appropritate statistics, i.e. for points it add the coordinates, for polygons it adds areas, etc. They write out to three different destination folders using dynamic schema: \\data\\Tasks\\Geometry_Statistics\\Writer\\Points \\data\\Tasks\\Geometry_Statistics\\Writer\\Polylines \\data\\Tasks\\Geometry_Statistics\\Writer\\Polygons These all appear as published parameters in FME server, what I'd like to do is have it so users can just specify: \\data\\Tasks\\Geometry_Statistics\\Writer\\ with FME doing the rest, i.e. dynamically creating the sub-folders. I've worked out you can link the destination to a parameter, but I can't see how you can make that parameter kind of dynamic, i.e. choose between
Trying to copy an SQL file to an external FTP site. Using FME 2013. Here is the script: import fmeobjects import ftplib import os import glob # FTP Section print 'Connecting to FTP Site...' # Connect to FTP site s = ftplib.FTP('ftpsite','city@ftpsite','password') # Point to file to send f = open('Z:\\DataExport\\FME\\Other_Exports\\Export\\REALTY_LISTINGS_DATA_test.SQL','r') # Send the file to FTP site print 'Sending file...' s.storbinary('REALTY_LISTINGS_DATA_test.SQL', f) print 'Finished Sending file.' # Close file and FTP connection f.close() s.quit() I'm getting the following error, why? Python Exception <error_perm>: 500 ? Error executing string `import fmeobjects I am assuming Python is installed with FME. Do I have to do something else to make this work. Never used Python before. Copied most of this from a sample. Thanks
Hi, Wondering if there is a solution to this problem: When using the 'Sequenced Table Columns' Format Parameter on the Oracle Writers (allows you to specify an Attribute and Sequence to populate that Attribute with the next value from the sequence) but I couldn't use it with a Fan Out. If all Feature Types used the same Sequence that would be OK. But if one Sequence per Feature Type I couldn't get it to work. Any suggestions?
Hello, I have a bunch of mapinfo line.tab files that I want to merge together. Each .tab file is in a seperate sub directory e.g. /test/one/line.tab /test/two/line.tab /test/three/line.tab I want to add a 'dir' text column to each layer before merging that is populated with the files sub directory name e.g. line.tab layer in the one directory will have a new column added 'dir' and be populated with value 'one' line.tab layer in the two directory will have a new column added 'dir' and be populated with value 'two' ...etc I see that hte AttributeCreator transformer can populate data columns, however I'm unsure how to get the data in the format as stated above. thank you
Hello, I have a simple workbench script that reads in one shapefile. Using the DuplicateRemover I remoev all features that have a exact value. My writer is going to another shapefile. How do I keep the original columns/attribute values of the orginal input shapefile why removing the duplicate features. thanks
Hello everyone: Now I have an excel,the item in it has fild " ID ?GID... "?the“ ID” sometimes has same value.if the “ID” is unique ?set “GID = 1”?And if there are two items have same “ID“?set the first item's "GID = 1",set the second‘s “GID = 2“? I use the DuplicateRemover one after another can sove it?But I want use a Loop then there's somthing wrong . the Loop features can't be check by the DuplicateRemover ,they all transom output from the duplicate cort? Any one can tell me something about this
Hello FMErs, I have a dataset with a large number of attributes I want to write to KML. Since most of the fields for any one record will be empty I'd like to check each field of each record and remove the field if it does not contain data. The search criteria for each field are the same so I'd like to loop the attributes from an array of some sort. I've looked at lists and looping in custom transformers but I can't quite see a path. Any suggestions would be greatly appreciated, Alan
We have more than one FME Engine installed on our FME Server host. The Engines have different Versions, e.g. one Engine is 2012 and one 2013. This is inevitable in order to keep older workbenches functioning due to a lacking downward compatibility. So far with FME 2012 Server I was able to define on which of the engines a service will be run by assigning a parameter such as 'tm_fmeInstance Engine1' on the FME Server Console command (line). With FME 2013 Server this does no loger work. How am I to control the engine on which a service will be executed?
Hello My question refers to the What's New Info which comes with FME 2013 SP1 The What's New in the "latest" official FME 2013 says for the latest change: BUILD 13264 20130207 The What's New for FME 2013 SP1 starts with the oldest entry: BUILD 13400 20121109 and ends with the latest entry: BUILD 13448 20130319 My questions: Why is Build 13400 from Nov. 2012 when Build 13264 is from Feb 2013 ? I thought Build numbers are counted upwards ;-) What happened between 13264 and 13400 ? I' m sure there is a simple answer, but still I am confused ... Michael
I have tested the TopologyBuilder in FME 2012, FME 2013 and FME 2013 Server (64bit). Processing the data of approx 3milj. lines (street network) in FME 2012 takes approx. 5 hours. With FME 2013 it takes over 22 hours and in FME server it takes over 50 hours (has not reache the end yet). I noticed that the transformer has been rewritten in the new FME version (since it is different from before). I suppose it is a bug! Does anyone know of some other way to build the topology with FME?