Creating and organizing workspaces. How to use Workbench.
Recently active
I am creating a extract process and I am needing to populate a existing template from Excel with data. The main issue is the template has 4 header rows, so I need to start writing data on Row 5. Has anyone had sucess in working with custom formats for Excel like this?
Hey FME'rs I'm struggling a little bit with using trying to build in a variable reader schema. I've built the workbench where it prompts the user for the source shape file. I received a sample of the schema but there is a good chance of a different shapefile schema being input. I have tried working with the knowledge base but I'm coming up short. The output is a known schema I've created after the analysis. Does anyone have any ideas?
Hi, I want to call same workbench again based on some feature at shutdown. I achieved this through a python shutdown script but the problem is i also want to set the user parameter for the next run. I tried but each time the workbench runs again, i takes the default value of parameter. Is there any way to set the parameter at shutdown so that next time when workbench runs it picks the value i set ? Any help would be appreciated. Thanks in advance.
The subject sort of says it all. I'm trying to setup a workbench process anyone in our team can run, or that I can work out how to automate. Basically I'm retreiving data from an XML feed that takes 2 querystring variables, one has to be the current date in the format (dd/mm/YY), the other I can make static as the number of days history of events to be retrieved. I would be grateful if anyone can advise hoe I can do this in Workbench, or if there's a method for doing it in Python (bearing in mind I'm a newbie @ Python). Thanks.
Hi FME user, I created a workbench FMW (script) in FME Desktop. The purpose of this script is to translate Oracle data to KMZ. The tool is then delivered to my client in the FME format (FME Desktop, Save the file as: FME instead of fmw). This file is then used with FME Quick Translator. My client asked if it was possible to change the name of the prompt window FME Quick Translator. The pop-up window with the user settings is called fmequicktranslator and I wonder if it is possible to change the name to something else? an idea?
I don't think that it is possible right now but with the new AttributeCreator adding the TestFilter and StringConcatenator, It would be cool that we can save our conditional values for an attribute or all of them. I have made a list of filters and concatenate strings into it, but if I would like to reuse it into an other workbench or just to be sure that all the work I have done into this transformer is saved (I have made an invalid test into the AC and all my work was gone after running my workbench! Hopefully i had the undo button!), I would like to have a file that I could select to load all my parameters rapidly. That was my suggestion of the day. Thank you.
I want to ask the community about "expected behaviour" of something. I use AttributeCreator to create Failed_Reason - it contains a value "1" (number one). So at this point @Value(Failed_Reason) = 1. This goes into a customTransformer. The customTransformer has a PublicParameter which points to Failed_Reason as an attribute using the "Attribute" type. Here's where things get confusing. Inside the customTransformer, if I use the ParameterFetcher, to return $(Parameter) I get "Failed_Reason" as a text string! Not 1. I get the same result if I pull it directly into a StringConcatenator for instance. So $(Parameter) = "Failed_Reason" (utf-8) On the other hand, if I put the parameter into a 2DPointReplacer, it works. But it gets worse! If I place an empty "attributeKeeper" before the 2DPointReplacer (so all attributes are now removed), it stops working. Why? Well, because the attributeKeeper is remov
I have three writers (CSV, Shape, MITAB) that I want to output to the same directory. However, I want that directory to be specified within the workspace at runtime based on the fme_basename of the input. So for example: Inputs: random_dataset_1.csv random_dataset_2.xls Outputs: c:\\outputs\\random_dataset_1\\bad_data.shp c:\\outputs\\random_dataset_1\\bad_data.TAB c:\\outputs\\random_dataset_1\\bad_data.csv c:\\outputs\\random_dataset_2\\bad_data.shp c:\\outputs\\random_dataset_2\\bad_data.TAB c:\\outputs\\random_dataset_2\\bad_data.csv How can I do this? There isn't a "parameterWriter". I think I saw someone about using special fme_ attributes, but I can't recall what nor find them. Thanks.
Hi, I am new to FME. I am trying to do a batch processing to convert shapefiles to JSOn files. All my shape files are in current directory, e.g., C:\\Users\\username\\Documents\\Projects I am trying to convert each of them into a separate json file in a folder C:\\Users\\username\\Documents\\Projects\\JSON I used dataset fanout after selecting all the shapefiles as input but it is returning only json file corresponding to the first shapefile. I also used file->batch deploy by selecting the source folder with *.shp as wild card and destination as above and deselected retain basename. But it is also giving only the output from first file. Please help me out where I am wrong or if you need information. Thanks, Vivek
Hello, I am new to FME and I have been trying to run a process that was created by someone else. Most of the process works but when the the last process runs I get this error "An error occurred while attempting to stop an edit session. The error number from ArcObjects is: '-2147024809'. The error message from ArcObjects is: {ArcGIS product not specified. You must first bind to an ArcGIS version prior to using any ArcGIS components.} Some error has occurred during shutdown of the writer, see previous error Some error has occurred during shutdown of the writer, see previous error A fatal error has occurred." I have tried to look this error up on google and several other sources but my inexperience with FME and it's processes have me stummped at where to look. I am very familiar with ESRI and geoprocessing and looking at our databases things seem correct. I am processing to a File Geodatabase off of a versioned SDE GDB. Is there anyone who could point me in t
Hi, if I to a reader add a Schemamapper where I add a couple of attributes, and after the Schemamapper I add another transformer, why aren't the attributes shown after my Schemamapping? Is there any way to visualize them beneath the next transformer's symbol? When adding a visualizer to the Schemamapper it's possible to see the attributes. So they exists but don't want to be seen in the attribute list in the desktop under the next transformer. Weird.
Hello community! I have 7 Batches (created via Batch deploy), that read spatial data from an oracle 10 database into SQLite. The biggest user takes, when batch is started manually, about 18 minutes. When this batch is started using windows scheduler, it takes up to 3 hours! Same for all the others. I'm using FME 2013 SP1 Oracle Edition on Windows Server 2012. neither the oracle server nor the fme server is under heavy load. (1-5% cpu). scheduled task are started as same user which starts manually the batches. (admin, highest privileges). Is there an option to tell each task its priority? is there a problem when batchfiles and tclfiles are located on desktop? (workspace are located in user\\documents\\my fme workspaces) would be thankful for any advice. best regards, chris.
Why is the "Show Developer information" code/form so different (and worse) than the form on the configure page. The configure page has check boxes for layers and a drop down menu for formats, but the show developer code has none of that. Can we get the code for configure form (which does't show up in view source).
Hi! Im processeing a massive amount of data and the script always crashes at the same place: 2013-04-22 21:06:03|12759.7| 4.8|INFORM|0> PolygonDissolveFactory: Processing 1000 polygon(s) in tile 2566 of 3531 in round 1 Error in child process '0', exited with code '1' It occurs when dissolving with parallel processing. Any idea what it might be? crappy geometries or something related to the parallel processes? /Henrik
I am using FME 2011 and having a problem passing through a calculated expression to a published parameter in a custom transformer. Here is what i am doing (which is not working). in my main workspace i have 2 published parameters that are used to compute a new value (i.e. param1*param2). I use the parameter fetcher to grab the 2 parameters, and then the expression builder to compute the new attribute. I then set this to a published parameter in a customer tranformer. In this custom transformer, this parameter is linked directly to one of the parameters in the Generalizer tranformer. When i run i get an immediate crash saying that the Generalizer cannot covert a null string. When i look at in the inspector, i see my new computed value set to @value(newexpressionattribute) when it shoudl have an integer that was computed (i.e. param1*param2). I am sure it is something simple. Any help would be appreciated.
I have a reader, a tester and an attributefilewriter. I have defined a python script private parameter to connect to a database and perform a set of db transactions. The python script is reading all the feature types from the reader and performing some operation. I can see that the python script is executed at the end of the translation after the attributefilewriter writes the data. Is this the normal behavior? When is the python script executed? Is it before or after the translation I have checked that the python script parameter is executed only once and it is not being executed for each incoming feature. Also please clarify if this is the case.
Is anybody still using FME Workbench 2007
Does FME server support concurrent invocation of a given workbench. To be specific is it possible to invoke the same workbench from N # of systems at the same given instance of time .
We have an FME workbench with over 50 transformers that does a CAD to GIS ETL of rooms/polygons. When I run each CAD file individually, I get the correct results but when I do a batch run (using the "prompt and run" method) with either an entire folder or adding files individually, I get varying results. For example, I have 5 CAD files for a building in one folder (one file for each floor in the building). When I run the files individually, I get 1242 polygons which is the correct number. When I do a batch run as described above, I get varying number of polygons. The number varies each time it is run so if I batch run ten times, I get ten different number of polygons (i've gotten 1078, 1140, 1025, 1149, etc.). Any input on what could be causing this/how to fix it? Thank you
I need to perform a validation check on particular columns of all the participating tables in a Oracle database and log the validation errors in another logger table. I want to make a generic custom transformer for this so that it can be reused in several workbenches. All other workbenches will import the custom transformer, connect the reader and specify the feature attributes that needs to be checked (e.g. null check). If the passing features have null values for the specified attributes, it will be logger in a logger table. Is this possible in FME? Any pointers conforming to best performance will be helpful.
My company will not move forward on using FME Workbench 2013 until it is confirmed as working well with our newest version of GE Smallworld. I'm always converting geometry data from AutoCAD Map into GE Smallworld data. I have to save the ACAD file as a version 2000 so Smallworld can read it. Can anybody tell me if there is a FME Workbench 2007 manual that I can find so I can better understand how the transfer of data from ACAD to GE Smallworld is setup? I would appreciate this greatly for the help! Paul21,
Hi everyone, If I'm using the Dynamic Schema to write out, can I create a sub-folder based on input formats or elsewhere? I've got a workbench I want to publish to FME server, it's quite basic. It takes shp files, runs them through a GeometryFilter and then adds appropritate statistics, i.e. for points it add the coordinates, for polygons it adds areas, etc. They write out to three different destination folders using dynamic schema: \\data\\Tasks\\Geometry_Statistics\\Writer\\Points \\data\\Tasks\\Geometry_Statistics\\Writer\\Polylines \\data\\Tasks\\Geometry_Statistics\\Writer\\Polygons These all appear as published parameters in FME server, what I'd like to do is have it so users can just specify: \\data\\Tasks\\Geometry_Statistics\\Writer\\ with FME doing the rest, i.e. dynamically creating the sub-folders. I've worked out you can link the destination to a parameter, but I can't see how you can make that parameter kind of dynamic, i.e. choose between
Trying to copy an SQL file to an external FTP site. Using FME 2013. Here is the script: import fmeobjects import ftplib import os import glob # FTP Section print 'Connecting to FTP Site...' # Connect to FTP site s = ftplib.FTP('ftpsite','city@ftpsite','password') # Point to file to send f = open('Z:\\DataExport\\FME\\Other_Exports\\Export\\REALTY_LISTINGS_DATA_test.SQL','r') # Send the file to FTP site print 'Sending file...' s.storbinary('REALTY_LISTINGS_DATA_test.SQL', f) print 'Finished Sending file.' # Close file and FTP connection f.close() s.quit() I'm getting the following error, why? Python Exception <error_perm>: 500 ? Error executing string `import fmeobjects I am assuming Python is installed with FME. Do I have to do something else to make this work. Never used Python before. Copied most of this from a sample. Thanks
Hi, Wondering if there is a solution to this problem: When using the 'Sequenced Table Columns' Format Parameter on the Oracle Writers (allows you to specify an Attribute and Sequence to populate that Attribute with the next value from the sequence) but I couldn't use it with a Fan Out. If all Feature Types used the same Sequence that would be OK. But if one Sequence per Feature Type I couldn't get it to work. Any suggestions?
Hello, I have a bunch of mapinfo line.tab files that I want to merge together. Each .tab file is in a seperate sub directory e.g. /test/one/line.tab /test/two/line.tab /test/three/line.tab I want to add a 'dir' text column to each layer before merging that is populated with the files sub directory name e.g. line.tab layer in the one directory will have a new column added 'dir' and be populated with value 'one' line.tab layer in the two directory will have a new column added 'dir' and be populated with value 'two' ...etc I see that hte AttributeCreator transformer can populate data columns, however I'm unsure how to get the data in the format as stated above. thank you