Creating and organizing workspaces. How to use Workbench.
Recently active
Hi If anyone has a few steps I can follow that would be great! :)
At the moment I am trying to use SherbendGeneralizer to generalize our data set in UK and I have some big performance issues. So I need an expert advice. Here is my workflow. Intersect Line(rivers, approx. 2MB shape file ) and Polygon (Postal code plus Administrative boundaries approx. 55 MB shape file) Perform the SherbendGeneralizer Export generalized layers When I chose a small area then it works fine but when I chose complete country it runs and runs without any output. Even after three days there is not output. I am using FME (Professional Edition) 2013 (Build 13264, WIN32) and FME (Professional Edition) 2013 (Build 13264, WIN64) on Windows 7.
Hallo all, I need to make sure that my procedures (enabling triggers and constrints) are run at the end of my translation. Since I have no idea if any of my writers will be triggerd I cannot use the end sql. After googling I came across the following module (cx_Oracle), but I dont know how to use it with procedures, or if it is at all possible. Any assistance would be helpful. Itay
Hello, I am in doubt whether the custom transformer I created processes just one feature at a time. It does not have any "group-by" clause active, but still seems to accumulate all the features first and then process them, instead of processing one by one. Is there a way how to check this behavior? Or better, is there a way how to forcingly make it feature-based instead of group-based? Thank you in anticipation, Jaroslav
A workspace which reads data from or writes data to a mapped network drive does not run on FME Server. The service works just fine in FME Workbench, but fails on FME Server. Have already tried: - HTML encoding the path - Python escaping the space (replacing each space with "\\t") Cannot rename the directory due to several other software programs referencing the same path; nor can I copy the files elsewhere, we are talking several gigabytes of data that changes all the time. Any tips are appreciated!
Hi, I have just started using FME 2012 (previously used FME 2009 on a pretty basic level) and noticed the new Dynamic Schema option. I have tried it, but can't find where my output file is going? I have set the output directory but it is not writing to there... Thanks,
Hello, I have been following this guide to chain FME Workbenches in FME Server: http://fmepedia.safe.com/articles/How_To/Chain-Jobs-in-FME-Server but I want to be able to download the resultant files at the end and can't figure out how best to do this. I can register the Controller workbench in the Job Submitter repository and it works fine but putting it in the data download repository has no effect because there is no files to write to at the end as they are in the second chained workbench I use. Thanks, Peter.
Datetime again! This time I am having trouble keeping the time in a datetime format in a custom reader with an earthquake feed. (Very topical in NZ today!) I can parse the date easily and export the field as datetime, but when I try to use it in ArcMap only the date part is kept. Debugging so far: I kep the date as a string, saved the feed to a file geodatabase. Converts as expected, then an animated time enabled map works by the hour instead of by the day. Inspected the feed by opeining a custom reader in another workspace. The field in recognised as a datetime type, and the contents is a standard FME date yyyymmddhhmmss. Seems OK. Export to a file geodatabase but have to call it a "date", however this is supposed to mean datetime for anything other than dBase stuff like sh**e files. Yep ,works ok. But the whole point is to be dynamic and use the feed to draw the 'quakes without the static copy. Where is the setting I have got wrong, or maybe a bug? I would put up
I created a workbench previously that read in Garmin waypoint information stored in an AutoCAD DXF file and converted into my GIS with a SQL Server DB. This was before FME had a reader for the Garmin GDB file format. I made a copy of that workbench and modified it to read the GDB file instead of the AutoCAD DXF. Toward the end of the translation sequence I have an AttributeRemover to remove unused attributes, but I noticed that somehow the workbench still has some default AutoCAD attributes floating in there. When I see the list of attributes I can remove, I see about 20 or so AutoCAD related attributes. My question is this: Is there a way to flush or reset the workbench so that it only contains attributes related to the current readers, writers, creaters, etc. or do I need to create the work bench from scratch in order to eliminate all these AutoCAD attributes?
I'm processing county-wide imagery and for large counties it takes up to 16 hours to produce output. My workflow is as follows: Input(MrSid) - Reproject - Clip to area of interest(up to 80% of county) - Tile (2 by 2) - Output (JP2). Reprojecting, clipping and tiling seems to go fast. If writing to JP2 is the problem then I'm out of luck because that's the format we need. Any tips are greatly appreciated. Thanks.
Hi Folks, With FME 2012, Safe threw in more restrictive licensing for node-locked (fixed) licenses. No matter how many cores a computer has, the number of instances of FME running is limited by the type of license. My question is twofold: a) Are the limits different between "group by" parallel processing and workbenchRunner parallel processing. b) What are the limits for each of these? They don't seem to be documented anywhere. The most I can find is group-by limits http://evangelism.safe.com/fmeevangelist94/ - and it says they're provisional at that time. Our Oracle Edition seems to be limited to 8 FME workbenchRunners, which is a shame because we have 16 cores purchased explicitly for FME. Thanks. Jonathan
Hello, I'm an FME newbie. I have a set of polygons which represent parks. As overlays I have layers of elements that exist within these parks, such as parking lots, ovals, playgrounds. The goal is to produce a new layer that covers that area covered by the parks, but that has many more polygons representing what's in the overlays. I'm pretty sure AreaOnAreaOverlayer is the transformer for the job. But when I select the static schema option, the attributes aren’t being written to the new layer. Not even the _overlaps attribute is being written. And when I ask it to make a List by entering a string in the List Name field, I don't know where this list of attributes is going. Where am I supposed to find this list?! TIA, MvW
Hello I created a workflow that transforms some data. As I have to do the same transformation for various oracle-users, I'm using the workflow-runner in a second workbench. But it's not only the name of the user, that I need to pass to the transformation-workflow, but also a second parameter (an attribute in a table). I read in a post, that I have to concatenate the two values an pass them as one parameter to the other workflow. But how can I integrate that parameter in my workflow? There is a transformer "parameter-fetcher", but it needs input from a reader. I also have to split the parameter again (Attribute-splitter) and use one of the two parameters for my reader (oracle-user) and the other in my writer (attribute). Thanks in advance Vera
I want to set feature colours at random according to an attribute value (similar to a thematic map). At the moment I'm achieving this by taking the data, using a duplicateremover so there is one instance of each group, a featurecoloursetter with the color scheme set to random, an attributekeeper to keep only the group attribute and the colour and then a featuremerger to merge the data back with the original data so that all features that share a certain attribute value have the same colour. It seems a bit long winded and I'm wondering if I've missed a better way to acheive this.
Hi all, Kindly asking for suggestion if anyone had found a solution for such an issue: in theory, getting job_id during python shutdown script execution should be piece of cake, with accessing to FME_MacroValues['FME_JOB_ID'], but actually there is no such key in FME_MacroValues. I've explored all FME_MacroValues dictionary, nothing similar is there. Also, there is nothing that could help in globals() as well. Is actually FME server still providing job_id for python hooks executed on start/end of translation?
I have a workspace with three FeatureReaders (two reading multiple datasets from two different SDE databases) and one reading a single zipped shapefile from a URL. They are all written to a Generic writer with the dynamic schema setting that is getting the schemas from Workspace Resources (Reader as Resource), one for each datasource (FeatureReader). I also have published and private parameters set to allow the user to pick one or more datasets from one or more FeatureReaders to run through the workspace. This works fine for the SDE datasets, but when the zipped shapefile is selected, the translation fails with the following error: UniversalReader -- readSchema resulted in 0 schema features being returned Shape Reader: No Shape files found in specified directory 'C:/Users/cw0157/AppData/Local/Temp/2/HAZ_HW_SITES.zip_1372349846576_4848'. Check if directory specified is valid Error fetching dynamic schema definitions from reader `SHAPE_1'. Error reading from `C:/Users/
Hi there, I have one workspace that reads from a Oracle table containing names of source feature types (to read) and target feature types (to write), along with a few other parameters. This workspace passes the name pair to WorkspaceRunner, evoking another workspace that reads the source feature type and wirtes to the target feature type in Oracle. I was able to pass target feature type name as parameter to non-database Writers such as GML Writer, but in the case of Oracle Writer, I could not figure out how this could be accomplished. I think I have done pretty thorough search on various sources including this link http://evangelism.safe.com/fmeevangelist31/ with no avail. But it is possible I may have missed some thing obvious. I appreciate very much any help from the FME community, as always. Bo
Hi, I have two workbenches. First one's publish parameter has all feature list, which i need to pass to 2nd workbench's reader. Unfortunately, i cant use workspace runner as i need to call after writers write into database. I can pass hard coded values but how should i pass parameters? Thanks, Subrat
Hello, I just sucessfully updated to FME 2013 SP2. The "What's new in FME 2013 SP2?" document states: "Coordinate Systems: Added Canadian geoids/vertical datums, including CGVD2000/05/10 and CGVD28 (PR#44361)" However, looking under any "Coordinate Systems" transformers such as Repojector or CoordinateSystemSetter, I don't see any support for these datums. Do I need to do extra steps before I can use these datumes? I suspect I may need to download a grid shift file?
Hi, My input spatial table contains 4000 records. I am doing some manipulation in workbench. But it takes very large amount of time to process. Is it possible to parellelly process each feature type? Thanks, Subrat
Hi there, I’d like to know if there is a method to match attributes with similar names. To explain, here’s what the data will look like. I have a Dynamic workspace that checks all files within two separate folder. So, the intent is to run this workspace on any features contained within, and the names of the shape files contained in those folders can be literally anything. Let’s say Folder A contains the following files: 10001_AFR_ROADS_V1 10001_AFR_WATER_V1 10001_AFR_RAILWAYS_V1 And Folder B contains: 10XYZ_afr_Roads_v1 10X01_Afr_Water_v1 10001_AFR_Railways_v1_0 As you can see, there are similarities, but they are not identical. I want to know if there’s a way to compare the two sources and match any of those files that are “somewhat” similar. Ideally, a percentage. So for example, of it compare two of those files, and it detected that there was an 80% or higher similarity. I don’t need to see the percentage, I just need some leniency on matching the two sources up. The
Hi, I have two workbenches out of which first one will generate a list of spatial tables,as per which second workbench will read from those Oracle spatial tables. Any idea how to implement this approach? Thanks, Subrat
Hi dears. We have a technical question regarding the connection FME using the reader ESRI Geodatabase through the direct connection option. We are getting the following error message below when trying to connect to the database GIS / Esri. Opening the Geodatabase reader FME has checked out an Esri license. The product checked out is 'ArcInfo' Installed ArcGIS version is '9.2' Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147216072'. The error message from ArcObjects is: {Underlying DBMS error[ORA-12545: A conexão falhou porque o objeto ou host de destino não existe No extended error.]} Please ensure the connection parameters are correct (server=`dummy', instance=`sde:oracle10g:\\;LOCAL=PJTP', user=`UOMSUSER', password=`***', database=`PJTP', version=`UOMSMGR.OMS_DMS_SINC') A fatal error has occurred. Check the logfile above for details FME Session Duration: 13.
hello? There are some groups in my AutoCAD DWG data. Groups in Autocad means a whole that when you select a group in AutoCAD ,you'll select all element in it. But when I read these groups data in FME, they'll be auto exploded even I set the 'read group' parameter to 'yes' in Reader. And I could not find some relationship between those features which are one group. How can I resolve this problem in FME.
I recall that in previous versions of FME you could occasionally get forced to version 9 of MapInfo by including a column type (date) or coordinate system that wasn't supported in earlier versions, but it appears that with 2013 SP2 now all of my MapInfo output has been forced to version 9 with no changes in the workspaces. Has anyone else seen this? This is pretty critical for me as most of my MapInfo users are still on 8.5. I'm putting in a support request for this too, but wanted to ping here as well.