Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,681 Posts
50,732 Replies

When you subscribe we will email you when there is a new topic in this category

12681 Posts

Recently active

Most replies Most views Newest first

asked in Transformers

Why does regular expression not work in BulkAttributeRemover?

The regular expression input for bulkremover works if I type in: fme_.* But if I try to add another expression using the regex or it fails to recognize the regex statement fme__.*|igds_.* I tested this statement using the ruby testing aplication recommended in the help section, and it was able to recognize the statement

asked in Transformers

Speed issue with FeatureMerger in FME 2014

Hi, We recently have installed FME 2014 32bit on Windows7 64bit with 8gb RAM. We re-created a workbench to try the new FeatureMerger transformer. The translation took a lot longer (9h vs 2.5h). The workbench is very simple, and consists of few FeatureMerger. However, the dataset is very large (around 10 millions features points). Our first test was to try the FeatureMerger without the Supplier First option just to compare results with the same settings of the FeatureMerger in FME 2013. Then we tested with the Supplier First correctly setted, but the translation took 9h also. Does anybody has encountered a speed issue with the new FeatureMerger transformer in FME 2014 32bit? Thank you for your feedback.

asked in Transformers

FME shows autocad line as duplicate when only one?

In autocad i only have one line but when i convert to a GDB the duplicate transformer removes it as it is a duplicate? It does this on about 20% of the lines in my Autocad file? I have tried to redraw,Flatten, Convert to Polyline, Copy and Paste to new DWg?

asked in Transformers

post a question

Hi guys! I have 40000 records in a table that looks like this one: I need to pull this data into an Excel spredsheet that must have the following structure: I believe it's a matter of working with lists in FME, but I can't get my head around. Do you have any suggestions? Cheers, Darius

asked in Transformers

Crosstab in FME

Hi all, I need to perform a crosstabulation in FME. I have a huge table with duplicate values because one of the columns can contain not unique values. I would like to turn this into a crosstab matrix where the values of this column with not unique values turn into different column headings. For more information, please click on this other post (http://fmepedia.safe.com/CommunityAnswers#!/feedtype=SINGLE_QUESTION_DETAIL&dc=All&criteria=ALLQUESTIONS&id=906a0000000cz1IAAQ). Thanks, Darius

fmelizardContributor

asked in Transformers

Create a Line from Points

Hi, Silly question, how do I create lines from points? Using 2014 SP1 there's the new VertexCreator, but when I send it a series of features (using "add Point") it turns them from "Null" into "point". Which is fine. Except I want to join some of those points together into Lines - they'll need to be grouped by a shared attribute. I'm sure I'm missing something, this strikes me that it should be very simple. Last year I created a transformer (looping required) that builds a line from a list of vertices - isn't there a better way? Cheers, Jonathan

jelleContributor

asked in Transformers

multiple pyramids in TIFF Container

Hi All, I've only started using the raster functions in FME yesterday. Tiling and pyramids process really fast. However, I would like to send the pyramids of one tile to one single TIFF container. Is that possible in FME? I can't find the way to do so. best regards, Jelle

asked in Transformers

Extract Overlapped Polygons

Hi, I've got a set of overlapping polygons(representing strata at different levels), and then another set of polygons on top of that(representing bore holes). For each bore hole I'd like to extract the polygons beneath in their entirety into a seperate shapefile. It is often the case that multiple bore holes will intersect the same strata, in this case I'd like the shapefiles of both bore holes to contain complete copies of the strata. Does anyone know how to do this? I've been messing around with the spatial relator, but I'm not sure if I'm using it correctly or what to do with it's list outputs.

asked in Transformers

The equivalent tool to “intersect” of ArcGIS in FME,

The equivalent tool to “intersect” of ArcGIS in FME, I couldn’t figure out which tool is equivekent to “intersect” of ArcGIS in FME. I have tool layers, and I want to extract the common areas between them. Boundary Landuse Intersect In this case, the “Erase” tool is applied with no problem to extract the Roads Roads = Boundary – Landuse The model is: Thank you Best Jamal

asked in Transformers

tester loop through values

I have a script that currently uses a user supplied ID value to search through four different geodatabases for features with the requested ID and updates data in an Excel file with the found features. It's quite simple: each geodatabase with its own Tester, the Right Value set to the appropriate parameter, all writing to a separate tab in an Excel writer which uses a template file. What I'd like to do is modify so instead of the user entering a single ID to search for, it can loop through multiple IDs in a table to look for and create an excel file for each ID. How I imagine it would work is to pass the values from a table one at a time to the Tester transformers. However, I'm still quite new to FME and I have no idea if this is possible. Does anyone have any thoughts on how this might be accomplished?

aguanContributor

asked in Transformers

How to reserve versioned annotation edits in updating feature-linked annotation class (ArcSDE)

I have a simple arcpy python script that truncates an ArcSDE feature class along with its feature-linked annotation class and appends it with another feature class in staging database. The append process also builds the linked annotation class (code shown below). Now an user needs to make minor edits on the annotation class (versioned), my question is how can I replace this python script with a FME workbench with the ability to reserve the edits from future updates of the feature class from the staging one? I am at ArcGIS 10.0 SP3, Oracle/ArcSDE 10.0. import arcpy SDE_GOM_LEASE_LEXCOAnno_P = "Database Connections\\\\sde_gom@usprd06.sde\\\\SDE_GOM.LEASE_LEXCOAnno_TJ" SDE_GOM_LEASE_LEXCO_P = "Database Connections\\\\sde_gom@usprd06.sde\\\\SDE_GOM.LEASE_LEXCO_TJ" SDE_GOM_LEASE_LEXCO_T = "Database Connections\\\\sde_gom@usqa06.sde\\\\SDE_GOM.LEASE_LEXCO" arcpy.DeleteFeatures_management(SDE_GOM_LEASE_LEXCOAnno_P) arcpy.DeleteFeatures_management(SDE_GOM_LEAS

asked in Transformers

daylight savings

The DateFormatter is causing me some problems. I have data in GMT(UTC) and need to pass it through the dateFormatter. The date is being formatted as expected except that it's automatically correcting for daylight savings time - I don't want it to! Does anyone know how to prevent the dateFormatter doing this? Here are the transformer's parameters: Date Attributes: DATETIME Source date Format: %Y%-m%-d %H:%M:%S Destination Date Format: %Y%m%d%H%M%S example input: 2014-03-29 01:15:00 example output: 20140329011500 (this is correct) example input: 2014-03-30 01:15:00 example output: 20140330021500 (this is incorrect - advanced by an hour because) (FME Desktop 2014)

asked in Transformers

How to manage input order ?

I've got a workbench which look like this: Reader --> T1 ---------->Aggregator -> Writer | | -> CT1 -| -> CT2 -| Every feature has an "id" and the aggregator groupd them with the "id" T1 is a simple transformer (like AttributeCreator). CT1 and CT2 are custom transformer very complicated with many steps (~20 each without the same length). Because i've got ~1million element in the Reader, in the Aggregator I which I could select the "Input is ordered by group" for "performance" issues. But it does not work; I've got only the T1 output. So, How may I do this ? For feeding the pipe I though of "no-op" block like in electronic ... but it's does not exist and it's a pain to do.. and not very reliable. Is there something else I could do / use ?

asked in Transformers

Intersecting 3D Faces

The simple question I have is, can you intersect two or more TIN models using FME? I have 3D linework (happens to be in AutoCAD) that I am using in FME to create simple 3D faces using the TIN Generator. Some of the faces intersect in 3D space. I would like to break up the faces where they intersect in 3D space, or at least generate the 3D line that shows where they intersect. The 3D faces are not co-planer so the SurfaceOnSurfaceOverlayer does not produce the desired results. In ESRI 3D Anlyst I can use the "Surface Difference" tool to calculate the intersection and then use the Surface Draper functions of FME to get what I need. But I would like to use FME to create a much more elegant (automated) solution. Any suggestions would be greatly appreciated.

dos_gisContributor

asked in Transformers

DWGStyler Adding Block Objects

I'm converting GIS to CAD using: GeometryFilter (Area) -> GeometryCoercer (fme_polygon) -> DWGStyler (Areas - polygon) I'm also using LabelPointReplacer. The resulting CAD file shows ploygons but it's also converting some of the areas to filled blocks? How do I ensure that all areas become polygons?

asked in Transformers

How to convert Cad points to geodb_polylines?

I have a series of dynamic blocks that can stretch in AutoCAD that I would like to convert and store in a geodb_polyline feature set., is this possible? I tried Point connector with no luck?

gioContributor

asked in Transformers

To keep or not to keep..titq!

Hi ppl, Is this normal behaviour? (and is it still in 2014?) I mean, what is the use of the option "Keep Input Attributes" ? Now i have to add a keepr in the stream...messing with workbench aesthetics..:( BB Gio

asked in Transformers

“AreaOnAreaOverlayer” fails: “The spatial comparator received a feature with invalid geometry”,

“AreaOnAreaOverlayer” fails: “The spatial comparator received a feature with invalid geometry”, I wanted to apply the “AreaOnAreaOverlayer” on the CAD file below but I got the error below: “The spatial comparator received a feature with invalid geometry” CAD file: http://www.mediafire.com/download/lf3y6k096nj1724/Rojib_Nablus_UrbanMasterPlan_06_X.dwg What might be the issue here? Thank you Best Jamal

asked in Transformers

post a question

I have a large spreadsheet that looks like something like that: Species Attribute_1 … Attribute-n Status_1 Status_2 Acarospora fuscata aa … qe VU NS Micarea misella xt … qq CR NR Porpidia striata dd … rt CR NR Verrucaria viridula po … da EN NS … … … … … … Is there a way in FME to obtain the following? The date above has to go to a another database that only accepts the next structure: Species Attribute_1 … Attribute-n Statuses Acarospora fuscata aa … qe VU Acarospora fuscata aa … qe NS Micarea misella

asked in Transformers

Error in clipper: “Invalid Clippee detected, using first coordinate of Clippee.”,

Error in clipper: “Invalid Clippee detected, using first coordinate of Clippee.”, I wanted to apply the clipper between two hatches (areas) layer but I got the error below “Invalid Clippee detected, using first coordinate of Clippee” The first layer is: Boundary_UrbanMasterPlan_HatchType_Design_Compulsory The second layer is: Landuse_UrbanMasterPlan_HatchType_Design_Compulsory Mathematically, Roads = Boundary - Landuse What might be the issue here? Downloads: CAD file: http://www.mediafire.com/download/lf3y6k096nj1724/Rojib_Nablus_UrbanMasterPlan_06_X.dwg Workbench file: http://www.mediafire.com/view/ubkuygxusxpkuk8/Clipper.fmw Thank you Best Jamal

asked in Transformers

How to make readers without input not throw an error ?

Hi, I'm attempting to run a workspace that calls other workspaces (on an FME Server), collecting and passing a list of path names as input to the detail workspaces' readers. When no path names are available for a specific reader (they're read from a db table), a blank string is passed. This however yields an error (when the reader apparently tries to open a file with a blank name), crashing the whole workspace. Is there any way of disabling one or more readers based on a blank input ? If not, Safe, this is an enhancement suggestion !!! Cheers Lars I Nielsen

asked in Transformers

ExpressionEvaluator and @function()s no longer work in FME 2013

I have an expression for calculating a line segment angle like this: atan2(@Coordinate(y,0)-@Coordinate(y1),@Coordinate(x,0)-@Coordinate(y,1)) It used to work in FME 2012. I published the workspace from FME 2013, and suddenly it says invalid character "@": 2014-03-18 20:58:38| 53.9| 0.0|WARN |LineTerminator_GetRadianRotationAtP1: Failed to evaluate TCL expression: @Coordinate(y 2014-03-18 20:58:38| 53.9| 0.0|WARN |LineTerminator_GetRadianRotationAtP1: TCL Error Message: invalid character "@" in expression "@Coordinate(y" 1. Does FME 2013+ prohibit @functions from being used in ExpressionEvaluator transformers? 2. Is there new syntax to get it to work? 3. What is the best way to get the angles of the first and last segments of a line geometry? Thanks, Brad

asked in Transformers

Changing an attribute name based on Source name, dynamically

Hello, i've been struggling with an issue that probably has an answer in Schema Mapper; I have around 30 shapefiles, 1 million (ish) features in each, that have a CATEGORY attribute and a CODE attribute, amongst many other things. The thing that makes them unique is that their file name is the year of generation (1994, 2006 etc) and there is also an attribute called year with the corresponding year in it for every feature, for clarity. I simply want to rename CATEGORY to CATEGORYXX, where XX represents the last two digits of the year being processed - e.g. CATEGORY94 or CATEGORY06, and do the same for CODE - eg CODE94 etc. That is simple and fine with AttributeRenamer or Creator or SubstringExtractor but i cannot go through all 30 files changing the attribute on the writer to be CODE91 then CODE 92 etc etc, especially when they may need processing more than once in the future. So I set up a dynamic workbench but obviously if you predefine an attribute on the writer, it will n

asked in Transformers

Improper result from the “clipper”,

Improper result from the “clipper”, Two layers on the CAD files are involved in the clipper. They are Boundary_UrbanMasterPlan_HatchType_Design_Compulsory Landuse_UrbanMasterPlan_HatchType_Design_Compulsory The workbench is as follows CAD file: http://www.mediafire.com/download/ys218hze0zjow6f/Iskaka_Salfeet_MasterPlan_02.dwg Workbench: http://www.mediafire.com/view/ubkuygxusxpkuk8/Clipper.fmw The result is What might be the issue here? Thank you Best Jamal

asked in Transformers

Removing the “overlap” (duplicates) with the option (create new feature),

Removing the “overlap” (duplicates) with the option (create new feature), I have two hatches that are overlapped. I wanted to convert them to areas and then to eleminte the overlap by adding new feature for the overlapped area (as we do in the topology of the ArcGIS). How this might be accomplished in the FME? CAD File: http://www.mediafire.com/download/rt7sfabb9whzzi4/Overlay.dwg Thank you Best Jamal

1
...
466
467
468
469
470
471
472
...
508

Page 469 / 508

Badge winners

mcseamushas earned the badge Conversationalist
mcseamushas earned the badge Teacher (Grey)
tiztrainhas earned the badge Expert (Grey)
arunkumarkchas earned the badge Integrate Spatial Data
nick_ahas earned the badge Integrate Spatial Data

Show all badges

30,160: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.