• EN

Transformers

Using transformers to modify data.

  • 12,294 Posts
  • 49,348 Replies

12294 Posts

O
odeneho
asked in Transformers

Remove commas within quotes

Hi, I have a csv file which I would like to split by comma into separate columns with Attributesplitter. However, there are instances where there are commas within quotes which I don't want to split.    Is there any way I can split by comma whilst ignoring the ones within quotes or how can I remove commas within quotes? I have tried with regular expression but no success. An example data; "BASEMENT, GROUND","Y","W8 6AH","LONDON","",,,"" TO: "BASEMENT GROUND","Y","W8 6AH","LONDON","",,,""    "BASEMENT, GROUND, FIRST","Y","SW3 3AD" TO: "BASEMENT GROUND FIRST","Y","SW3 3AD" Thank you

9
R
11 years ago
B
bruce
asked in Transformers

HotPots/ Density anlaysis based on polygons

Sort of following on from my previous question about Overlapping Polygons ....  (AreonAreaOverlayer)  I'm going to be wanting to look at ways of analysing the data based on the accumulated attributes of these polygons.  Each Polygon has an assigned Intensity Value. Where these polygons overlap then there will be an accumulated Intensity Value.  I'm wanting to represent these Intensity Values in some meaningful way, and thought that a Hotspot/ Density analysis might be a good way to do so. That is, to create a cluster around areas of a similar intensity valueand have a gradient/ contour map showing these Intensities.  There seem to be some transformers which would work on point datasets, but can this be done on a polygonal dataset too ?. Would using a Convex/ Concave Hull around polygons of a similar Intensity Value be a valid way of achieving this ?  Thanks in advance,  Bruce

3
fmelizard
Contributor
11 years ago
B
brcalexm
asked in Transformers

MapInfo Seamless table

Hello All,  I have a large number of MapInfo TAB files that are currently used in MapInfo Workspaces to create a bunch of static maps. I would like to create an automated process to clean up some of this data and then combine the TAB files into a seamless table to replace each workspace. I could write a MapBasic program for this, but some of what I want to do to the TABs is probably easier within FME. Except I'm not sure if it is possible to create a seamless table within FME.  Has anyone attempted to create a MapInfo Seamless table (TAB file that references a number of other TAB files) within FME desktop? 

1
davideagle
Contributor
11 years ago
A
adam
asked in Transformers

Calibrate an LRS with FME

I would like to use FME to calibrate a regular street network for use as the basis of a linear referencing system.  Business rules are pretty simple: - routes should be built from constituent street segments without merging said segments - assume that valid routeID's already exist as an attribute in street segments - routes begin in cardinal south and end in cardinal north - routes begin in cardinal east and end in cardinal west - route measures are based on lengths of geometries composing the routes.   I recently created the results I want using Geomedia Pro with Geomedia Transportation Manager, but I would like to migrate to using FME so that the workflow is more easily reproducable.   Any resource that can help me get this done is appreciated.

1
sigtill
Contributor
11 years ago
jpvo
jpvo
asked in Transformers

Statistic calculator working with dates

Hi guys, I'm interested in having a statisatic calculator that would work with dates. I'd like to return the most recent date of an object set "group by" tile_ID. Is there a way I could do this without a python caller?  Cheers,  JP

4
jpvo
11 years ago
sigtill
Contributor
sigtillContributor
asked in Transformers

Warning about Dissolver (only version 10) FME2013

Just a warning to those of you using Dissolver (version 10), it is broken - so the dissolved output is "inversed" in overlapping areas. using the old Dissolver (version 8). is OK. Thats for any geometry (even simple bounding boxes).  As a side note a thing to consider at Safe might be adding an "auto-update" procedure in all versions (even BETAs). This way it would be possible for Safe to notify an individual installation at runtime and give a pop-up with for instance the following:  "There is a newer version of FME available. Critical fixes includes: - Error in Dissolver: fixed - Bufferer: fixed  For other improvements look at  http://downloads.safe.com/fme/whatsnew.txt  Do you want to update to this new version? "  Of course you would need to only update the required modules (not a complete install) - however it would be very easy for you to publish crucial updates.

0
sigtill
Contributor
11 years ago
J
jack_ryan
asked in Transformers

Cumulative totals

How do you take a specific attribute from a grouped/sorted set of features, and cumulate the sum feature by feature and store in separate field?

5
J
11 years ago
H
hektopascal
asked in Transformers

Combined loop + attribute assignment question

I have a large number of roads that I need to treat on a per community basis. My programming paradigm is heavily influenced by the tools I used before (a mix of matlab, python and perl), and so I'm pretty quick to see for-each-loops as the logical way to proceed.   The problem: I'm doing some simple geometric operations to extract some metadata about the roads of each community. Those operations include aggregating, finding a common midpoint and so on - basic stuff I've implemented and tested - but I've yet to find a dynamical way to add an attribute with the ID for that particular community.   For me, the next step is to iterate over each community, reading and treating data separately for each community polygon. I see I need to create custom transformers to do that. I'm happy with getting a little more hands-on with custom transformers - but I would appreciate a little guidelines on the way.   In my head the solution would look like this:   1) Read all polygons th

8
H
11 years ago
B
bruce
asked in Transformers

AreaOnAreaOverlayer

This transformer does everything I need it to - I have multiple overlapping polygons in a MapInfo Table, and I need to accumulate statistics on the overlapping areas, from each of the component polygons.  I can do this using the List Name option in the transformer and I get an expanded attribute list for the Writer showing all of the attribute data - I can see the results ok within an FME Visualiser - However when I try and output the data to MapInfo  none of the attribute data is populated.  Any ideas ?  Thanks,  Bruce

7
B
11 years ago
C
chrismugdan
asked in Transformers

Re-combining polygons as rings in a polygon

I have input polygons that consist of multiple disconnected rings (as islands) and I am generalising them and removing islands of less than a certain area. I am using Generalizer, DonutHoleExtractor, SpatialFilter and DonutBuilder to do this and it works well, but the resulting layers are now individual polygons. I want to combine the polygons as rings in single polygons based on a unique ID. Can someone recommend a method of doing this please?

2
fmelizard
Contributor
11 years ago
W
wasc0501
asked in Transformers

ESRI MDB to Smallworld GIS / Annotation

Hallo, I have to import an Esri Geodatabase to Smallwworld Gis 4.1.1. To import polylines and points are no problem. To import an annotation is probably, because the justification is alyways on the lower left side. How i can set the annotation to the middle center of the polyline. I use the labeller to set and import the labels from an annotation list. I read the the article from FMEpedia (Article Number: 000001996) but i don't understand this. How i have to use the attributes sworld_vert_just and sworld_horiz_just?  Thanks from Austria wasc

1
C
11 years ago
fmelizard
Contributor
fmelizardContributor
asked in Transformers

Using SchemaMapper to Map Data into an Existing Schema

Hi, I'm able to figure out how to map a single feature coming from one schema to an existing feature of another schema using the Schema Mapper tranformer.  The problem that I'm having is how to map the rest of the features using the same SchemaMapper transformer without having to create one for each feature that are within the two schemas. Here is schematic of what i'm trying to do.  Note that the Out feature already exist in the output schema.   RoadL  ------------------------>  |                                |-------------------------> RoadL_Out RiverL --------------------------> | SchemaMapper  |-------------------------> RiverL_Out SandA  ------------------------>  |                                |------------------------->  SandL_Out  What's happening for me is that the total number of features from the incoming schema are being inserted into each of the output features.  That is, if the total number of the road (200), river (700) and sand (100

6
fmelizard
Contributor
11 years ago
C
chrismugdan
asked in Transformers

Adding centroid fields

I want to compute a centroid for polygons then add the X and Y fields to my features.  I could not find any way of doing this in FME desktop as I have it. Can anyone suggest how I might do this please?

4
M
11 years ago
fmelizard
Contributor
fmelizardContributor
asked in Transformers

FME 2013 DWG additions

Hi,  I was going throught the whats great in FME 2013 and came across this: "Added new template files to (FME_HOME)\\autocad directory, both of which have AutoCAD standard line type definitions loaded in them (PR#36706)"  Does it means that FME 2013 will have the ability to create line types other that continous? as is the case with FME 2012.  Also will I be a able to set the dwg line type from input attributes stating the desired line type?  That would be great!  Cheers,  Itay

4
fmelizard
Contributor
11 years ago
R
romainjanil
asked in Transformers

coordinateConcatenator bug?

Hi, is there a bug in the ouput of the coordinateConcatenator ?: last 2 couple of coordinates are glued together in the output string attribute whatever the delimiter is. Other coordinates pair (or trio) are well delimited though. This is very annoying for further pyhton operation (seems awckward to put a test or an error checking for something that's aobviously a bug). On FME 2013 beta but also 2012. Did anybody else seen this ? Thanks

1
R
11 years ago
T
torbenhansen
asked in Transformers

Converting attributenames to lowercase

I need to batch-convert a lot of featureclasses from an Oracle Spatial database into SQL Server Spatial 2008. In it's own, that's not a problem to do, but I need to have all the attribute names and values in lowercase due to compatibility reasons, as all our data in SQL Server will be exported to our hosted WebGIS-server, which runs PostGIS. I can use the CaseChanger to make all attribute-values lowercase, but I cant seem to transform the attributenames themselves into lowercase. Only workaround I can see is using the AttributeRenamer or AttributeCopier and then renaming every single attributename by hand. I'm looking at converting well over 200 featureclasses, so doing it by hand is not an option. Anyone got an idea how to make all attributenames lowercase?

1
T
11 years ago
mark2atsafe
Safer
mark2atsafeSafer
asked in Transformers

What are you looking forward to in FME2013?

Take a look at the What's Great page for FME 2013.  I'll wait while you do that..........  Done? OK, which of the new functionality are you looking forward to the most?

18
flavio
11 years ago
G
graeme
asked in Transformers

Oracle/SDE sequence increment

I have an SDE environment with Oracle and am trying to append rows to an existing table.  The primary key is defined in the database by an auto-incrementing Oracle integer sequence.  Normally for a Postgresql or Oracle writer, setting the key to strings like 'DEFAULT' or 'MYSEQUENCE.NEXTVAL' act like they would in SQL.  However I have not been able to get the SDE workbench writer to operate in a similar manner.  When using a 'MYSEQUENCE.NEXTVAL', FME tries to be smart and do a schema check -- it won't allow writing a string to an integer field.  If I try not populating the attribute, FME complains that the NULL constraint on the PK would be violated.  I also was going to try a hack to read in the max key value with the intention of having an FME counter set each subsequent value.  However that won't work because the equivalent of a mapping file @SDEsql call doesn't exist in workbench.  Suggestions on how to do this or other approaches to try out woul

5
G
11 years ago
gisbradokla
Contributor
gisbradoklaContributor
asked in Transformers

repair geometry function

I have a workspace I recently completed that creates a buffer of a line featureclass.  I dissolve it into single polygons and run a chopper to limit the polygons to 8000 vertices.  I have now discovered that the resulting shape file has self intersecting polygons.  I ran the repair geometry in ARCMAP and validate this fact.  Looking at the transformers there is a selfIntersector which I added to my workflow but I still get self intersetcions after running. I don't see any options on the selfintersector.  Am I  missing something? Can someone help? 

2
gisbradokla
Contributor
11 years ago
S
sweetpea73
asked in Transformers

Merging Polygon Data

What transformer(s) do I need to merge two polygon layers together where the coincident polygons would have both their original attributes and the attributes of the other polygon?  Thanks!

3
davideagle
Contributor
11 years ago
S
stian
asked in Transformers

SQL Executor

Hi!  I'm having a hard time getting SQLExecutor to interpret a SQL string from published parameters. However if I paste the exact same string directly into the transformer it executes without problem. Any ideas why???  The WHERE clause looks like this when i execute the workflow  WHERE ST_Contains(ST_GeomFromEWKT('SRID=32633;POLYGON ((183044.6766 6488587.2041,172720.1045 6526144.3677,205500.5582 6546330.9112,215416.0671 6503714.6016,183044.6766 6488587.2041))'),the_geom32633) and date >= driftsutslipp.date_to_int(date '$(date_from)') and date <= driftsutslipp.date_to_int(date '$(date_to)  And the Error is:  Error executing SQL query: ............................[edited ] WHERE ST_Contains(ST_GeomFromEWKT('SRID=32633;POLYGON ((183044.6766 6488587.2041,172720.1045 6526144.3677,205500.5582 6546330.9112,215416.0671 6503714.6016,183044.6766 6488587.2041))'),the_geom32633) and date >= driftsutslipp.date_to_int(date '$(date_from)') and date &lt

2
S
11 years ago
B
borone
asked in Transformers

intersept polylines with given points

Hi, I have a point dataset with an unique attribute and a polyline dataset. The points are a subset of the vetrices of the polylines. I'd like to know, how can I intersept the polylines with the points and add an attribute to the lines out of the unique point attribute at the start and the end of the cutted polylines. The image below shows what I mean.     Thanks for your ideas!

5
B
11 years ago
T
talbert
asked in Transformers

Sketchup Layers

I am using FME to write a Sketchup files with a combination of different elements.  Is there a way to define layers with FME in a sketchup file?  I examined a sketchup file with layers using the logger in FME and it looks like the GeometryTrait "sketchup_layer_name" is used define the layer of the object.  But when I add this attribute to my translation the objects are not placed on different layers.  They all still end up on Layer 0.

1
C
11 years ago
C
casey
asked in Transformers

RegEx for null or empty attributes

What RegEx can I use to define null or empty attributes in StringReplacer? Or do I even need to use RegEx? I'm trying to replace null/empty attributes with UNKNOWN. Seems simple enought but it's giving me fits.

4
fmelizard
Contributor
11 years ago
C
crosadio
asked in Transformers

Annotation DGN->ESRI annotation

Hi  i am new to FME and  i could not find a way to import dgn annotation into ESRI Annotation FeatureClass.  Is this possible in FME ?  Tks for your help

1
R
11 years ago

Badge winners

Show all badges
28,803
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.