Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,714 Replies
10000 Posts
P
pbiffar
asked in Transformers
lat lon to geometry

lat lon to geometry

170
danilo_fme
Evangelist
jspratt
Participant
jsprattParticipant
asked in Transformers
How to create key:value pair in JSON from fme_attrib_info{}.field_name and fme_attrib_info{}.field_value?

I have attempted a few different techniques to get my desired output.1.) Reader->AttributeExposer->JSONTemplater2.) Reader->AttributeExposer->ListConcatenator->JSONTemplater3.) Reader->AttributeExposer->JSON Writer4.) Reader->AttributeExposer->ListKeyValuePairExtractor->5.) Reader->AttributeExposer->ListExploder->JSONTemplater6.) OthersI am working with values such as:objid | fme_attrib_info{}.field_name | fme_attrib_info{}.field_value |-------+--------------------------------------+--------------------------------------|1       | SERIAL_NUM                       |          12345                          |2       | TYPE                                     |          SOME_TYPE              |  My desired output would be as follows:{    "SERIAL_NUM": "123456",    "TYPE": "SOMETYPE}I've used the tutorial on site here for extracting attributes from CAD blocks. Now, I would like to take these attributes and make a json payload per unique block to be wri

741
takashi
Celebrity
arnovananrooij
Contributor
arnovananrooijContributor
asked in Transformers
Bulk attribute rename and sum values of duplicate attribute names

Hi community,I have a very complex challenge. I have a csv with an unknown set of (dynamic) attributes. I was asked to rename the attributes so everything from the dot is removed. That is very easy I would say with the BulkAttributeRenamer (BAR), but then I found out I get duplicate attribute names and this is not allowed in the BAR. I asked what to do with these duplicates and they said I have to sum the attributevalues if there are duplicates. So for instance I have and attribute xxx17.1 and xxx17.2 the result must have an attribute xxx17 and the values have to be summed. This is no problem with a fixed schema, but I have a dynamic one and I have no idea how to do this. I have attached an example csv. All ideas are welcome.Thank you.  

330
ebygomm
Influencer
B
bino
asked in Transformers
How to Trim the overlap lines based on priority

Requires functionality in a CAD environment that allows anyone in the * .dwg or *.shp file layers to prioritize what can be common "Trim" the lines (TRIM function) according to the given priorities.

80
koenterralytics
Contributor
michaelpascoe
michaelpascoe
asked in Transformers
Is it possible to add functions to be available in the Arithmetic/Text editor

Hello all, Is it possible to add your own python functions to be callable from the Arithmetic/Text editors? I find I keep having to write multiple entries in an AttributeCreator to do things like find the smallest difference between two angles. ie. Situations where you need some state so you cant just use an expression. It would be nice if I could add a python function to a workspace that is then callable like the Math functions that are available in the Arithmetic editor.Let me know if this is not currently possible and I will add it to the ideas section.ThanksMichael Pascoecc: @deanhowell​, @luke.giles​ 

50
virtualcitymatt
Celebrity
L
ltsanthony
asked in Transformers
Hello, I am new to FME and could use some help with the FME FeatureMerger Transformer. I have two excel files that contains a matching key field, however I am unable to pull in the 'other' column of data associated to the key fields.

I know it's probably something simple, but I'm not seeing it. I thought perhaps inlineQuerier would help, but I am not versed with SQL. Essentially I want to do a "vlookup" from one file into the other based off the key field. thanks in advance!

110
Y
G
gellerroma
asked in Transformers
How write measure to postgis?

Hello.I have calibrated route in file geodatabase (ArcGIS). I have line coordinate (kilometre) in the start and the end point. I try export this route with M-value to PostGIS in FME. But in result I have line without M-value. Do you know how it works?If i created MULTILINESTRING M in postgis directly sql it work. So metadata field geom support M-value PS GeometryExtractor have field with M-value

350
G
richardt
Contributor
richardtContributor
asked in Transformers
How to remove repetitions from output of PointOnPointOverlayer?

I am looking to merge into a list selected attributes from nearby points and output a single feature for each group of nearby points. PointOnPointOverlayer perfectly finds the nearby points and generates the list I want, but outputs all the input features with a list of all the other features. Thus for say 4 nearby features it will output 4 features each with a list which identifies the other 3 features in the group, but without anything like a group ID with which you could select just the first in each group with a DuplicateFilter.This is almost exactly the example given in the PointOnPointOverlayer manual page which creates lists of crimes at common locations... but doesn't explain how to not have multiple copies of the same list at the same location. Am I missing something obvious? It seems that PointOnPointOverlayer has done all the hard work!The closest I could get to generating a group ID is to give all my input points a unique ID field, then set "Merge attributes"

236
richardt
Contributor
E
edhere
asked in Transformers
Help needed on spatial transformation (overlapping coordinates)

Hello all, I need some help performing a spatial operation. What I haveA set of coordinates (sample enclosed) What I wantRemove / dissolve coordinate pairs if the are within 2 km radius of each other so that only coordinate pairs remain that have no overlap. What I've triedA Bufferer transformer with a radius of 2km connected to a PointOnAreaOverlayer.The result is a bunch of overlaps but I don't know how to further process these.  Cheers,Eduard

110
E
j_geo
Contributor
j_geoContributor
asked in Transformers
LAS tansformation and local coordinate system

Hello,I am a researcher from Slovenia. I'm having huge trouble working with Slovenian datasets, as they are in EPSG:3912 or EPSG:3794. These two systems are not supported by FME. I solved this for shapefiles by using ESRIReprojector. But it does not seem to work with las datasets. I am trying to extrude footprints using LIDAR data and convert that to KML, which needs WGS84 data.Is there a sollution? I am quite surprised that FME does not support all EPSG projections.I even tried to add custom coordinate system and was not successful.Regards!Jernej

630
daveatsafe
Safer
W
whatahitson
asked in Transformers
How to count the number of features with the same value for an attribute

Hello,  I'm passing a load of lines through an FME workbench and eachline has a project name as an an attribute. I want to add an attribute that counts how many lines are in the project (share the project name). Does anyone know how to do this?  I've tried playing around with the counter but have had no luck. what I need is it to separate out into all the different projects, use the counter, then chuck everything back together. I would use a filter but there are hundreds of projects.  Any ideas?  Thanks

27050
jan
Contributor
joe.fme
Contributor
joe.fmeContributor
asked in Transformers
Hi, I'm a pretty experienced FME user but this has got me stumped. I'm trying to parse a date field, but it's not parsing the Nulls/Empty/Missing entries despite being selected to

I have fed it into a NullAttributeMapper to make sure all Nulls, Missing and Empty fields are uniform. That's fine, and so is the Date transformation when inspected. However it still rejects any of the Null fields, and when it outputs to the AttributeManager, all of the fields are then Null. Even the ones with a date value. I've checked the "Passthrough Nulls, Empty and Missing" values to "Yes", but still no luck. It seems to apply the null to everything in the DateTimeConverter.I've tried with a new Transformer/rebuilding that section, and have also restarted the workspace, as well as clearing any temp files. Any help? Thanks

30813
joe.fme
Contributor
jan
Contributor
janContributor
asked in Transformers
A problem with Statistics Calculator

The statistics Calculator gives this error when trying to count the sum of an attribute: 2020-08-11 12:49:59|2233.8| 2.3|ERROR |Python Exception <MemoryError>: 2020-08-11 12:49:59|2233.8| 0.0|FATAL |@Python failed to execute function `StatisticsCalculator.recordFeature'2020-08-11 12:49:59|2233.8| 0.0|ERROR |StatisticsCalculator_2_InputProcessor (TeeFactory): StatisticsCalculator_2_InputProcessor: @Python execution failed2020-08-11 12:49:59|2233.9| 0.1|ERROR |StatisticsCalculator_2_InputProcessor: @Python execution failed There was approx 2.5M features passing through each one having a value of 1. So the sum operation should not be exhaustive. What could cause this? A bug?

1040
jan
Contributor
jseigneuret
jseigneuret
asked in Transformers
Isolate list of attributes in published paameters

I use a custom transformer with two inputs, 1 per table.In my custom transformer i have 2 published parameters to get the attribute of:table A - Fieldtable B - Field But both parameters return globales listes of fieldsIt's possible to isolate the fields list for each table on it specific parameter  

80
virtualcitymatt
Celebrity
francis_m
Contributor
francis_mContributor
asked in Transformers
Multiple attachment emailer

I have a simple workbench that read data from a table and produce a number of Excel files. Depending on the config, the output can be 2, 3 or more Excel files (via FeatureWriter). At the end, I want to send the result by email. If I use Emailer and put my attachment manually, it works perfecly, but if I want it to be more flexible, I want as many attachment as my workbench produce. Is it possible to concatenate the output dataset produced ? I tried but failed... any Idea ? No zip please!

1370
virtualcitymatt
Celebrity
M
muhammad_yasir
asked in Transformers
Defining dataframe at Python Caller

Hi there, I am defining a data frame at Python caller on __init__ function like below: class FeatureProcessor(object): def __init__(self): df2 = pandas.DataFrame(columns= ['INCIDENT_DATE',INCIDENT_MINS','INCIDENT_VALUE']) later in the program at input function I am storing feature attribute value in data frame something like that: def input(self,feature): self.pyoutput(feature) df2['INCIDENT_DATE'] = feature.getAttribute('DATE') df2['INCIDENT_MINS'] = feature.getAttribute('MINS') df2['INCIDENT_VALUE'] = feature.getAttribute('VALUE_LOST') However, when I ran the Python caller block, it throws an error message that df2 is not defined at the input block. Could anyone point out where am I making the mistake?     

682
jseigneuret
M
mike707
asked in Transformers
FME Uses Proxy Even When "No Proxy" is selected

I change FME Proxy Settings from "Use system proxy settings" to "No Proxy". But FME is still using the system's settings. So I edited the systems's settings and disabled proxy, and removed proxy settings from environment variables. FME still uses proxy settings. I restarted FME, and it still uses proxy settings. I can't connect to the proxy right now, so the transformation crashes. Snapshot below. How can I get FME to not use any proxy? FME 2020 here. Thanks in advance, Mike 

330
M
boubcher
Contributor
boubcherContributor
asked in Transformers
Right left side of the road

I am not getting the right info when I use the rightleft transformer for the position of the point to the road I check the segment and is has the same direction all Point are getting RIGHT position valueany thought please 

60
srg
B
bbulla
asked in Transformers
Exported shapefile problems - FeatureWriter

Hi,So after lots of testing, it's looks like when I export shapefiles using the FeatureWriter and include the .sbn Spatial Index, the shapefiles do not function properly. When first loading them in ArcMap, they appear to be ok, but when zooming, selecting, panning the map, I get very odd results with certain features suddenly dissapearing, not being selectable, etc. If I modify my FeatureWriter to not include any spatial index, then the shapefiles work fine. I only have this problem when I include the spatial index. I would like to include the spatial index. Is there a fix for this?? Thanks,

590
debbiatsafe
Safer
mattebridges
Contributor
mattebridgesContributor
asked in Transformers
How to create attributes from JSON arrays?

Hi - I'm trying to create individual records with attributes from a JSON response from an API. I've been able to call the API using the HTTP Caller and have tried using a JSON Fragmenter to extract attributes.  I don't seem able to get attributes from this but as shown in the attached there are a number of attributes in one of the returned rows. This looks as if it is a list called 'array' (there are 49 members in the 'list' which is as expected). I'd have thought I could use a List Exploder but this transformer doesn't pick up any list attributes. I'd really appreciate any advice on how I might explode this structure in to individual rows with attributes. Thanks and all the best. Matt 

10490
jdh
Contributor
A
ateko
asked in Transformers
ESRI Reprojector - Read Source Coordinate Sytem from feature

Is it possible to read the coordinate system from the input features and use it as source for the ESRI reprojector? Background is, that I don't want to define a transformer for each UTM zone as the destination coordinate system and the geographic transformation will be identical for all, so it would make sense to read the source coordinate system from the input files. Unfortunately I have no idea how to realize this. I've tried a User parameter, but I have no idea how to dynamically populate this value with the source coordinate system.

340
andreaatsafe
Safer
G
gsgoraya
asked in Transformers
Create buffers based on Distance and find the count of points within buffer

Hello All,I have two datasets. The first dataset is excel files that show citizens' residence the second dataset is GTFS. I want to find the number of residents who live within 400 meters from the existing bus stops. I would appreciate the help or advice. Thanks

1070
R
bonbon
Contributor
bonbonContributor
asked in Transformers
How to clip a raster with clipper's extend?

Hi,I want to cut a raster with shp file, and the result raster will have the extent of the clipper's instead of the clippee's. (consider null or nodata as filled up)

4030
adriano
B
bkolubenka
asked in Transformers
I would like to ask about creation list from several columns

I just want to create a line from below table in screen. To do it may be needs to create list as below but I do not know how it manage. Please help Sample of list below. Facility Name | Request User | X | Y |========================================Line | MEKK | x1 | y1 |Line | MEKK | x2 | y2 |Line | MEKK | x3 | y3 | Line | MEKK | x* | y* |    

120
gio
Contributor
T
thomas_
asked in Transformers
How to calculate a 7-days moving average

I'm trying to calculate a 7-days moving average in FME 2017.Using "DateTimeConverter" and the "Cumulative" option in "StatisticCalculator" I've managed to calculate a moving average on a weekly basis. However, the calcul of the average re-intializes at the start of each week with the value of the first day of the week.Is there a way to implemente a moving average with a known frequency (7 days in this case, 365 in another I'm working on)?Thanks

830
T

Badge Winners

Show all badges

Community Stats

31,810
Posts
120,826
Replies
39,437
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.