Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,712 Replies
10000 Posts
scarter
Contributor
scarterContributor
asked in Transformers
Calculating distances from source points to a hotpot location via a road network

Hello. I need to calculate the distance in metres from a set of points to a singlehotspot location, but have it calculate the shortest distance along a line roadnetwork (to the hotspot). I have three datasets: Table 1: several 'home' locations (points)Table 2: one hotspot 'destination' location (point) Table 3: a road network (lines) The road network layer does not contains things like no left turn, one-way, pathways, best avoided roads, dead-ends etc. etc. That's absolutely fine, as I just need a crude distance along the network.  Also, the home locations may or may not be on the network, so I may need to introduce a tolerance for where a point doesn’t snap to a network line. I need the shortest distance added to table 1 as a new column in metres. I’ve looked at ShortestPathFinder and LengthToPointCalculator but they don’t seem appropriate. Many thanks, 

1740
DanAtSafe
Safer
olivier
Contributor
olivierContributor
asked in Transformers
Solving gaps and overlaps among 3D road polygons

Hi, I have a street network of 3D polygons and the set is not 100% topologically correct. There may be small gaps or overlaps between consecutive road polygons. And normally two consecutive polygons should share the same set of vertices at their junction (materialized by the line separating 2 adjacent polygons).  This would be very easy to solve in 2D using transformers such as the Snapper, AreaOnAreaOverlayer, AreaGapAndOverlapCleaner or TopologyBuilder . But these transformers seem to support 2D only and as a result will not take the z information which is stored in each polygon vertex coordinate. Roads crossing at different z value (bigger than a tolerance of x meters) should not obey to the same rules as those roads which are consecutive.Do you see a possible solution using FME? I was thinking about classifying polygons according to their distinct heights, also cutting polygons with more than 1 z value into 2 parts, and then running the AreaGapAndOverlapCleaner on them with the Gro

690
olivier
Contributor
juanmahere
Supporter
juanmahereSupporter
asked in Transformers
How can I parse XML data?

Hi,New in XML transformers, I'd like to know in FME Desktop 2022 how can I read and parse data contained on this XML: <SOAP-ENV:Envelope><SOAP-ENV:Body><ns1:GetSiteValuesResponse><ns1:siteValues><ns1:siteRAIId>1558</ns1:siteRAIId><ns1:x>144.882271794492</ns1:x><ns1:y>-37.825548770183602</ns1:y><ns1:enabled>true</ns1:enabled><ns1:reportedTime>2022-07-26T23:58:04.878</ns1:reportedTime><ns1:currentValues><ns1:laneNumber>1</ns1:laneNumber><ns1:panelValue>Blank</ns1:panelValue><ns1:annulusFlashing>false</ns1:annulusFlashing></ns1:currentValues><ns1:currentValues><ns1:laneNumber>2</ns1:laneNumber><ns1:panelValue>Blank</ns1:panelValue><ns1:annulusFlashing>false</ns1:annulusFlashing></ns1:currentValues><ns1:currentValues><ns1:laneNumber>3</ns1:laneNumber><ns1:panelValue>Blank</ns1:panelValu

2640
hkingsbury
Celebrity
aaron
Contributor
aaronContributor
asked in Transformers
Emailer attachment fails with 'Message size exceeds limit' error

I have a workspace that writes a simple CSV file a little over 10 MB in size using a FeatureWriter. I then use an Emailer to send the file to myself but receive a 'Message size exceeds limit' error. (Error wording is - Emailer: SMTPSenderRefused: Could not complete request. Message: (552, b'5.3.4 Message size exceeds fixed limit', 'myemail@company.com')) Is this limit imposed by the Emailer transformer itself? I can email the file to myself as an attachment manually without issue so I don't think it's our company email server. Wondering how I can overcome this issue. Running FME Desktop 2020.1.2.1 (Build 20624). Thanks, Aaron

440
aaron
Contributor
D
daniel
asked in Transformers
How to resolve failed to write error for writing aggregates to line feature class in Esri Geodatabase (File Geodb Open API) writer

Hello, I've got an FME workspace which uses the LineBuilder then aggregates the lines using the Aggregator which grouping the line features into aggregates grouping by an attribute. However, I'm getting the following error message:FileGDB Writer: Failed to write Geometry to feature class 'BUS_ROUTE' with geometry type 'esriGeometryPolyline'. Dropping containing feature.I've tried using GeometryCoercer after the Aggregator but this doesn't work as the GeometryCoercer cannot coerce IFMEAggregate features into lines. Any help would be much appreciated, thank you.

1690
M
L
lachichi_farah
asked in Transformers
How to get the percentage of a feature compared to another ?

For exemple, I would like to have "This feature A overlaps 5% of the feature B" and "The feature B overlaps 30% of the feature A" (I have one dataset) For now, I used "AreaOnAreaOverLayer" to have overlaps. Then, I calculated the area of the overlaps and the features to know what part of the feature the overlap represents. However, at the end, I have for a feature the percentage that represents the overlap compared to one feature, but I haven't the other feature. I only have " Field 1: Feature A / Field 2: 80%" . That's allI want another field that tell me the name of the other feature. Thank you for helping   

4830
L
arnaud974
Contributor
arnaud974Contributor
asked in Transformers
Transform a coordinates array into a polygon

Hi, I've downloaded a json file that contains geometries defined as an array of coordinates. A portion of this json file is described below. One json feature can have one or more geometries. I can't find the proper way to parse this json file and transform this array of coordinates to a polygon. Do you have any solution ?  Thanks for your help.{ "identifier" : "2", "country" : "REU", "name" : "[FM][D 2] La grande montée/Plaine des cafres", "type" : "COMMON", "restriction" : "PROHIBITED", "restrictionConditions" : "", "region" : 931, "reason" : [ "OTHER" ], "otherReasonInfo" : "Zone dangereuse", "regulationExemption" : "", "uSpaceClass" : "", "message" : "Vols interdits sauf lorsque la publication d'information aéronautique l'autorise explicitement ou avec l'accord du gestionnaire de la zone lorsqu'il est désigné par l'information aéronautique", "applicability" : [], "zoneAuthority" : [ { "name" : "Autorité mentionnée en ENR 5.1 de l’AIP", "service

2982
arnaud974
Contributor
O
oskarwallin90
asked in Transformers
How to properly UVmap a TINsurface, without getting large offsets in the UVmap?

Hello!  I am generating a few TIN surfaces which i want to use in Unreal Engine. This means that i will need to generate a UVmap to be able to texture it in engine.  My current setup looks like this: (Ignore my Apperance setting and image rasterizer, i was trying to see if generating a georeferenced texture would work in the appearance setter.). My TIN surface is far away from Origin, so what i am doing is removing the xmin and ymin extracted in the bounds extrator for the offset in the texture coordinate setter. I have tried to do the same thing for the appearance setter aswell.  It seems to generate a UVmap, but the UV is VERY offset in regards to where i need it to be. the scale is correct though.  This is how my UV looks in 3Ds max, its the correct size, but WAY offset.  As you can see below, the size is correct if i manually move the UV down to the 1:1 UV.   Moving this manually for every tinsurface i generate is both nonexact aswell as timewise impossible. Do you have any tips?

240
O
N
natashya
asked in Transformers
HI EVERYONE, I have a problem where I need to update ENERGY ADE using FME workbench but there is nothing appeared, I would like to ask, is it any of you have been work with it? I really need the helps since this is my final project.

HI EVERYONE, I have a problem where I need to update ENERGY ADE using FME workbench but there is nothing appeared, I would like to ask, is it any of you have been work with it? I really need the helps since this is my final project.

60
M
L
lachichi_farah
asked in Transformers
How to know if a field contains string or integer (numbre or letters) ?

I have a field with a code (number) and I would like to know if a feature haven't a number code in her line (maybe a message like "error" or other but with letters). Thanks for helping

3420
M
B
bi
asked in Transformers
Excel FeatureWriter ignoring Row Number Attribute

Hi all, I've published a workspace to FME Server which updates some rows in Excel. When run on FME Workbench, the rows are correctly updating (using fme_db_operation = UPDATE) at the correct row number, which starts at row 10. I've set the row number by using a counter for xlsx_row_id with a Count Start set to 10. Weirdly, when published to FME Server, the workspace ignores the xlsx_row_id attribute and starts writing at row number 1 (even though it gets the correct column positions). Is this a bug in FME Server? Does anyone have a workaround? I've tried different options in the Start Position parameters of the FeatureWriter (both "Named Range Start Row" and "Start Row") but no success... Any advice gladly received, BI

1000
B
K
khalid_omer
asked in Transformers
convert line to an arraw

Dear All , We have a line and we need to add an arrow to it , as shown below we need to add the blue line , it looks that we need to use 2d pointer adder but how to get the exact location from the end point and draw two lines

520
fme_hans
Contributor
charry
Supporter
charrySupporter
asked in Transformers
Vertex normals removed due to application of non-invertible matrix

Vertex normals removed due to application of non-invertible matrix,Error running translation. when I try translate the 3d .obj model to 3dtiles,the error Appear，of course not all obj appear the error

120
charry
Supporter
P
ppp19
asked in Transformers
How to update PostgreSQL existing schema with any new data with additional columns ?

Hi, I am new for using FME to create PostgreSQL database and having trouble updating schema or adding columns to the existing table. so to explain in detail: 1) I have different councils 3 waters pipe data which I want to add to my database2) I have already done extracting, and transforming of data but now I want to load data coming from different councils into a single PostgreSQL database3) So I am using FME writer format "PostgreSQL" and table (say Table1) definition as "Automatic" and ok till I have added the data from one council having 52 columns4) Now when I am trying to add data into same postgresql database table (Table1) from other council having 79 columns in it ... my database is not accepting data from those new columns came from new council 79-52= 27 columns into my existing database table Any comment or recommendation on this will be great!

3510
geomancer
Evangelist
B
bradosav
asked in Transformers
User parameter for reader path

My workflow regularly compares files stored at path X with prefix Y with files stored at path Z with prefix Y. I'd like to set up the workbench in such a way that I'd copy the workbench for a project and only have to edit the Y parameter for it to read in the required files, i.e. Read: $(Path_to_X)/($Prefix_Y)*.csvRead: $(Path_to_Z)/($Prefix_Y)*.csv Can this be done, and if so, how?Thanks!

1630
B
B
bruno_de_lat
asked in Transformers
Tools for version control of .fmw en .fmx files

Hi all,  I was wondering if somebody could advice me a good tool that can be used for good version control of FME Workbenches and FME Custom Transformers. Any suggestions? Preferable an open source tool.  There are some  tools available for this, but most of them offer also automated "merge" and "compare" functonalities and in my opionion  this doesn't work well on .fmw en .fmx files, therefore I prefer not to have this functionality.  In case there is a difference, the user should be the responsible to choose the local version or the version of the server to decide which one to keep. Also multi-user-editing of the same workspace is not something that works in an FME environment (yet). But I do have interest in the back up functionalities, the compare functionalities, have a single repository of the main workbenches, being capable of taken the models locally and run them locally,...  I experimented with GIT version control, and It helps, but it is not exactly wh

540
B
smfks911
smfks911
asked in Transformers
Why attribute is missing after area on area overlay?

Hi altruist, I am having an issue in after using AreaOnArea overlay operation. I have overlaid two polygon datasets and ideally the output should have attributes from layer when there is _overlap field have 2 and more. This is what happened for other overlay operations. However, in the following cases I do not see the attribute from one of the polygons after the overlay operations: This is the attributes before overlay:The overlay operations:After the overlay:Does anyone have idea why that may happen?

940
smfks911
D
daichisuba
asked in Transformers
How can I write or create a newline-delimited GeoJSON file

I'm currently exploring MapBox and their Tiling Service, which is currently in Beta and I'm trying to figure out how to create a line-delimited GeoJSON output so I can upload via their Tileset API.  The data/file needs to take the format as per the example below: Normal GeoJSON{    "type": "FeatureCollection",    "features": [        {            "type": "Feature",            "properties": {                "name": "Melbourne"            }, "geometry": {                "type": "Point",                "coordinates": [                    144.9584,                    -37.8173                ]            }        }, {            "type": "Feature",            "properties": {                "name": "Canberra"            }, "geometry": {                "type": "Point",                "coordinates": [                    149.1009,                    -35.3039                ]            }        }, {            "type": "Feature",            "properties": {                "name": "Sydney"         

1472
ebygomm
Influencer
F
fionahf
asked in Transformers
Why is this URL causing an error with FeatureReader?

I am trying to read the following URL (https://eprostor.gov.si/ods/atom?id=1&type=data) with a FeatureReader transformer so that it will download the zip file and process the data within. This works fine with many other URLs I have used in this way (e.g. https://services.cuzk.cz/gml/inspire/ad/epsg-4258/583723.zip), but not for this one.The error is:XML Parser error: 'Error in input dataset: 'https://eprostor.gov.si/ods/atom?id=11&type=data' line: 1 column: 11 message: invalid byte '�' at position 1 of a 1-byte sequence' I have attached an example workbench and associated csv containing a successful and failing URL in a list. I'm wondering if anyone else has ever come across this issue, and/or if anyone has any ideas as to what is causing the problem, and if it can be resolved in some way. The only thing I can think at the moment is the fact that the URL that is failing does not contain `.zip` at the end of the URL, or is maybe passing in some mis-information in the headers - t

170
todd_davis
Influencer
fmesafe.podpora
Contributor
fmesafe.podporaContributor
asked in Transformers
Data merging

Hi. I need some advice please. I have a 5x data branch at the end of WS. Each branch contains a defined attribute, see note. This attribute is part of the DepartureLeg. Each departureLeg contains a startpoint and an endpoint, two points (it can be one of the variants of five branches ( airportstartpoint, navaidendpoint... etc. ) and each departureLeg is part of a Departure. Chronologically, it goes like this. A departure contains several departureLegs and each departureLeg has two points ( airportStartpoint, navaidStartpoint, navaidEndpoint, etc. ) This is how I need to group it, but I can't. I think I have all the ids I need.

130
fmesafe.podpora
Contributor
helmoetz
Supporter
helmoetzSupporter
asked in Transformers
GML posList mixed up?

Hi, I'm struggling reading geometry from an xml file. When looking at a part of the (0.7Gb) large xml, I can see it has coordinates that reference a location I do not expect:<gml:LineString srsName="urn:ogc:def:crs:EPSG::4258" gml:id="GEOMETRY_98ce8c1e-3676-4a60-b2a8-d7e63fe97d1d"><gml:posList srsDimension="3">51.77106873325691 5.459700336196274 49.41166353587596 3.2520665388839736 47.937498062913775 8.934025947231504 51.771400476701494 5.460105669526139 49.412014702926356 3.25205099130662 47.937476504785614 8.934700858000644 51.77170841095756 5.460502642204418 49.412240574188026 3.252040990938717 47.93746470527796 8.935070205423436 51.771910436397455 5.46090045825306 49.41302764854071 3.2520061426583493 47.9374374566226 8.935922993715176 51.77277383456701 5.462819713112839 ...</gml:posList></gml:LineString>The 3D coordinates seem to alternate, which might have something to do with a side view from the data, I guess. When I look at the data in the viewer, it loo

1100
helmoetz
Supporter
eric_armitage
Contributor
eric_armitageContributor
asked in Transformers
Reading Microstation DGN Header information

The documentation for the IGDS (DGN) reader states that "Design files consist of a header, followed by a series of elements. The header contains global information including the transformation equation from design units to user coordinates, as well as the dimension of the elements in the file" . My question is how do I read only the header information - coordinates and dimensions etc. I have a large number of files and I just want to the header info from each one. I know how to run the batch processing part with the workspace runner but can't figure out how to set up the reader.

520
eric_armitage
Contributor
brandonguo
Contributor
brandonguoContributor
asked in Transformers
How to design a customised loop transformer?

I am trying to solve the application allocation issue through FME. The scenario is I have a list of applications and a list of places with limited spaces.  My initial thought is to sort applications by date, every time, send only one application to the neighbour finder and then change the place's available spaces.  The issue that annoys me is it seems like two loops running parallel but also linked together. Not sure what's the best way to design this type of loop? My loop design seems like just creating an endless circle.Any guide would be much appreciated.

1610
brandonguo
Contributor
O
oiram
asked in Transformers
Split up polygon where it becomes long and narrow

I have a dataset where polygon sometimes have a long and narrow part like in this image (upper narrow part of the highlighted polygon): I am looking for a way to cut polygons like this in two parts so that the small polygons becomes a separate shape.Any idea how to do this automatically? 

1350
V
N
neel_d
asked in Transformers
How to apply formatting to pivot table when writing to excell using dynamic writer

I have a dataset with 3 attributes (REF_ID, orde, DMdrempel) and one (DHMdrempel) has formatting (colouring) applied.There is a 1 to many relation between REF_ID and orde, a 1to1 between DHMdrempel and orde (although sometimes values of DHMdrempel can be identical).I want to create a pivottabel as this one but with the formatting applied:I apply an attributepivoter with parameters set as follows: group rows by REF_ID, group colums by orde and attribute to analyze is DHMdrempel.Because of automation purposes and because I don't know the (maximal) number of 'orde'/columns, I cannot use the attributeExposer (or at least I think I can't). I therefore use a Dynamic writer to create my excel file.But I want to include the formatting (colouring) of the DHMdrempel into my pivotted table but I can't find out how to do this. Can you help me?

380
dmitribagh
Safer

Badge Winners

  • Welcome Back
    dcoxhas earned the badge Welcome Back
  • Welcome Back
    mglimsdalhas earned the badge Welcome Back
  • Webinar Watcher (Ruby)
    bchadhas earned the badge Webinar Watcher (Ruby)
  • Webinar Watcher (Grey)
    fme_studenthas earned the badge Webinar Watcher (Grey)
  • English Speaker
    jkenneyhas earned the badge English Speaker
Show all badges

Community Stats

31,803
Posts
120,813
Replies
39,429
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.