- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,751 Posts
51,004 Replies

When you subscribe we will email you when there is a new topic in this category

12751 Posts

Most replies

Most views

Newest first

lifalin2016Contributor

asked in Transformers

Deleting "unknown" attributes ?

Hi,We have a proces, that converts some schema-less XMLs into MS/SQL. The output definition is set to "Automatic".It now seems, that later versions of the XML files include more attributes than the original versions. These new attributes are output as-is, but cannot be seen in the workspace.I've tried to update the reader feature types, but even though the attributes are present in the data files, they don't show up in the workspace.How can I by default remove all "unknown" attributes coming from the XML files ?Oughtn't the Attribute Manager have an option for this ?Cheers.

6 years ago

lianaolianov

asked in Transformers

Help using the MRF2DIntersector

Hello,Can somepne please help me using the MRF2DIntersector ? I'am trying to remove overshoots but I got confused and lost within the transformer's parameters. Thank you in advance.

6 years ago

poncetaContributor

asked in Transformers

Invalid WKT encountered: LINESTRINGZ

Hi,I've encountered a problem when using a GeometryReplacer With LineStringZInvalid WKT encountered: LINESTRINGZ(541502.5560000000 152585.6960000000 583.544, 541502.4660000000 152585.4560000000 583.775, 541501.2901908699 152581.1464218800 0.0)I do assume that LinestringZ is not an OGC WKT recognized format yet, although it is recognized as a valid OGC WKB format.http://portal.opengeospatial.org/files/?artifact_id=25355My goal is to check the geometry validity from my linestringz features before sending these to my postgis database.SELECT ST_ISVALID(ST_GeomFromText('LINESTRINGZ(541502.5560000000 152585.6960000000 583.544, 541502.4660000000 152585.4560000000 583.775, 541501.2901908699 152581.1464218800 0.0)'))Any idea how I could deal with this on FME 2018?

290

6 years ago

rohan

asked in Transformers

UpdateDetector - passing in attribute for Attributes to Match value

I have an UpdateDetector that compares incoming WFS records with a static table which then gets updated. I was supplying the Attributes to Match value from a user parameter. However, I was asked to make it work with a CSV file that supplies the required values. I was able to create a comma-delimited list by using a listConcatenator.However, I can't find any way to make the resulting attribute available to the UpdateDetector. I tried just passing it in to the Original node along with the records to be tested, but this always results in a spurious row appearing in the Delete port that just contains the attribute. As a work-around, I can filter out the unnecessary row to ignore it; however, this is a bit kludgy and I'm wondering if there is a better way to do it. I've tried inserting the attribute at other points in the work flow, but this either results in the attribute not being available to the UpdateDetector, or else the same thing happens. It seems like it should be possi

6 years ago

lianaolianov

asked in Transformers

LineCombiner and MRF2DJoiner seem not to work properly

Hello, I have a shapefile where some connected lines have to get connected and merged into one feature. However, it seems like there is a problem in my use of LineCombiner and MRF2DJoiner.Here is my shapefile : https://drive.google.com/open?id=1Iwe0FDMePozczihABOvJ_PBlre7xRAisAttached : a picture of a linear feature who has passed through the LineCombiner but still divided in 2 llines altough there are both connected. Thank you.

6 years ago

iboates

asked in Transformers

TopologyBuilder is not cleaning topology properly

I am having a problem with the TopologyBuilder transformer. I have "Assume clean data" set to "No", but it is not cleaning the data properly. Some of the edges are broken up according to the other lines, but others are not. These images are the result of my TopologyBuilder transformer, with the vertical line in the middle starting as one long line before being sent to it. As you can see from the highlights, some of the lines are not being split properly.I have zoomed in on these features as far as I can go with QGIS and I do not see a gap between them. I would assume that this is due to some imprecision in the snapping tolerance but I cannot find such a parameter to adjust.This is the transformer as seen in the workbench:

430

6 years ago

lianaolianov

asked in Transformers

Problem with LengthCalculator

Hello, I have a problem with the LenghtCalculator transformer. The point is that, when I calculate distances of linear segments I expect that visually long ones have bigger distance values but it's not exactly what happend. I want to use it along with a TestFilter to delete lines of lenght below a value of my choice. Thank you in advance. Here is the shapefile I'm working in : https://drive.google.com/open?id=1-vycWGAvos7pjCxE7tLXHroA69G1M5-G

510

6 years ago

robert_puntContributor

asked in Transformers

reading dutch json

Hi everybody, ik am trying to read an url that gives me json-format answer.the url is like: https://geodata.nationaalgeoregister.nl/locatieserver/v3/suggest?wt=json&q;=Nieuwe Steen 1 Hoorni want to read the values of the attributes "type" "weergavenaam" "id" "score"regard,Bert punt

135

6 years ago

aronContributor

asked in Transformers

Pass geometry and coordinate system when converting from XML

I am trying to convert a dataset from XML (KuntaGML) to shape but cant get it to behave properly. I am using a dynamic workspace and the output is 80:ish shapefiles. Everything exports but loses its coordinate system and gets is geometry from the first feature read. I have tried adding the desired coordinate system up in the left corner of the workspace but it only seems to be written to half, or so, of the files output. As for the geometry I have tried both "from schema" and "first feature defines geometry" none of them make any difference, everything is output as points, even though all geometries are in the XML. What am I doing wrong?

130

6 years ago

kellos

asked in Transformers

Unable to get a PDF2D from a JPEG2000

Hi,I am currently trying to get a PDF2D file with several layers (a background map and some additionnal information). To do this, I used a sorter, a PDFPageFormatter and a Geospatial PDF writer.Everything works fine, except for the background part. I use a JPG2000 reader. No matter how I try to make a PDF out it, it fails (by failing I mean, the pdf file is created but no background is visible or it even makes Adobe Reader crash). I have tried with only JPEG2000 reader and PDF2D writer or this some intermediate transformers, nothing seems to work.Are there any parameters I missed?(I use FME 2015.1.0.0 and Acrobat 8). Acrobat 8 always crashes when loading the resulting file. Acrobat Reader XI somehow manages to load the file, but even if the layers are there, the background layer is empty and so are most of the other layers)

6 years ago

dustinInfluencer

asked in Transformers

Searching complete dataset for null values

I'm trying to calculate the percentage of null values per feature class in a dataset. Null values are defined by '-99999' or 'noinformation' or 'No Information'.I have hundreds of feature classes, each with hundreds of attributes named differently. So building a workbench calling out each attribute specifically would be very time consuming. This needs to be a dynamic solution.So far I've tried an AttributeExploder followed by ListSearcher, but I'm having trouble calculating totals based on feature class.

132

6 years ago

redgeographicsCelebrity

asked in Transformers

Explode multi-part geometry

The attched FFS file contains multi-geometry objects where one or more of the parts are arcs. I need to do some checks on the parts that are not arcs. So far I haven't been succesful in getting only the non-arc segments out, so any suggestions would be very welcome.I tried the GeometryPartExtractor (checking for child elements of type IFMEArc) but that only selects the entire object, I want to break it up.And stroking the arcs is not an option...

6160

6 years ago

mvdorst

asked in Transformers

Xml flattener and multiple occurences of an element

Hi, I use XML flattener like this to expose an element. What I want, and what this does, is make a column with the element name as its name, and put the value of the xml element that was matched as its value. The problem is when "ElementToMatch" occurs multiple times in the XML file. It only makes one new column and puts the first occurring value that was matched inside. Is there a way to make as many columns as needed so that each found value ends up in the results? Order and empty values (if only one is found for example) don't matter.Thanks a bunch in advance.

23525

6 years ago

llindish

asked in Transformers

How to merge two data sets with connecting IDs, when some of the attributes need to be transposed?

Hi there,I'm looking for a way how to bring together these two data-sets. 1st data-set contains records with unique ID and several attributes: Connect_ID Facility TypeName 3 Cafe Ice-creamAAA 12 Store GroceryBBB 25 Store ElectronicsCCC 2nd data-set contains IDs, days and operational hours:Connect_IDDay of the weekOpensCloses3Monday8:00:0018:00:00 3Tuesday8:00:0018:00:00 3Wednesday8:00:0018:00:00 3Thursday8:00:0018:00:00 3Friday8:00:0018:00:00 3Saturday9:00:0014:00:00 3Sunday12Monday8:00:0017:00:00 12Tuesday8:00:0017:00:00 12Wednesday8:00:0017:00:00 12Thursday8:00:0017:00:00 12Friday8:00:0017:00:00 12Saturday9:00:0015:00:00 12Sunday25Monday8:00:0018:00:00 25Tuesday8:00:0018:00:00 25Wednesday8:00:0018:00:00 25Thursday8:00:0018:00:00 25Friday8:00:0018:00:00 25Saturday9:00:0018:00:00 25Sunday What I would like to do is bring these tables together, but they should have 1 row per ID, so the days and the opening hours should be transposed to

1340

6 years ago

denizturan1985

asked in Transformers

String Replacer doesn't catch Unicode Character

Hello all,I have a problem with catching Turkish Unicode characters in StringReplacer and StringSearcher transformers. "\\w" function doesn't catch " Ç ç ? ? ? ? Ö ö ? ? Ü ü" letters. It works when I put these letters in the search bar. Also, I checked the same letters on www.regexpal.com and it didn't work too. Is there any solution to catch these letters with "\\w"? Otherwise, I need to change these letters with other special characters which don't exist in Turkish Alphabet at the beginning and the end of the Workspace. ThanksDeniz

153

6 years ago

davidbailey

asked in Transformers

Populate entire column based on specific value in the same column

Is there an easy way to populate an entire column (I have multiple columns) based on the value in that column that has a comma in it?Basically, if I have a column named pole and all attributes in that column have the value of "pole_status" except for one value that has this value: "Con, PLA, MRC, MRE". How can I populate the entire column with "Con, PLA, MRC, MRE".I've tried Attribute Manager using a Conditional Value to filter out all records that don't have comma in it but then I'm not sure how I can actually use the "Con, PLA, MRC, MRE" value as the output value. Maybe there's a better option. Custom Python might do the trick - but I want to exhaust all of my transformer options before I go that route. Note: I cant simply write "Con, PLA, MRC, MRE" in the AttributeManager since these values will change and there's multiple columns - si it wouldn't be sustainable I also know I can probably accomplish this by us

2050

6 years ago

garydlester

asked in Transformers

Run Workspace with Data, FME Cloud

I am trying to troubleshoot why a cloud workspace won't run with data and I am getting this response from the server."request": "\\"DataProcessing/FieldDataLineCreator/FieldDataLineCreator.fmw\\" -XML_PARAMETER {\\"remote-addr\\":\\"127.0.0.1\\",\\"host\\":\\"production-tgs.fmecloud.com\\",\\"user-agent\\":\\"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:59.0) Gecko/20100101 Firefox/59.0\\"}C:\\\\fakepath\\\\1801116-012618RF(TGS_Export_v2).csvhttps://production-tgs.fmecloud.com/fmedatadownload/DataProcessing/FieldDataLineCreator.fmw?detail=high{\\"opt_responseformat\\":\\"json\\",\\"SourceDataset_CSV2\\":\\"C:\\\\\\\\fakepath\\\\\\\\1801116-012618RF(TGS_Export_v2).csv\\",\\"detail\\":\\"high\\",\\"opt_showresult\\":\\"true\\",\\"token\\":\\"\\"} --FME_SECURITY_USER \\"\\" --FME_SECURITY_ROLE

6 years ago

pedrortm

asked in Transformers

Dynamic KML and GeoJSON from Azure Stream Analytics

Hi,I was wondering if it's possible to connect to Azure Stream Analytics and from the output, create a dynamic KML URL and/or a GEOJSON source to connect other applications to. If so, at what cost?Thanks

6 years ago

ryanfishersk

asked in Transformers

Rasters to polygons based on values in a table

Hello,I have around 200 rasters (in ascii format, all in the same folder) that need to be converted into polygons based on a certain threshold pixel value (as an example, for one of the rasters the final polygon should include any pixels above 0.4). Unfortunately, the big issue is that the threshold value changes for each raster (0.4 in my example, but could be 0.5, 0.6, etc for other rasters). I have an excel table with the raster name and associated threshold value but I can't figure out how to make a workflow where the raster name is then used to lookup the matching value in the excel table and then use that value in the RasterExpressionEvaluator and subsequent RastertoPolygonCoercer transformer.Thank you for any help!

310

6 years ago

jennamkdavis

asked in Transformers

Automate process of georeferencing parking lot spaces

Hi everyone, I was wondering whether anyone had strategies for automating the georeferencing process. I have a raster displaying parking lots and am trying to create a dataset that shows the painted parking space lines. In the past, I've manually drawn the parking space lines, but was wondering whether anyone had any suggestions on how to automate this process.Basically, I've been thinking about how to draw a rectangle over the entire area of the parking lot and then somehow divide the parking lot into a specific number of spaces. However, since each parking lot has a different number of spaces, I'm stuck on how I'd automate this process.Any ideas?Thanks

6 years ago

ivanoterouvigo

asked in Transformers

how tow convert dxf to gbxml

160

6 years ago

s3585629

asked in Transformers

Changing to local time, create new data file and find out features with same attibutes

Hi, I just jumped into FME world and get stuck with it. I have a data file of location based network and need to do analyzing with it. The file looks like thisUserID VenueID VnueCat VenueName Lat Long Offsetminmute UTC Time470 49bbd 4bfds Arts & Crafts Store 40.719810 -74.0025 -240 Tue Apr 03 18:00:09 +0000......1. I need to convert the UTC into local time zone2. How can I create a new dataset with specific UserID3. How can I find any 2 different UserID which have same Lat, Long and LocalTime attributes and create a list of them come along with same attributes.I have attached a small sample of the datafile below. Please let me know if you need full data file

6 years ago

jackzhang

asked in Transformers

xfMap error handling

Hello,I have a complex xml file and have created a xfMap to translate it. However the reader terminated the whole process when it failed to translate one feature due to it doesn't have the required geometry info (Line0008 as in the code below).I'm wondering if there's a way in xfMap to handle errors by using something like try...catch or if..else. Or should I validate and fix the invalid features using something like xmlvalidator and updator before translating it using xfMap? thank you.<PlanFeature name="Line0007"><CoordGeom><Line oID="Line0007_0001"><Start pntRef="TPS0021">5813350.321246 317541.885870 2.430529</Start><End pntRef="TPS0022">5813350.289701 317542.164240 2.460172</End></Line><Line oID="Line0007_0002"><Start pntRef="TPS0022">5813350.289701 317542.164240 2.460172</Start><End pntRef="TPS0023">5813349.458068 317542.315624 2.497628</End></Line></CoordGeom></PlanFeature><PlanFeatu

153

6 years ago

raalst

asked in Transformers

How to test a multiline feature for the number of disjoint line segments ?

Hi all, I have an oracle SDO geometry table containing multiline features. These features should be contiguous collections of point-pairs. i.e. all endpoints should touch another point-pair from the same feature. the features can form a string of point pairs ('~'), but also a 'Y' type of topology, or something more complex. However, the feature should not consist of sub-parts that are not connected to each other (e.g. '~ ~' ).How can I test for this requirement to be met ?I think I should somehow be able to count what Oracle calls the parts of the multiline object, but it is not clear to me if I can call these oracle constructs from FME, or what FME equivalent to use. Can you point me to some example or helpful bit of information for this type of tests in FME ?Regards, Ronald

440

6 years ago

owen

asked in Transformers

Insert point at end of line

Hello,I am trying to insert vertices at the end of lines, using the vertexcreator and 'insert point at index'.To do this I am using -1 for the index, but this adding the vertex at the point one before last (see image). How can I get the extra vertex to be at the end?Thanks, Owen

3170

6 years ago

Page 341 / 511

Badge winners

mpimiskernhas earned the badge English Speaker
mpimiskernhas earned the badge German Speaker
albineprohas earned the badge Student (Bronze)
albineprohas earned the badge Student (Grey)
albineprohas earned the badge Expert (Grey)

Show all badges

30,469: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.