- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,682 Posts
50,740 Replies

When you subscribe we will email you when there is a new topic in this category

12682 Posts

Recently active

Most replies Most views Newest first

akcaribou

asked in Transformers

How to sum shape lengths based on different combination of years

I have a dataset containing fields representing year and shape length and would like to know how to sum the shape length based on different ranges of years. For example, if I had years 2010- 2020 how would I get the following? 2010 = sum of shape length 2010 2011 = sum of shape length for 2010 and 2011 2012 = sum of shape length for 2010,2011, and 2012and so on up to 2020. For reference, please see the attached image of my data set. I've attempted to work this out using test filter using the "IN RANGE" operator but it seems to filter out the values for each consecutive year. Would creating a new field using a combination of math functions and string functions within Text editor in attribute manager be a better method?

3 years ago

zacharylee1204

asked in Transformers

How to find vertex/points that are not on the line feature

Hello everyone, So I have many points and lines in my data set. I would like to extract those points that are not on/touch the lines. May I ask how I can do that? Thank you and sorry for all the questions.

3 years ago

zacharylee1204

asked in Transformers

How to check a list (array) of data is within the given table (excel)

Hello there,So I have a list of data - Floor and units. For the units, it could have more than one categories (with space to seperate different categories). And I have a excel list that shows all the categories.What I can to do is to check all the Units are within the excel table categories. Might I ask how to do it? Since there could be several cateogries in one unit, I am not sure how what transformer I should use to solve my problem. Data:Floor UnitsG/F Lobby1/F Office Toliet Excel:TypeLobbyOfficeTolietBathroom Thank you for your help!

3 years ago

jawaz

asked in Transformers

How to convert Mapinfo Tab file text to Geodatabase Annotations?

Hi, I am new to FME. I have a Mapinfo TAB file from UK Mastermaps which contains the map text ( housenumber, streets etc). I would like to conert it to gdb annotations to be used in arcgis.

281

3 years ago

moset221

asked in Transformers

Create same geometry with different attributes

Hi, I have a polygon layer that represents the building footprint (attribute: building id). In .csv I have a list of apartments (attributes: building id, Apartman id). One building consists of x apartments. So, I need to x duplicates of the building footprint and each clone needs to have a different apartment id. I used the FeatureMerger to join shp and csv and clon to create duplicates of geometry but all duplicates have the same apartment id.

3 years ago

mahbouberezaiee

asked in Transformers

How to replace features of one GML file in another using gml id

Hi everyone. I have 2 gml files and want to replace some buildings from one of them in the other one using their gml id. I tried feature joiner, but it doesn't work. Can somebody helps me with that? Many thanks in advance

3 years ago

ikubra800

asked in Transformers

convert Using XML hierarcy(parent-child id) to relational database(postgresql) tables

191

3 years ago

raphael

asked in Transformers

FeatureReader with Oracle multiple geometry

Hello, I use one featureReader to load Oracle spatial data on my workspace. How can i choose my geometry like the oracle spatial reader ? By defaut fme read the first geometry field. Thank you

3 years ago

rob_nason

asked in Transformers

Filter data based on multiple columns

As an example, in Excel you would use the filter function and select specific values from the drop down menu across multiple columns. How in FME do you filter rows of data based on attributes held in multiple columns? I've looked at the two SQL translators; SQLCreator and SQLExcuter but both need connecting directly to a database. In my case I need to use the transformer within my workflow. Thanks.

784

3 years ago

arash_hokmContributor

asked in Transformers

Add a dot to the last three numbers

Hi FME Community,I have a column with number. I want to add a dot to the last three numbers.the pictures show what I expect as a result:what I have:Thanks in advance :)

128

3 years ago

clangContributor

asked in Transformers

Repair ESRI Geometry errors

Hi, We have an FME workbench to extract features from PostGIS, run through a GeometryValidator to identify and repair features, then written to an ESRI geodatabase. However when loading features from the Geodatabase in ArcMap, some features are prevented from loading due to geometry errors, such as self intersects. Is there a way to configure FME to match the geometry validation routine performed by ESRI and if possible repair these?

511

3 years ago

aronContributor

asked in Transformers

Strategies to process huge datasets?

This is more of a hypothetical question, I don't have a problem that needs solving, but am pondering the possibilities and limits of FME.What are the strategies to process huge datasets? I would imagine that there is a limit to the resource management that FME can do on its own? At some point the software might need some "help" in order to break down the data in manageable chunks? How is this done? Tiling? Memory management? Renting a super computer? Etc?Trying to think of an example I came up with the following idea. How would one go about generalizing the contour lines for a whole country in one run without watching life go by? Please note that I am not asking about how to generalize, my question is what strategies there are to speed up huge processing operations similar to the example above?

2675

3 years ago

gmbutler2Contributor

asked in Transformers

How can I find duplicate lines by their geometry even if the coordinates are flipped on the duplicates.

I have a workspace where I have lines that are clearly duplicated but the matcher does not identify them because the coordinates are flipped on one versus the other. Is there a way to identify duplicate geometries for lines regardless of whether the coordinates are flipped. For example: Line 1Coordinate 0 = 1973175.975504196, 1785187.3988771015Coordinate 1 = 1973164.445329631, 1784950.337012621 Line 2Coordinate 0 = 1973164.445329631, 1784950.337012621Coordinate 1 = 1973175.975504196, 1785187.3988771015 Both lines are identical, however the direction of one is different from the other. So how can I eliminate one of these based solely on geometry.

573

3 years ago

jamal

asked in Transformers

A tool in FME to remove duplicates,

A tool in FME to remove duplicates, I couldn’t figure out which tool can remove duplicates. For example, in case we have two lines that are identical (one on top of another), then which tools can remove this duplicate? For example, in the screenshot below we have 4 lines that are identical, then how to remove three of them and to leave one? Thank you Best Jamal

53211

3 years ago

oliver.morrisContributor

asked in Transformers

Feature Reader not respecting max features to read

Hi, wondering if anyone know how to limit the featurereader, I am trying to read only the first 10 rows from each table in postgres and it is still pulling back every row before passing on only 10. What am I doing wrong? Thank you in advance

1232

3 years ago

christianlendl

asked in Transformers

How can I guarantee that the workspace runner selects the right inputs?

Dear FME community,I have a question concerning the FME workspace runner. I have a workspace with 5 different inputs. The goal is to create geospatial PDFs. Each of the inputs represents a different layer of the geospatial PDF. Now I know that the workspace runner will import the inputs once at a time. The problem is now that in the 5 input-folders have each a different number of files. This means that at the end not every PDF will have the same number of layers. How can I guarantee that the workspace runner selects the right inputs? I have named the input files exactly the same, but they are in different folders. So it would probably be easy to just compare the base names. I would be very happy, if somebody could help me with this. Thank you so much in advance! With kind regardsChristian

3 years ago

mapperContributor

asked in Transformers

Extracting attributes from HTML within KML with photos

HelloI am having trouble extracting attributes from a kml for the features that have photos.I am using XQuery similar to this example https://community.safe.com/s/question/0D54Q0000848CTkSAM/extracting-information-from-different-folders-in-kml-to-convert-to-the-shapefile That method works for the features that don't have photos but the features that have photos seem to have a extra section in the HTML that is causing my XQuery to fail. The Xquery I am using is : declare default element namespace "http://www.w3.org/1999/xhtml";for $x in /html/body/table/tr/td/table/trreturn fme:set-attribute($x/td[1]/text(),$x/td[2]/text()) I am pretty sure I just need to modify the Xquery

163

3 years ago

marcandre

asked in Transformers

Un-pyramid a tiff

Hi. Create a pyramid. Easy.How I could extract only the most dense level without processing all others levels?

122

3 years ago

kweatherby

asked in Transformers

I'm losing the unique ID's of features when using Dissolver, which is problematic for the features that have multi-part geometries, because I'm unable to aggregate back the multi-part features based on this unique ID. How could I overcome this issue?

The features are a subset of US Census tracts, and a handful of them have multi-part geometries that do not share a boundary. My goal is to treat these multi-part geometries as a single unit based on the unique ID (FIPS code) for each tract.

3 years ago

lindsayContributor

asked in Transformers

Best method to resample, mosaic, and then tile large amount of raster files?

Hi,The problem I'm trying to solve is as follows:I have about 2,000 aerial imagery ECW files, averaging in size around 30MB (so around 60GB in total).Each of the files cover 1km x 1km on the ground at a resolution of 10cm, so are 10,000px x 10,000px.I have been asked to downsample each file to 2,048px x 2,048px and output the results as a series of 4km x 4km tiles (each tile being 8,192px x 8,192px).I have an index feature class that lists each 'FileName' and its corresponding 'Tile' attribute.I've attached an image that shows this spatially, below.Large black squares and number labels represent the tiles that I want to output. The coloured squares with red outlines represent the original files.Previously, when working with a much smaller amount of data, I've been able to use my index feature class, in conjunction with a StringConcatenater, to provide the full path of each file to an 'ER Mapper ECW' FeatureReader.From there, I used RasterResampler an

1236

3 years ago

lorindaParticipant

asked in Transformers

Workspace runs with service account in Desktop but not completely in FME Server

Have two workspaces that when I run it under my account or the service account on the server, it runs fine, published to FME Server and set up automation. It APPEARS to run (one workspace checks for the latest zip file in a directory on a file share and then copies to the resources directory and unzips on the server - this works as it should under both accounts and in FME server when run separately thru Run Workspace). The second workspace is to process the data that was unzipped and place in the resources directory - the files are separated into two directories due to how the vendor supplies the data for download - the script will read this data via either account. It will operate as expected when run with Workbench. Running via Server it processes, but when I look at the output data, not all of it is there! The csv files appear to be appending to the tables in the SDE. The graphic data doesn't even show that it attempted to write to the feature class. I'm stumped. The graph

232

3 years ago

ikubra800

asked in Transformers

How can I get parent_id in xml for creating database tables ? (I used FeatureReader,XMLFragmenter and etc. but I cannot get xml_parent_id)

3 years ago

birgitEnthusiast

asked in Transformers

Autodesk BIM360 Docs Connector transformer cannot download file to a location specified in a feature attribute value

Hi everyone, I am trying to download a set of files with the AutodeskBIM360DocsConnector and save them to a temporary location. The temp location is generated with the TempPathCreator. The BIM 360 connector does not have the option to pick an attribute for the "Download to Folder" parameter. Typing out @Value(DownloadLocation) seems to trigger FME to recognize that I want to use an attribute value, however during translation the attribute value is ignored and instead FME uses the string I typed in i.e. it creates a map named "@Value(DownloadFolder)".

225

3 years ago

lidiad

asked in Transformers

String Replacer - find symbol or letter or number followed by Capital Letter and insert a space

I have text where spaces between some words is missing. These spots are easy to find with regex because it is always something following by capital letter without the space. I can't workout how to add the space though. My String Replacer looks like this: @ReplaceRegEx(@Value(Speciality),([^ ])([A-Z]), \\1, \\2) The output it produces is:Anxiety, Panic & Phobia shildren & Adolescent selationships Outside work (ndividual counselling )eadership Original:Anxiety, Panic & PhobiasChildren & AdolescentsRelationships Outside work (Individual counselling)Leadership So it adds space, just not where I need it and removes the capital letter. I tried many variations, but none of them produces the needed outcome.

394

3 years ago

sgsc

asked in Transformers

Is there a way to gracefully terminate a looping Custom Transformer?

My flow includes a looping Custom Transformer that gets records from a paginated API until there are no records left to get - unfortunately the API doesn't have a "last page" flag or anything, so the only way to check that the flow should end is to keep trying until we get a 400 Bad Request status code with a message like "Request out of range". When this happens, the loop should break and output all the features that have been created up to that point. At the moment, the only way I can get this to break is with a Terminator, which is (a) making the flow look like it failed, and (b) not allowing me to continue with the next steps of generating a HTML report. Is there a more graceful way to exit a loop? The transformer looks like this:The relevant part in the flow itself looks like this. The Tester is doing exactly what it's supposed to, but it doesn't seem to be reaching the HTMLReportGenerator.

585

3 years ago

Page 137 / 508

Badge winners

canerakinhas earned the badge Welcome Back
mmestrovhas earned the badge Welcome Back
alena_thas earned the badge English Speaker
alena_thas earned the badge Welcome Back
khadijahbhas earned the badge Webinar Watcher (Grey)

Show all badges

30,176: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.