- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,750 Posts
50,996 Replies

When you subscribe we will email you when there is a new topic in this category

12750 Posts

asked in Transformers

Formatting of FileProperties DateTime

Hi,I've got a formatting problem with dateTime that comes with the FileProperty-Reader (as part of Workspace-Reader). The dateTime is not formatted like YYYYMMDDHHMMSS as expected. If month, days, hours, minutes or seconds are just one digit, there is no leading zero. So it displays something like '20171127135' which could be 12th of January 7:13 am and 5 seconds or maybe 27th of November?I'm using 2016.1 and can't check this on later versions so far. Are there ways to get this issue handled or is it an early version bug?Thanks in advance,Maik

7 years ago

jasonberneathy

asked in Transformers

How to pull the table data from nextgenstats.nfl.com?

So I am having some issue's in pulling the table data from www.nextgenstats.nfl.com. I have tried the HTMLTable reader, and I keep receiving an error message when trying to connect to it. Any suggestions would be great!

180

7 years ago

saqibamin

asked in Transformers

Duplicate values in string

I have the following string with duplicate values "Lighting; Lighting; Roads; Streets; Roads; " inside an attribute. I know there isn't a transformer to handle this apart from the StringElementDuplicateRemover custom transformer, is there another simpler solution to this?

620

7 years ago

kieranodonnell

asked in Transformers

Removing Duplicates in a table from Multiple Fields

I'm working on removing duplicates in a list, but need to filter this based on multiple fields. I can remove duplicates with only one field easily, but am having trouble where it relies on multiple fields. Scenario: Where a Business has the same name/address duplicates need to be removed. However if a Business has the same name, but a different address, I want it kept in the list. Example: Name Address Action McDonalds 123 Brown Street - Keep McDonalds 123 Brown Street - Remove McDonalds 999 South Road - Keep Burger King 999 South Road - Keep Where I'm at now all I can output is: McDonalds 123 Brown Street Burger King 999 Sourh Road My actual list has about 15,000 records. Any help would be much appreciated.

950

7 years ago

fmelizardContributor

asked in Transformers

Publish workflows from GitHub to FME Server?

A friend wants to know if we can publish workflows from GitHub to FME Server?

230

7 years ago

shefqetlulja

asked in Transformers

Merge DWGs to 1DWG and put all objects to one new layer named as the original filename

I have 1000 dwg that has text and lines on 2 layer, i want to merge them all in one dwg and the final dwg should have as layer names all the filename and all the objects (text,lines) should be in only one layer which is the filename the come from.e.g t1.dwg, t2.dwg... -> merge.dwg (with two layer t1,t2...) every object from t1.dwg should be inside t1 layer in the merged dwg, same with the object from t2.dwg should be all inside t2 layer on the merged dwg, and so one for all the dwgs used as input.

3490

7 years ago

rkay

asked in Transformers

Add zip file size to data download notication email

Hi all I'm trying to add the zip file size to the data download service notification email. This is the method I'm using: Workspace writes the data to be downloaded and a json file containing the information elements I will use in the email.Python shutdown script gets the zip file size from the zip file and appends a 'zip_size' element to the json (this doesn't work)workspace published as a data download service with its own success topic and publisher. The publisher is set to access the info in the modified json file (set as 'Data to Post') when workspace published (this doesn't work) I'm not sure if this is possible. Can anyone suggest any alternatives or ideas? This is my python shutdown script import os import json import fme def sizeof_fmt(num, suffix='B'): for unit in ['','K','M','G','T','P','E','Z']: print "unit: {0} number: {1}".format(unit, num) if abs(num) < 1024.0: return "{number:.{digits}f} {u}{suff}".format(number=num, digits=1, u

154

7 years ago

bhampton

asked in Transformers

Corruption detected Clipper

Hi all!After upgrading Clipper program I cannot open DBF format file.The error message: 'Corruption detected Clipper'. I tried to search from google but no answer.What's the problem? What should I do?

110

7 years ago

sharynrichardso

asked in Transformers

Can anyone please give me some direction on converting MITab to GTFS and ensuring the spatial objects are correctly represented?

7 years ago

krda123

asked in Transformers

Transforming donut polygon to GML

Hi,How do I transform donut polygons with a variable amount of holes from ESRI database to GML?So far I have only succeeded in transforming one hole per polygon. Below is the code inside my XMLTemplater transformer. <hy-p:geometry> <gml:Polygon gml:id="id{fme:get-attribute("OBJECTID")}"> <gml:exterior> <gml:LinearRing> <gml:coordinates>{fme:get-attribute("_coord_outer")}</gml:coordinates> </gml:LinearRing> </gml:exterior> <gml:interior> <gml:LinearRing> <gml:coordinates>{fme:get-attribute("_coord_hole")}</gml:coordinates> </gml:LinearRing> </gml:interior> </gml:Polygon> </hy-p:geometry>Kind regardsKristina Danielsson

250

7 years ago

timboberooskyContributor

asked in Transformers

StringReplacer - Regex on json formatted text

Hello,I am trying to modify the contents of a series of json files, though I only need to remove all of the leading text before the "{"rings"" text. I will have upwards of 130 files to go through, and each has slightly different text to remove. I was thinking of using a StringReplacer to find all the text that I want to remove, then just set the "Replacement Text" to nothing. I'm assuming I need to use regex in the StringReplcaer to identify the series of text in each file that I need to remove. The example of text that I need to remove is:{"displayFieldName":"","fieldAliases":{"OPS_AREA":"OPS_AREA","OBJECTID":"OBJECTID"},"geometryType":"esriGeometryPolygon","spatialReference":{"wkid":102100,"latestWkid":3857},"fields":[{"name":"OPS_AREA","type":"esriFieldTypeString","alias":

7 years ago

jaroContributor

asked in Transformers

Sketchup Length Units

Hi people,would anyone suggest how to output sketchup file with correct length units?I recently managed to handle layers with the parameter "sketchup_layer_name". However, any model i produce has inches set as length units. I need to change it to meters.Is there a similar parameter, such as "sketchup_length_unit" ?Thanks,Jaro

300

7 years ago

jeff_o

asked in Transformers

Overlapping polygons and latest date filter.

I have a dataset of state pesticide permit polygons. Each polygon is identified by a permit number and site id plus there are attributes for effective date and expiration date. In many cases the polygons overlap in one of three ways:1. Edge overlaps where imprecise drawing causes overlaps.2. Polygons are designed to represent the same area. Sometimes these are drawn slightly differently so they are not exact matches3. The same area is divided into different numbers of polygons at different times.What I need to do is take overlap cases 2 & 3 and keep the overlapping polygon with the most recent effective date.

260

7 years ago

westdakota

asked in Transformers

System Caller not working vis-à-vis Terminal

I'm trying to use SystemCaller to run Tesseract (a command-line OCR engine) on my Mac. While the following command line works in Terminal directly, it fails from the SystemCaller:tesseract /Users/westdakota/Documents/Coding_Projects/LSAT_Vocab/Output.png /Users/westdakota/Documents/Coding_Projects/LSAT_Vocab/words (This is all one line; no carriage return. The first path -- despite the name -- is the input file path: a file that was created by the previous step in my workflow, the FeatureWriter; the second is the output file path: the text file of words OCR'd by Tesseract.) Until now, I've only ever used SystemCaller on a Windows machine. Is there anything different I need to know when using it with a Mac?

230

7 years ago

anilkb1105

asked in Transformers

POINT FEATURE CLASS-SYMBOLOGY

Hi @mark_1spatialI'm in process of transforming the oracle Spatial data to Autocad.dwg format by creating the FME 2016 workbench(fmw), i'll need to create/define my own symbology/block for a particular POINT feature class(which is not available in my existing Template.dwg), is there any option in FME that we can create/define our own symbology/block for a point feature class that needs to be displayed in the .DWG output file. Any help would be appreciated.

130

7 years ago

dagw

asked in Transformers

Run dissolver on surface in 3D

I have a collection of surfacess that want to run a Dissolver on. The problem is that while all the surfaces are planar, they are in 3D-space and aren't necessarily parallel to the XY-plane. Dissolver seems to only work with 2D surfaces. Any ideas? Thanks Dag

180

7 years ago

ottadini

asked in Transformers

What does this mean in detail? "A spiral or curve geom has been dropped"

I have a LandXML file that contains clothoids, i.e. spiral geometries. When I inspect the file, I get warnings like this:The Coord child element is not currently supported. FME Currently only supports Chain, Line, and IrregularLine. A Spiral or Curve geometry has been droppedWhat does "dropped" actually mean? The geometries are in fact aggregates of straight line segments and curves (road and rail designs). Some are simple (radial) curves, and some are clothoids (spirals). There seem to be small gaps in the geometries in the data inspector viewer.

120

7 years ago

Anonymous

asked in Transformers

Attribute Hider

Does FME have a transformer for "hiding", as opposed to "removing" an attribute? I am using the FeatureReader to dynamically read a feature class that is specified by parameter. This script is then called for many feature classes. The attributes of any one feature class are thus not exposed.However, for some features I need to access the ID field of the feature class, for example, "FID". I do this by an AttributeExposer in a custom transformer that is only called for a particular feature class. But I don't want the ID field to carry on as an attribute when it is time to write the feature class to the output table. It would be great if I could then "un-expose", or "hide" the attribute, back to the level of visibility it had when I used the feature reader. Is it possible?

1150

7 years ago

lazarlubomirContributor

asked in Transformers

XML Templater: how to put list values into one attribute

Hello,is anybody here, who could help me with XML creating please?What I have to solve: I have one feature with list of references to another features. I need to create XML record which contains all of these references and also keeps number of reference in Index. Example is below:I know that I have to use XMLTemplater, I am able to create schema, but I cant identify, how to figure out list values behaviour and also how to insert into index parameter sequenced value from list.Thank You so much!Lubo

252

7 years ago

mb_fdfa

asked in Transformers

Identifying shelters/tents from satellite imagery

As part of our role in providing humanitarian aid, we need to identify potentially thousands of shelters/tents in refugee camps with ghe aid of current satellite imagery (in the future possibly from drone imagery). It would be sufficient to identify their existence and capture a point feature - perimeter would be a bonus but not absolutely necessary at the moment. Doing verification on automatically generated output would be much faster than the current options of manually digitising elements or field data capture.Is there anyone who has experience in something comparable? I have virtually no experience with raster data, so thought I'd see if anyone in the FME Community has any inputs/thoughts on this.Thanks in advance.

7 years ago

philippebEnthusiast

asked in Transformers

What is Dale's homepage?

I had the chance to assist a Dale's presentation recently and I noticed his homepage on his MacBook's browser.Do you know what he's using when he opens a new tab? It is not Google nor Safe, I can tell you this!Thanks!

7 years ago

chriswilsonSupporter

asked in Transformers

XMLTemplater with subtemplate not retaining nesting correctly

I have the following root template in an XMLTemplater:Where {fme:process-features("FEATURE_CLASSES") occurs I want to insert the following subtemplate within the sequence elements, grouped by an attribute so that it repeats according to how many feature classes I have:The result, however, loses the nesting and leaves elements retreating to the root element level - the subtemplates start inserting at row 6 with the first element showing in the correct position:What can I do to avoid this, or is it just a case of using a separate templater for the subtypes and then appending them into the root in an XMLAppender?

140

7 years ago

dmatranga

asked in Transformers

Finding gaps in time series

Can anyone suggest a way to use FME to find gaps in a daily time series?I'm looking to generate a report for missing days of data in an effort to QC a dataset and know there must be a way to do this, right?

1144

7 years ago

1011analyst

asked in Transformers

Removing parts of a string with the Attributetrimmer?

Hello FME users, I need to trim parts of a string and have been using the Attribute Trimmer's ReplaceRegEx function. I noticed however that while some fields are trimmed correctly while other's aren't. I have not be able to find a patter or correlation between the length or type of string that isn't trimmed perfectly vs. the ones that are. It looks like this:@ReplaceRegEx(<|| Toronto>,<|| Scarborough>,<|| Scarborough|| Toronto>,<|| East York>,<|| North York>,<|| York>,<|| Etobicoke>)The result:Notice how || Etobicoke is still there. I have tried different Attribute trimmer functions like ReplaceString or TrimLeft and the part I want to keep is sometimes trimmed off.Would you have any suggestions for a more effective method or this just a bug?Thanks in advance,

159313

7 years ago

fmeuser_gcContributor

asked in Transformers

Handling of intersecting/overlapped polygons

I'm trying to edit my workspace to handle the ovevrlapped polygons on the boundaries.How can I remove overlaps?Here I isolated a location. Dues to overlaps this location is falling under both the polygons. The boundaries on both sides of location are opposite boundaries of overlapped polygons. In other words, boundary shown on right would also be part of left polygon.Please note that this happens only when I write to Netezza.

1180

7 years ago

Page 365 / 510

Badge winners

aawad.93has earned the badge Teacher (Grey)
aawad.93has earned the badge Student (Grey)
aawad.93has earned the badge Arabic Speaker
aawad.93has earned the badge English Speaker
aawad.93has earned the badge French Speaker

Show all badges

30,457: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.