- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,739 Posts
50,959 Replies

When you subscribe we will email you when there is a new topic in this category

12739 Posts

asked in Transformers

issue with converting points to polygon

Hi There, I have a set of points that make up an area of interest. I am trying to create a polygon using the points, using Linebuilder & LineCloser. It does create the polygon but it's not what I was expecting. I am looking for some feedback on how to resolve this. Thanks Jay

690

7 years ago

cliff_wade

asked in Transformers

Testing dataset quality

Hello, I have a query please. The attached table is a snapshot (fictional names etc used) of an Excel dataset of 10000 records, where employees of a company are each given a Card to access the office building, and this dataset logs their details each time they have entered the building, by swiping their card at the entrance door, in the past week.In the ideal world, every employee should have a unique "Employee Number" and also a unique "Card Number." So in this example, John Smith should have an "Employee Number" of 100, and a "Card Number" of 1. However, we can see that he also has a "Card Number" of 2 on two occasions he has entered the building, for whatever reason.Also, we can see that for Sarah Brown, her "Card Number" should indeed be 5, but for some reason, she has two "Employee Numbers" (400 and 500) when in fact she should just have one "Employee Number" of 400.What is the best way, using FME, tha

140

7 years ago

abbas_lokat

asked in Transformers

Lines that exist outside a polygon

I have a file of 100+ polygons and need to find lines that exist outside of the polygon based on a join condition that links the line to the polygon.ie find me the lines in file x that exist outside of a polygon where line.shape not in/not entirely within polygon.shape and line.auth = polygon.authI'm a new FME user - I've experimented with both the spatial relator and the spatial filter. I don't know if I'm just using them incorrectly! any help appreciated!ThanksBaz

480

7 years ago

redgeographicsCelebrity

asked in Transformers

Combine ideas

These two ideas seem to be similar, can they be combined?https://knowledge.safe.com/idea/48591/save-feature-count.htmlhttps://knowledge.safe.com/idea/48474/save-number-of-records-that-went-through-each-port.html

100

7 years ago

harrygibson

asked in Transformers

RCaller timeout error

I'm using an RCaller within a workbench that's processing some reasonably large datasets. The R script I'm using works fine in R itself, and the workbench runs perfectly with a smaller test dataset. However with a full-size dataset I get the following error, approximately 30 seconds after the last feature enters the RCaller and the rscript.exe processes begin:RCaller(InlineQueryFactory): InlineQueryFactory encountered an error when starting R interpreter. Message was: Process operation timed outRunning with the same size dataset in RGui or RStudio, the processing I'm doing takes approximately 10 minutes. However the processing is by group and so I use the ddply package in parallel mode to split the processing across 10 cores, making the process take approximately 1 minute.I've transferred this over to the RCaller in FME, and it starts the 10 processes, but still times out after about 30 seconds. How can I use the RCaller to do work that takes more than 30 seconds to produce an output?

140

7 years ago

tim_woodContributor

asked in Transformers

SQLExecutor - how to update multiple SQL Server columns in one query?

FME 2017.0.1.1 (17291) 64-bit on Windows Server 2008 connecting to SQL Server 2012 on Windows Server 2012.MS SQL Server supports this type of update statement:update db.owner.mytableset field1 = ABC, field2 = XYZwhere primkey = 123I want to do the same thing with SQLExecutor thus:update db.owner.mytableset field1 = @Value(fieldA), field2 = @Value(fieldB)where primkey = @Value(uniqueid)However when I put this into the SQL Statement parameter, the cog on the transformer goes red i.e. something is wrong, but nothing is highlighted red in the transformer properties. Is this an FME bug, or do I need to write it differently?

11816

7 years ago

hahyun6911

asked in Transformers

Difference between LL83 and LL-83

Hello Everyone,I have a very simple question regarding Coordinate Systems. I found out there were "LL83" and "LL-83" which looked pretty much same.Do you guys know what is the major difference between those two systems?Thank you!Sean

823

7 years ago

chriswilsonSupporter

asked in Transformers

Scanning an uploaded zip and subfolders for geodatabases on FME Server

I have been using FME server to run a workspace that reads an uploaded zip containing - a couple of directories down - a single geodatabase. The zip is uploaded via a published parameter. I now need the uploaded zip to be scanned for multiple geodatabases and for all of those to be read. Additionally the geodatabases are now a couple of extra subdirectories down and the zip is now large (130mb). The desktop solution would be something like this:C:\\Folder\\Subfolder1\\Subfolder2\\Subfolder3\\temp.zip\\**\\*.gdbAs the workspace on FME Server will require an uploaded zip it will not be reading from a network drive so the published parameter by default is blank. How do I ensure that the zip will be scanned on the server for folders and subfolders, and any geodatabase within that read?I did try uploading the new zip with multiple geodatabases via the original published parameter, with the error message causing a subsequent process failure being:Unable to connect to the File Geodatabase

710

7 years ago

stian

asked in Transformers

Reprojection from EPSG:3413 - NSIDC Polar/WGS 84 to 3575

Cheers! I'm having a hard time trying to reproject som Icedata from NSDIC using FME. The data is shifted a bit too far south as the following discussion thread also seems to end with: https://groups.google.com/forum/#!msg/fmetalk/ekh0-juHPiM/8I5UqSzq0nIJ I tried the same suggestions and so far seeing exactly the same issue as Karl did. I really would appreciate any help on this matter in order to get my workspace done. Reprojection seems to be ok using Arc Toolbox BTW! Regards Stian

163

7 years ago

koo9

asked in Transformers

Adding dynamic business rules for GIS data validation

new to the platform but got a question on how to dynamically add business rules to the existing workspace from an external source e.g. web app (since the rules is managed in the web app). assuming the integration is through FME REST servicce.

7 years ago

phatnine

asked in Transformers

Odata limitations

Hi guys,I'm using FME desktop 2016 to make call to SAP using the Odata reader. As of now, I cannot connect properly, but using Microsoft Excel, I can connect without any problem to SAP with Odata.There is no geometry involved, I just want to fetch financial data and upload it to a datawarehouse.What I am suppose to enter in the feed parameter? Can I put SELECT parameters in the URL?What are the limitations for Odata reader?Thank you!

480

7 years ago

guidos

asked in Transformers

Can snap to grid work all the time?

I am using the snap to grid function and it doesn't work sometimes depending on the connection lines location. My workaround is to find a place where it does snap to grid then create an anno and snap the anno to grid near the transformer. I then select both and drag them to the place where the snap to grid wasn't working before.

370

7 years ago

fmaas90

asked in Transformers

Problems by choosing a different Python interpreter

I have the following problem: In my FME workbench I need Python and additional Python modules. Because a few of them cannot be installed with fme easy_install and the FME python interpreter does not accept modules which are manually installed I decided to install Python 2.7 indepently from FME and use its python interpreter. So I installed Python, installed the modules, tested it in the shell by importing the modules and it worked. Then I followed the instruction on https://knowledge.safe.com/articles/814/choosing-a-different-python-interpreter-installati.html and chose the python27.dll instead of the standarized fme python.dll. After that also I tested to import the modules in FME by scripting a Startup Python script but here it says that the modules could not be found. What could be the problem?

725

7 years ago

chris_fc

asked in Transformers

Error using RasterMosaicker

When running RasterMosaicker I get the following error message ESRIASCIIGRID writer: Failed to get tile of size 1 rows by 500 columns at row 4999, column 0. I'm trying to mosaic ESR AsciiGrid files. Can anyone advise please?Chris

110

7 years ago

tim_woodContributor

asked in Transformers

SQL Server update table to replace empty string with null taking forever

Hello.I'm using FME 2017.0.1.1 (17291) 64-bit on Windows Server 2008 connecting to SQL Server 2012 on Windows Server 2012.I'm reading an SQL Server table of 3.7 million records with about 80 fields and writing back to it using fme_db_operation to update about 70 of those fields after using NullAttributeMapper to replace empty strings with null. It's been going for 16 hours and has not even done 1 million records.Is this the sort of timings I should be expecting or is there something I can do to improve things?Features per transaction on the Writer is 500.

3178

7 years ago

sanjay

asked in Transformers

Variable JPEG2000 values after clipping

Hello,I am aware that JPEG2000 is not the most ideal format for images if one wants to preserve quality but I don't have a choice of other formats in the external files I have to work with.Anyway, I would like to clip these external JPEG2000 files using clipper polygons and save the output as JPEG2000. At the same time I would like to avoid a change in the original-to-clipped raster pixel values unless they are on edges of the clipper polygons. So, I have set the compression in writer to 0 but still, for some reasons, the clipped raster values are quite different to the original raster values. Would I be correct in thinking that given the choice of image output format, it may not be possible to preserve original raster values? Any ideas please..Thanks,S.

100

7 years ago

robbie_botha

asked in Transformers

Subtracting two unknown values from each other

Hello there,I'm having a difficult time with subtracting two unknown measurements of line features with each other.In short, I'm calculating the lengths of two overlaying features (lay1 and Lay2), and I want to check for all values that when subtracted from each other, is smaller than 5.Everything is working perfectly, except where I'm stuck, is in a tester transformer where I added the following (seemingly incorrect) info in:@Value(Lay1_Length)-@Value(Lay2-Length) > 5Is there a different way I should create this expression?Kind Regards,

390

7 years ago

sofiaContributor

asked in Transformers

Finding gaps in a polygon layer - help needed to create basic translation

Hi!I need help creating a basic translation for identifying and writing to shapefile the gaps between polygons on one layer. I don't know how to begin!I really appriciate some tips on what transformers to use and how to configure them too look for the gaps that are millimeters in size. I dont need the translation to repair the gaps, I just want to find them to investigate myself.

980

7 years ago

mayermart

asked in Transformers

FME Server: Set Default for TM_Priority

Hello,Is it possible to set a default value for the Parameter TM_PRIORITY?Thanks in advance

7 years ago

jakobr

asked in Transformers

Imap publisher heap space problem

I use imap to access an e-mail account and run translations based on the attached files. The process seems to run out of memory frequently causing the following information in the log:INFORM Thread-111 Publisher_imap Exception in thread "received-mail" java.lang.OutOfMemoryError: Java heap spaceIs this a known issue and how can it be fixed? The attached files which are to be processed can reach up to 5-6MB.

7 years ago

ddblehm

asked in Transformers

Converting the first vertex of polyline lines to points with starting line angle

I need to extract the starting vertex only and the line direction (angle). The polylines also have arcs in them but I only need the first vertex and starting line angle in the output. I will use this information to insert an arrow head pointing at the point with the back of the arrow or wide end in-line with the polyline. My source data is in a ARCGIS application with a SQL database and I’m converting that information into AutoCAD. So, the arrow head will be a block pointing at the first vertex with the back end in-line with the polyline. Basically, I need to insert flow arrows but in CAD. I can do it in ARCGIS without any issues but I need to get the same symbology into plain cad without a geometric network defined. I tried several transformers i.e. the chopper but it converts arc’s into line segments and inserts multiple points. Any help would be greatly appreciated. Example of the finial output attached.

1390

7 years ago

asked in Transformers

Splitting Linear Referencing Segment and assign a Value to First Segment

I am new to FME, and I am trying to set up a workflow to transform some LRS segment feature data using the following rule: Assume that each feature segment has route identifier, begin and end measure, and a "split key" which is a value that indicates a percentage of the total segment length that I should split the event in TWO. I think this can be done with the Clipper transformer. In addition however, I have another requirement where when I split the event into 2, I need to add a new value to the first segment only. This is what is tripping me up. After splitting the segment, how do I identify the first of the 2 splits and add the value. If my explanation is not clear enough, see the following example dataINPUT: Given the following example Event Segments: ROUTE_IDBEGIN_MEASUREEND_MEASURESPLIT_KEYR1 0520%R23950%R2912100% OUTPUT: ROUTE_IDBEGIN_MEASUREEND_MEASURENEW_ATTRR101AR115nullR236AR2612nullR2912A Note that in the last segment, a split of 100% yields the same segmen

234

7 years ago

rick_williams

asked in Transformers

Has anyone else experienced an issue writing a Date field to Excel?

I have an issue that occurs in ALL of my workflows. Randomly, the first row of data written to Excel defaults to a data type of General and therefore date fields end up in the Excel data format of floating point. Every row thereafter is formatted, correctly, as a date (Custom data type). Example:All first row date field(s) format: 41787All rows after the first row format: Jan 09, 2017Is there a fix/reason this is happening? This is not a new issue. it's been happening since FME 2016.

300

7 years ago

arthyContributor

asked in Transformers

how to assign NULL (or MISSING) values inside a python caller?

Hi,I would like to know how to assign an attribute value NULL using python? I'm aware of the nullattributemapper transformer to do that but I would like to add this inside a python script.Thanks

1750

7 years ago

philippe33

asked in Transformers

XML Text to split into a list

Hi,I have a XML Templater i filled with data to match a structured record and i obtain this: <aixm:annotation xmlns:aixm="http://www.aixm.aero/schema/5.1"> <aixm:Note xmlns:gml="http://www.opengis.net/gml/3.2" gml:id="nresp_1520862_0"> <aixm:purpose>DESCRIPTION</aixm:purpose> <aixm:translatedNote> <aixm:LinguisticNote gml:id="lnresp_1520862_0"> <aixm:note>Site description: 10 km Ouest de Bordeaux\\\\10 km West of Bordeaux</aixm:note> </aixm:LinguisticNote> </aixm:translatedNote> </aixm:Note> </aixm:annotation><aixm:annotation xmlns:aixm="http://www.aixm.aero/schema/5.1"> <aixm:Note xmlns:gml="http://www.opengis.net/gml/3.2" gml:id="noresp_1520862_0"> <aixm:purpose>DESCRIPTION</aixm:purpose> <aixm:translatedNote> <aixm:Linguistic

106

7 years ago

Page 386 / 510

Badge winners

followersindiahas earned the badge English Speaker
james_c_452has earned the badge Webinar Watcher (Bronze)
vidhyarhas earned the badge Integrate Spatial Data
boostpadhas earned the badge FME Flow Authoring Training
sam_keasthas earned the badge English Speaker

Show all badges

30,425: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.