- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,677 Posts
50,715 Replies

When you subscribe we will email you when there is a new topic in this category

12677 Posts

Recently active

Most replies Most views Newest first

reservoirdogSupporter

asked in Transformers

XMLtermplater vs. XSD-driven and a little problem

I need to export data of an oracle database to XML, it’s data from an electricity network, so not highly structured or nested.I created a workbench using the xml-templater and got some results, so far so good.Are there any limitations using the XMLtemplater compared to the XSD-driven Writer?I don’t want to create the whole export and realize later, that I would have better chosen the XSD-driven Writer for XML.Also a little problem with XML templater:I created an Attribute Value using Attribute Manager, a simple number “0.4”.When I write this value using the XMLtemplater it gets written as “0.40000000000002” to the Textfile.What am I doing wrong?

886

28 days ago

chansoo.byeonObserver

asked in Transformers

How to create 3D multipatch layer from 3D polygon layer with FME

is it possible to automate my 2D to 3D workflow in ArcGIS Pro in FME? here is the process: 2D polygon layer with a height field → extrusion in ArcGIS Pro → “Layer 3D to Feature Class” Geoprocessing. Here, I group it based on a field so multiple polygons will be merged into a 3D multipatch. → then use this multipatch layer on top of the 3D AGOL terrain layer so they appear good on a 3D scene in AGOL.Does FME have a transformer & writer to automate this workflow? Thanks!

391

29 days ago

vxn43Supporter

asked in Transformers

ChangeDetector how to question

I have two spreadsheets. One is the original data; the other is data that has changed. The schemas are the same. The spreadsheet with the changes has 3 records. I need to add these 3 records into the original data (while deleting the original 3 records in the original data), thus updating the records in the original. What is the best way to do this using ChangeDetector?Currently, when I use ChangeDetector, the records from the changes spreadsheet are output to Inserted; The records from the original spreadsheet are output to Deleted. Deleted includes the 3 unchanged records that are in changes spreadsheet. In the screenshot below the 95,392 in Deleted include the unchanged records that are in Changes. The transformer outputs the Original and Revised separately with no way for me to delete the 3 records in 95,392 and add the 3 changed records?

371

29 days ago

tvaContributor

asked in Transformers

Http caller: multi threaded with looping and authentication

322

29 days ago

liz.gParticipant

asked in Transformers

AttributeManager - Remove Attribute

Hi All,I have recently upgraded from 2022 to 2024. Previously, when choosing to remove an attribute from within the AttributeManager transformer, the name of the attribute was removed from the ‘output Attribute’ column. This was very handy as it gave a good visual prompt for how the new dataset would appear. Example shown in the screenshot below:I now notice with the new version that the name is no longer removed and stays visible in the Output Attribute column. Example shown below:Does anyone know if this is this something that can be changed in a setting somewhere? I know this is only a small thing but it made a big difference to my day lol :D Thanks!

853

29 days ago

aronContributor

asked in Transformers

Change both the attribute and corresponding values from an external lookup table?

Working with crossborder maps that get their data from two different datasets. There are many ways to approach this, and I am toying with the idea to convert the attributes and their values from dataset A to the standard of dataset B. The benefit would be easier downstream processing. A simple example:Dataset A: attribute ‘Lakes’, value ‘yes’Dataset B: attribute ‘water’, value ‘1’Then do some FME-magic to convert everything from A to the standard of B, ie ‘lakes’ → ‘water’ and ‘yes’ → ‘1’I imagine that the only reasonably fast way to set this up would be by utilizing an external lookup table, csv or similar. How would one go about to change both the attribute and values from an external lookup table? I would like to keep it dynamic and easily editable, so preferably avoiding the AttributeValueMapper.

353

30 days ago

rzel24Contributor

asked in Transformers

Unable to Connect to BigQuery

Hello,I was wondering if someone here could give some guidance to a problem we are experiencing.We our trying to connect FME to BigQuery but regardless if it is the reader or writer we are unable to connect using Web Connection.For the Web Connection settings we use or own accounts which have access to BigQuery. In fact when we connect directly to BigQuery we are able to see the project, datasets and tables and we are able to run queries on them.But when trying to establish the connection from FME using Web Connection we get the following error: BigQuery Connection ErrorAny help on how to solve the issue or to even find out what exactly is wrong would be appreciated.Thanks in advance.RZ.-

352

30 days ago

ldreyfussContributor

asked in Transformers

Is there a transformer that filters or joins or tests based on all items in a list?

I have a table of data that I’m trying to map. The locations are essentially polygons with their bounding streets entered as attributes:I have street data and have been able to create polygons using AreaBuilder, but am stuck on trying to add all of the streets back as searchable/joinable attributes rather than items in a list.I’ve tried the ListExploder and gotten a stack of polygons, each one with one street’s attributes, but I aggregating isn’t quite getting me the results I’d expect. In a perfect world, I’d be able to run FeatureJoiner or something similar on every item in the list, but it only seems to allow one.Any advice is very much appreciated!

343

30 days ago

salah.elfarissiContributor

asked in Transformers

PythonCaller Log does not show error line number (FME(R) 2024.1.1.0 (20240729 - Build 24619 - WIN64)

When python caller errors out.It does not show error line number. Message Type: fme::internal::_v0::py::ExceptionPython Exception <GEOSException>: LocateFailureException: Could not locate vertex.🟢06-Report (PythonFactory): PythonFactory failed to close properly

808

30 days ago

p_c_20Contributor

asked in Transformers

Hull Accumulator - what decision making is it doing?

I’m looking at an area of survey points that can be divided into east and west areas by grouping with an attribute value. I have used Hull Accumulator to draw polygons around a) the whole area (light purple) and b) the two subdivisions (darker purple). The point population remains the same overall, but I get different external boundaries in places, when I was expecting the same. Alpha = 0. What would be useful is any description about how the transformer makes its drawing choices. I also end up with a donut hole. Again, am trying to understand how this occurs, as I assumed the transformer would create an external boundary only.Many thanks

463

1 month ago

pknoContributor

asked in Transformers

String Pair Replacer inner workings

Helly everyone,I am working with data that consists of abrreviations/code items that are strung together in a single field which I am trying to convert to full text. For that I am using a string pair replacer which contains thousands of mapping pairs, but I have encountered a problem which I can’t seem to solve without knowing how exactly the String Pair replacer does its thing. The problem arises when multiple codes share letters. Here`s an example: I have the following pairs somewhere in my replacement pair string**gn green**bn browng gravelF mudSo F:**bn**gn should map to Mud:browngreen but whats happening is this: M:brown**gravelr.I figured that the transformer probably checks its list from start to finish and ordered my list by string length in hopes it would transform longer strings first. The order of replacement items definetely has a big impact on the result and I was succesful of ironing out most errors in doing that but this particular translation and a few others still dont

401

1 month ago

llin

asked in Transformers

DGN Custom Line Style

Started this this help article which is written for V8i and not CONNECT but believe I've added the line styles to the seed. Drew lines set to the appropriate layer and the line styles are correct. Seed is in a ProjectWise workspace and exported for use with FME:Workbench clip:DGN Styler configuration:DGN writer:Translated DGN shows the correct line style in properties but not in the display:Re-importing line styles warns of duplicates:But afterwards the line style is correct:

1043

1 month ago

jaosakkeimrObserver

asked in Transformers

Creating new points/nodes along a line that bends.

So, in the context of pipelines we run camera inspections registering different damages and features along the pipeline. We have registered pipelines by ID in a larger gis database. I already have a script running that reads the information and returns all the registerd freatures in the camera inspections and draws it in a arcgis. The issue is that sometimes the lines have bends even with the same ID. making it hard to create new points at the specified distance. So what i need is something that creates a point at a specific length from the starting point ID, that takes into account the geometric changes of the line. in the example picture under, i want to draw a point at the POI. I have the distance(70m) from start. But there does not seem to be obvious functionality for this in FME. Any ideas?

283

1 month ago

markothorenParticipant

asked in Transformers

DPS-file

Hi!Is it possible to create (writers etc) a Data Pump Script (DPS) file for store in Oracle in FME Form ?

264

1 month ago

ldreyfussContributor

asked in Transformers

Extract all line segments between many pairs of points

Hello,I have a set of pairs of points that each have a uniqueID_start and unique_end field. I am trying to extract all of the line segments between each pair of points. The tricky thing is that the pairs can be several line segments long, and have other pairs intersecting them:There could also be several points on a single spot, but corresponding to different pair sets.It’s a mess! Any help would be wonderful!

492

1 month ago

pgammieContributor

asked in Transformers

Shapefile to DGN (V8)

Hello, I have a reader with a shapefile that has contour lines in it. I have connected that to the ContourLabeller transformer. I have taken the label output port of the ContourLabeller and run it to a DGN Styler where I have styled it. These parts are all working but when I write it using the DGN (V8) writer the label level is not created. What am I missing here? Thanks!

200

1 month ago

mariakaContributor

asked in Transformers

Swap/Rotate profile onto XY-space

Hi there,I have severale profiles, which fly somewhere in 3D space.The elevation always follows the z axis. The direction varies, but follows one direction in XY level.I started like this:BoundsExtractor get the bounds (aka rotation axis) GeometryRefiner do some geometry refining 3DRotator rotate around the axisResult:3D view2D viewred: rotation axisgrey/black: original geometrygreen: rotated geometryI expected the green geometries to be rotated around the axis, but instead they are rotated into 3d space 😵‍💫 I also tried to set the axis through the geometry (z = zmax-zmin), but with no success.Can somebody help?Cheers,Maria

251

1 month ago

zkovacs

asked in Transformers

HTTP call JSON parsing problem

I have a problem with parsing JSON which is the result of an HTTP call to get what I need. (See json files attached.)If I download the .json file and simply put it in a JSON reader with a query,filter for type:"Update Feature Attributes" and explode some of the lists, it gives me what I need:My problem is that I have loads of transactions to go through the same way, so I'd need to use an HTTPCaller. I've managed to get that far that with a JSONExtractor I can get "type", "ID" for example, but struggling to break down lists "attributesAfterChange" and "changedAttributesNames" - ListExploder doesn't recognise them as lists for some reason. Any ideas what should I do to get the list values/break down the arrays? Maybe it's very simple but I just cannot find a solution right now. NB: the attributes in these lists vary and not exclusive to what's in the attached json files, so somewhat making it a bit more complex...Any h

794

1 month ago

ben.dawsonContributor

asked in Transformers

Geometry Extractor INVALID_GEOMETRY_VERTICES for WKT

I’m trying to make a KML from a CSV with Geometry in WKT. I have got up to the Extract Geomery transformer but keep getting the INVALID_GEOMETRY_VERTICES error. Example i’m trying to extractLINESTRING Z (212197.02298451745 6343709.643456226 -405.22127891605567, 212199.2655298651 6343696.0119692795 -406.87294763726277, 212201.50807521114 6343682.380482333 -408.246661504635, 212203.75062055816 6343668.748995384 -409.3429700220356, 212205.99316590338 6343655.117508436 -410.1623117274895, 212208.2357112494 6343641.48602149 -410.7050143686031, 212210.47825659852 6343627.85453454 -410.9712950336693, 212212.7208019459 6343614.223047592 -410.9612602385047, 212214.96334728913 6343600.591560645 -410.674905969057, 212217.20589263522 6343586.960073698 -410.1121176798006, 212219.4484379844 6343573.328586748 -409.2726702479159, 212221.69098332908 6343559.697099801 -408.1562278832371, 212223.9335286767 6343546.065612854 -406.7623439939325, 212226.01318177005 6343533.424279183 -405.22127891605555)

353

1 month ago

Anonymous

asked in Transformers

AutoCAD Dimensions to validate angles

Hello, I was just wondering if anyone has successfully used the AutoCAD Dimension attributes to validate angles?I have a example drawing below where the angle of the lines is added as text in AutoCAD using the DIMANGULAR function in AutoCAD. When FME reads in the features, using ‘Explode Dimensions’ set to No, I get a series of attributes against the text point with the coordinates of lines used to determine the angle in AutoCAD. What I have found is that defpt2 to deft4 aren’t always in the order to create lines and test the angle between them and was wondering if anyone else has had success in validating angles from a DWG?

131

1 month ago

riain.garciaContributor

asked in Transformers

Emailer - Microsoft Email Service - Unable to retrieve access token

I’ve been successfully utilising the Microsoft Email Service via the Emailer transformer for sometime - I noticed last week that all emails scheduled to run via FME flow stopped working, and when I opened the workspaces to reauthorise Microsoft, I was met with the following error: “Unable to retrieve access tokenRequest to update access token failed. HTTP Error: HTTP/1.1 401 Unauthorized” My IT department can see on their end that the logins have been successful via FME Emailer Enterprise Application on Azure.

695

1 month ago

rusanpeContributor

asked in Transformers

SQLExecutor doesn't produce a view with any geometry when it should do

I have many SQLExecutor transformers and for any reason they use to lost the geometries.The visual preview nor the data inspector show any geometry, only a “There is no geometry in this view” message.When they should save the results in the next FeatureWriter (in a postgis database) only the alphanumeric fields are correctly writed, but the geom field is fill with nulls.When I execute the same sql sentence in QGis or pgAdmin I get the geom field with the correct geometries.I'm not be able to find the fix for this issue. Any idea will be appreciated. Thanks in advance.

396

1 month ago

elzbietalekveContributor

asked in Transformers

Parameters til Portal for ArcGIS-writeren

Hi,I have an FMW (FME Form v.2023.2) with 4 datasets, and I would like to save the results as ArcGIS Portal writers. Each dataset could change due to modifications in the underlying databases or files used in the FMW. These changes may involve the deletion or insertion of rows, updates to attribute values, or, in some cases, no changes at all.I would like to run the FMW once a month without modifying the parameters for ArcGIS Portal.How should I configure ArcGIS Portal to capture all changes for these 4 datasets?When I used Insert for Feature Option and Truncate for Feature Type Handling 3 datasets where correct updated, the 4th dataset “Alle_Adr_Adkom” got:ArcGIS Portal Feature Service Writer: 0 features successfully written to 'Alle_Adr_Adkom', but the server rejected the 48751 features in the last request due to errors. See warnings above. Ending translationARCGISPORTALFEATURES writer: An error has occurred. Check the logfile above for details”I appreciate your helpElisabeth

294

1 month ago

diniz

asked in Transformers

Change log file name with FMEWorkspaceRunner

Hello. I am running workspaces using FME Python API and the class FMEWorkspaceRunner, where I am currently using the method runWithParameters.I would like to know how can I change the Log file name (and path) when running the workspace in this way. I saw in the documentation that runWithParametersAndDirectives have an example about change the log name, but it is not clear for me.Thanks.

122

1 month ago

nicole.huangParticipant

asked in Transformers

HTTPCaller configuration for ArcGIS Online Admin workflows

Hello,I was told that I can use HTTPCaller to automate some ArcGIS Online Admin workflows, such as creating/deleting user accounts.I found this ArcGIS REST APIs authentication document to guide me, but I can’t figure out how exactly. https://developers.arcgis.com/rest/users-groups-and-items/authentication/ Any help is appreciated! Nicole

301

1 month ago

Page 5 / 508

Badge winners

stephenjackshas earned the badge Welcome Back
brown3khas earned the badge Student (Grey)
dewrightcohas earned the badge Welcome Back
dylan.at.safehas earned the badge Teacher (Bronze)
skyrunnerhas earned the badge FME Form Advanced Training

Show all badges

30,148: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.