- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,677 Posts
50,715 Replies

When you subscribe we will email you when there is a new topic in this category

12677 Posts

Recently active

Most replies Most views Newest first

tomerbublick1Contributor

asked in Transformers

How can I save label positions from a DWG file?

I have a block sitting on a line and a block associated with a point in a DWG file. How can I save the label positions, including the rotation and alignment of attributes like 'ID', 'Slope', and 'IL_Out', using the CAD Feature Writer in FME?

443

1 month ago

fiennaContributor

asked in Transformers

SpatialFilter gives unexpected results

I'm using FME Workbench version 2023.2.3. I have 2 datasets, 1 dataset contains around 2,5 million polygons, the other dataset is 1 polygon (a province in this case). I want to know which polygons overlap with the province (even if the overlap is small). I use a SpatialFilter for this, with the 2,5 million polygons as candidate and the 1 polygon of the province as filter. Below are the settings: Now I noticed some issues, where some polygons who do have an overlap, still end up in the ‘failed’ port. Like the example below:I asked some colleagues and they don't know what's going on here. Everything looks alright and we have no idea why this doesn't go in the ‘passed’ port. It almost seems like a bug. I use this SpatialFilter a lot, so I'm curious what's going on here. I hope someone can help me to figure this out.

14810

1 month ago

mgruppParticipant

asked in Transformers

ArcGIS portal feature writer fails to fill certain fields when run on FME Flow

Hi everyone,I have a problem that I can't seem to solve. I have a workspace that writes data from a PostGIS database to a feature layer on our portal using the ArcGIS portal writer. When this workspace is run locally on FME form, it works perfectly fine. When it is uploaded to portal and run there, it seems to work fine (the amount of features written is identical to the amount when run locally), but some important fields are not filled. Flow and Form both use the same web connection with the same authorization parameters. Why is it that a identical workspace that runs locally can fill all fields fine, but when run on portal it seems to not be able to fill these fields??? I have put testfilters and loggers in between to check if the fields actually have values and they do, so it must be a writer quirk. Field names between the features and writer are identical as well (all lowercase) so I am at a loss... I am using fme form/flow 2023.2.2 and ArcGIS portal 11.1

442

1 month ago

david_r

asked in Transformers

FME encoded text (internals)

Not really a question, but feel free to add comments or thoughts below.We are implementing pre-commit hooks and centralized Python linters in our git workflows, and for this we need to extract all Python code from workspace files pushed to git. Since we do not want to require a full FME installation for this, we’re parsing the .fmw files as text files using Python and extracting all the code blocks within, before passing them on to the linter as if they were stand-alone Python scripts.As code blocks are encoded in a somewhat non-standard way, I’m sharing a Python function to convert FME encoded strings to regular text, without resorting to any dependencies like an FME installation, (which would allow using FMESession.decodeFromFMEParsableText) or other third-party libraries.It can decode FME encoded strings on either formatimport&lt;space&gt;fme&lt;lf&gt;import&lt;space&gt;fmeobjects&lt;lf&gt;import&lt;space&gt;json&lt;lf&gt;&lt;lf&am

582

1 month ago

axcel.fmeContributor

asked in Transformers

Conditional Group Processing

Hi there,last time, this community forum was so helpful and I hope someone can help me this time around too…I’m using the Clipper to clip polygons using the Group Processing feature. Only if the values of the attribute “att_1” are the same should the clipping occur. So far so good. However, it can be that att_1 is NULL (empty) and in this case, I would like to do Group Processing using attribute “att_2”. Is there a way to configure this in the Clipper directly?With my humble knowlegde of FME, I would filter for att_1 being NULL and have two Clippers (one for Group Processing att_1 and one for Group Processing att_2) and then merge the two data streams again. But is there a more elegant way?

443

1 month ago

huundriks2Participant

asked in Transformers

Count by two attributes and restart when one changes

Hi, This is defeating me!Any pointers sincerely appreciated.See attached spreadsheet, Where I have features with attributes having multiple similar IDs as well as a name attribute.I have added the columns _num and _page, that is the desired output I manually added in.I can achieve the _num output easy enough with a counter set to Local and group by the two Attributes Name and ID. I set the Count to be _num and Group ID to be _page. This works fine until the Name group changes and the _page will continue counting, See screenshot. However, when the new Name starts with B I want the _page to restart at 1. How do I set it? Thanks. Nic

473

1 month ago

linmengObserver

asked in Transformers

3Dtiles show error how to fix geometricError ?

I am a Chinese student who uses FME software to read shp files and create 3Dtiers files. There is a problem loading and displaying now. As shown in the video, there is an issue with zooming in and out.Others' 3dtiles were generated using other software and did not encounter this issue. I'm having problems using FME now, how can I solve this. Please help me. My English is not very good. Can you understand what I translated using translation software.I searched for some 3dtiles files and someone said it was a geometricError parameter setting issue.Where can i set the 3dtiles geometricError ???please help me .I am bad in English.my Emial 1985425275@qq.com FME USE THIS . Maxinum Number of Triangle Faces Per Tile Trying to set 100 and 1000 times, but it doesn't work。Where can I set parameters？？？Someone told me that there is a problem with the geometricError parameter and it needs to be corrected。Hom to ???

441

1 month ago

nathContributor

asked in Transformers

Purge tempory files

Hello, Am I the only one who is experiencing lately that if I have several models open and I do a purge tempory files in 1 of them then it then does the same in the others? The numbers remain in the other model but the green box to view is gone and I have to run the whole model again :-(I do that because sometimes I update a reader but then it won't run again without me doing that purge.

464

1 month ago

joySupporter

asked in Transformers

(GIS) When looking for neighbours, I only want neighbours that touch more than a single vertex

Hello everyone,I am currently making a script that looks for houses that have a garden. In my current script I have two datasets: 1) houses, 2) gardensI used for now the NeighborFinder transformer and I have a maximum distance of zero, since the gardens and the houses need to touch one another. So far, so good. However, now I get another problem.I have the following situation. You can see in the drawn example below that the garden and House 1 share a line, while this is not the case for House 2. However, based on my current settings in the NeighbourFinder, the garden is as well considered a neighbour for House2.How can I go about it, that House 2 is not included, since House 2 and the garden don't share a line, but only one vertex. Do I need to change some settings in the NeighbourFinder or do I have to go differently about it.

603

1 month ago

judy_fme

asked in Transformers

how to dissolve line segments into long line?

I need to dissolve line segments into long line base on some attributes. I tried LineCombiner and it doesn't work, still same segments in the result.

52714

1 month ago

sammySupporter

asked in Transformers

Resolve domains option to output coded value rather than "null"

Is there an option or setting that I have missed?I have a reader pulling in data from a portal feature service. I set it to resolve domains.I have a field that, for whatever reason, the coded value is not being resolved so the “_resolved” field is being populated as <null>.Rather than having to add transformers to each of my workbenches to check each of my domain fields, I was wondering if there is a setting I am missing somewhere?In this instance, I would rather have the coded values populate the “_resolved” field rather than it show up as “<null>”. Is there an option that I can set in the reader (or somewhere else) to be able to do this? I am using Workbench 2023.1. This post indicates that there was no option 3 years ago… hoping there’s been an update made? Also, looks like no progress made on this request (from 4 years ago!) to at least add a warning in this type of situtaion. Please go upvote:

1766

1 month ago

michaelbreen

asked in Transformers

Disabling Feature caching causes transformer to fail.

Has anyone experienced a workbench erroring when feature caching is disabled? For context I have had this workbench running through task scheduler for around two years (keeping it updated) and recently discovered an issue where it crashed at a specific transformer (feature joiner).In testing I have run the workbench with feature caching on (it worked fine) so I tested all the normal points - replace transformers, replace readers/writers, change user credentials. When I turned off feature caching is where the error occurs (in the same spot as when running it through task scheduler).The attached logs show where it crashed on the feature joiner, has anyone experienced this? My last step is to recreate the workbench from scratch and test that as well.

705

1 month ago

nigelgriffithsObserver

asked in Transformers

Calculating area of overlap for one feature layer against another, and filtering based on percentage of overlap.

Hello, I am attempting to replicate the following PostGIS SQL code within an FME workspace: where ST_DWithin(property_boundary.shape ,restriction_area."SP_GEOMETRY",100) and ST_AREA( ST_INTERSECTION(property_boundary.shape ,restriction_area."SP_GEOMETRY"))/ST_AREA(restriction_area."SP_GEOMETRY") < 0.1 property_boundary layer is parcel data for an area. restriction_area is a collection of polygons where the same restriction applies but for different reasons which is listed in the attributes. If the above script is true for a given property an attribute is then applied. I am not very familar with PostGIS SQL, but from my understanding, this script is filtering for all property_boundary shapes that intersect a 100 meter buffer of the restriction_area. Then, it calculates the total overlap between each property_boundary shape, and each restriction_area shape. If the area of overlap for a property_boundary shape is less than 10% of the total for a given restriction_area it is selected in

632

1 month ago

dbaldacchino1Contributor

asked in Transformers

Thoughts on the new UI/updated look in FME 2024

I have finally started using FME Workbench (Form) 2024 a bit more consistently now that I built a new instance of FME Server (Flow Hosted) 2024.1.1.1. I like the updated look, but am missing a few things and noticing some inconsistencies in how the transformers render on the canvas:The newer look is more modern and although it’s just “ok” for me (looks like a card and less “fussy” than the previous transformer look), I like it. I miss the cog-wheel to access settings with a single click at the top-right of each transformer. Now you have to highlight the transformer and then you can click to access the settings. Doubling the mouse clicks isn’t a great enhancement. Would love to see this make a come-back, maybe as a minimalist “dot” or something... I can double click to get to the settings, but still not thrilled about it. It is forcing me to use the Parameter Editor window more now, docked to the right of the screen. Still getting used to it in an effort to reduce the clicking but with

1065

1 month ago

mzebrowsParticipant

asked in Transformers

Unsupported geometry type Text. Downconverting to Point

Hi,In my workbench I’m trying to export points and labels from Oracle database to Geopackage file.So I’ve configured an Oracle Spatial Object Reader and a TextAdder. On the TextAdder’s output I can see points with labels. Then I’m adding a writer of type OGC Geopackage.But when I’m trying to run process, the result GPKG file contains only points (without labels).On logs there’s a information: “Unsupported geometry type Text. Downconverting to Point”If I replace OGC Geopackage writer with Bentley Microstation Desing (V8), then it works properly (I mean the result contains points and labels).How to export labels to Geopackage?

363

1 month ago

timboberooskyContributor

asked in Transformers

When FeatureWriter fails there is no output

When a FeatureWriter fails for whatever reason, is the expected outcome that nothing is output from any of the ports, even if some or all other feature types are successful? In my example I have 2 feature types in a FeatureWriter and 1 of the 2 writes successfully, the other fails (I’ve forced it to fail to test this functionality). I want to be able to take the information from the successfully-written feature type further in the workspace for processing. Is this not possible? Currently I’ve resorted to 40 separate FeatureWriters for 40 different feature types in case 1 of them fails and the other 39 are successful. I do have Rejected Feature Handling set to Continue Translation. This is FME 2024.1.1.1 (B23620).Below is my example. The 312 features for for the one feature type successfully write to my database (ArcSDE GeoDB). I’m ok that the Translation Failed and is actually a good thing, I just want to use the summary and feature counts to write to log tables further along in the tr

503

1 month ago

bwhitney

asked in Transformers

Is there a way of working with GraphQL APIs using the HTTPCaller transformation?

I am in the process of working on an integration between Cityworks and ArcGIS Urban. While I am well-versed in using the HTTPCaller transformer for REST APIs in FME Desktop, after s few hours of working with an HTTPCaller, the only way I was able to make a GraphQL API call was using a PythonCaller with some custom code using the requests library. For now, the PythonCaller route will work well enough, but I would rather lean on the HTTPCaller for when others have to take over this integration who are not Pythonistas.

2546

1 month ago

od10Contributor

asked in Transformers

Merge Surfaces, Simplify and Retain Textures/Appearances

Hello, I have multiple FBX surfaces with textures as external jpegs which are read in alongside the geometry and coloured accordingly. I need to merge these surfaces into one file using a deaggregator and a meshmerger which works, but when i write this to an FBX file, the jpegs or textures are all individual files which are retained from the original file. Also when i simplify the mesh, it also looses all colours. Is there a way of merging, simplifying a mesh whilst retaining all textures or appearances? Thanks,@takashi @nielsgerrits @hkingsbury @daveatsafe @david_r @ebygomm

330

1 month ago

so_much_moreContributor

asked in Transformers

Date functions only available in featureWriter transformer not in a Writer, why?

I need to write datetime to a comment on a SQL table after my postgres SQL writer is complete.This can easily be done like when using a featureWriter like so:COMMENT ON SCHEMA "my schema" IS '@DateTimeFormat(@DateTimeNow(), %Y-%m-%d %H:%M)';This is not possible if i use a regular postgres writer. Only SQL functions are available. This alone is not enough to set a timestamp.Tiny but frustrating neuance between almost identical transformer/writers. What other ways can i inject a datetime into my comment on schema syntax?

715

1 month ago

syahirahContributor

asked in Transformers

HTTPCaller POST method to get FileUpload

Hello, I am configuring FME to receive file uploaded from website through API - POST method. We want the api to directly pass the uploaded file from website to FME for processing. Note that the file is not saved into any DB.The issue I am facing is the the configuration of HTTPCaller Transformer to receive file datatype. Anyone can help suggest on this? Would be very helpful if I can get any advice to configure it the correct way since I’m stuck with this. The logs: The api test through postman has give success response to upload file.The file type I am testing to upload is excel file. Later will need to test with CSV & Shapefile.

653

1 month ago

joepkInfluencer

asked in Transformers

Attribute Accumulation question

Hi all, I am currently using a Dissolver with Attribute Accumulation > Accumulation Mode set to ‘Use Attributes From One Feature’.How does FME decide which feature's attributes are used? I assumed it would be the first one to enter the transformer, but I couldn't find anything on this in the documentation. Kind regards,Joep

615

1 month ago

aronContributor

asked in Transformers

Find the "corners" of irregular polygons?

The polygons below have corners that are 90 roughly degrees. I would like to split them at the corners so that I get four lines from each polygon for further processing.The two areas below are only examples, but the rest of the data have similar elongated, bent shapes. I tried finding the corners by intersecting against a bounding box but the result was not very useful because of the irregularity of the shapes. My guess is that I would get the best result by measuring where the vertex take a 80-100 degree turn. Any suggestions on how to achieve this? Or other clever ways to breake the polygons appart?

544

1 month ago

alpheusParticipant

asked in Transformers

Transformers not installed message - AttributExposer and Clipper

Why do I get the message: The following potential problems were detected in this workspace:Transformers are used that are not installed: 'AttributeExposer (version 2)', 'Clipper (version 16)' The install/machine that created this workbench, and the install/machine I’m trying to run it on are different, is it a version mismatch? How can I fix it?

1226

1 month ago

jacklonsdaleContributor

asked in Transformers

JSON unexpected character and string replacing

Hi all,I have a set of JSON files which return an error upon trying to read them in - that it encounters an unexpected character "\\". If i open the JSON in a text editor and remove all the \\ characters it reads successfully in FME then.As i have a batch of 300 JSON files i cant do this manually. I have tried reading in each one as a text file and using a StringReplacer but it is incredibly slow.Has anyone got any suggestions or solutions?Kind regards,Jack

3355

1 month ago

arunkjContributor

asked in Transformers

AttributeManager with limited sets of attributes

I need something like the AttributeManager but it needs to work only on a limited set of attributes. What I need is a transformer that sets values (conditionally) to a handful of attributes. I need the ability to copy paste this box to various places in a workspace or to other workspaces. I’ve been using AttributeManager but the problem is it gets overwhelmed with other attributes and the transformer changes based on the input stream. I need something that’s sort of shielded from what’s in the pipe. These limited set of attributes are common to various workspaces or workflows (eg, datemodified, lastuser, datecreated etc) and are always guaranteed to exist. So naturally I need them handled in a simple, separate transformer that can be reused. Is there any way to achieve this? Thanks

514

1 month ago

Page 6 / 508

Badge winners

stephenjackshas earned the badge Welcome Back
brown3khas earned the badge Student (Grey)
dewrightcohas earned the badge Welcome Back
dylan.at.safehas earned the badge Teacher (Bronze)
skyrunnerhas earned the badge FME Form Advanced Training

Show all badges

30,148: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.