Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,685 Replies
10000 Posts
francisco_1988
Contributor
francisco_1988Contributor
asked in Transformers
Managing Reading Order Conflicts

After adding FeatureReader_2, the reading order started prioritizing the XML block. Then, a join occurs with the Data Dictionary block, but since the XML is fully read first, when the flow reaches the FeatureJoiner, the data dictionary has not yet been processed, causing an error.This started after I added FeatureReader_2, because I need it to read shapefile files to extract the name and coordinate system, which are parameters defined in my spreadsheet with the paths to each shapefile.Is there any way to make the XML and Data Dictionary blocks read simultaneously? Or, since the FeatureReader is a reader, will it always have priority?

455
francisco_1988
Contributor
panda
Enthusiast
pandaEnthusiast
asked in Transformers
How to get Raster palette index value out from WMS

I’m working with getting raster imagery in the area of interest out from the WMS. It’s the Land Coverage WMS. (https://dmsdata.cr.usgs.gov/geoserver/mrlc_Land-Cover-Native_conus_year_data/wms?)End goal is to clip the Raster out from WMS into smaller area, and I need to be able to write attribute table showing the value number & RGB value in the Raster.End Product. (Smaller Raster with attribute table)​​​​​​The issue I’m having is that the Palette index seeing inside ArcPro and FME is different. (Approximate location, SE corner of Possom Kingdom Lake, Graford, Texas, USA.) (32.856463, -98.431004)Screenshot from ArcPro. When clicking Blue (Water) the value is 11. Screenshot from FME. When viewing the Palette after using RasterPaletteExtractor it showed Blue as 0. and I cannot figure out how to get the value “11” out of it. Also If anyone can help me figure out how to write the raster file out with attribute table that would be greatly appreciated. I’m quite new with Raster, so I’m no

341
takashi
Celebrity
alexbiz
Influencer
alexbizInfluencer
posted in Transformers
Introducing BetterReportGenerator (BRG) – a fresh, modular take on HTML reporting

Hi everyone!Today I’d like to share a new approach to building reports in FME, along with an entire family of custom transformers I’ve created to support it. Why I built BRGI’m a long-time fan of the HTMLReportGenerator. It lets me craft reports quickly, and I love the versatility of HTML compared with, say, PDF. I even demo it in every Intro to FME course as a great example of “let FME handle the code.”But as much as I love it, I’ve always hit three pain points:1. Plain styling – it could really use a dash of CSS/Bootstrap.2. Hard-coded content types – adding a new chart or HTML element isn’t trivial.3. Cumbersome feature ordering – managing Sorters and AttributeCreators just to control layout can get messy.Earlier this year I had to build a highly procedural report with lots of HTMLLayouters, AttributeCreators, and Sorters, and the workspace quickly turned into spaghetti. That’s when I thought: I already improved SystemCaller with BetterSystemCaller… why not do the same for report ge

39115
alexbiz
Influencer
geodances
Contributor
geodancesContributor
asked in Transformers
Schema Mapping and DWG to SHP conversion

Hello,A DWG is converted to SHP with a Schema Mapper and Schema Scanner (This is a POC for a more complex workspace.).  Output FileWhat is the Q_schemam attribute that is automatically created ? (I removed it from the writer but I am curious about it). How do I remove the original attribute from my Schema Mapper ? I selected ‘Source Attribute: Remove’ in the schema mapper, but the original attribute is still outputted.  My output also contains Source Bra and Source Fea, how do I avoid writing this attributes? What are they ? Thank you

231
evieatsafe
Safer
antoine.prince
Contributor
antoine.princeContributor
asked in Transformers
Problem with Esri ArcGIS Server Feature Service Reader

The FeatureReader for Esri ArcGIS Server Feature Service seems broken in 2024.0. I try to read the following feature type : "Zones de gestion intégrée eau par bassin versant - ZGIEBV";and I get the following error message : ArcGIS Feature Service Reader: Could not find a layer/table matching feature type 'Zones'Python Exception <FeatureTypeNotFoundException>: FMEException: 928219: ArcGIS Feature Service Reader: Could not find a layer/table matching feature type 'Zones' It seems to me like the feature type cannot contain spaces. This worked fine in FME 2023.

1525
evieatsafe
Safer
M
mattdoa2
asked in Transformers
ESRI ArcGIS Server Feature Service Reader Fails When Spaces are in the Feature Type Name

I'm using a FeatureReader to read an ArcGIS Server Map Service. The map service has a lot of layers (AKA: Feature Types) which I can choose from to read.If I choose a feature type name which doesn't have a space then it works but if I choose one with a space then FME Desktop errors saying it can't find the feature type with the truncated feature type name at the first space. Here is an extract from the logs below for "Fish habitat areas" as an example of it incorrectly reading "fish" as the feature type name ArcGIS Feature Service Reader: Could not find a layer/table matching feature type 'Fish'A fatal error has occurred. Check the logfile above for detailsStoring feature(s) to FME feature store file `C:\\tempDir\\wb-cache-DownloadFishHabitats-C19216\\Main_map_service_-_FeatureReader -1 3 fo 633 _lt_REJECTED_gt_ 0 85bd7267ad00c49a5eda9b6f99fe095bbe050483.ffsupdating' Is there a way I can get around this? (I can't remove the spaces in the

774
evieatsafe
Safer
aaron
Contributor
aaronContributor
asked in Transformers
HTTPCaller truncating edit request with ESRI's REST API

I’m using an HTTPCaller to applyEdits using ESRI’s REST API. It includes sending along some JSON to add to a table in a feature service. The workspace runs successfully testing with 1 or 2 records in the JSON parameter, which is all sent with a single HTTP call, but fails when testing with 10 records. It looks like FME is truncating the HTTP string, which causes the request to fail. That’s what it looks like in the FME log anyway; the query string appears on two lines (see attached screenshot). If I try applyEdits in a web browser at the REST endpoint and paste the JSON in manually, I can add the data without issue. Is there a parameter or formatting change I need to make to keep FME from truncating the HTTP call? (FME Desktop/Form 2023.2.2.0, build 23764)

769
bruceharold
Supporter
syedh2993
Contributor
syedh2993Contributor
asked in Transformers
Join records with Line geometry

Hi All,I am working on data with Line Geometry and would require some help to solve the below scenario,While plotting them on map, I see there is small gap between lines in some scenarios and would like to join them together if the distance between two lines is less.(Reason for this gap - There is an asset in between the lines which has Point geometry.- Not sure if this statement will help, JFYI)Below is an example of different line geometries joining with each other, and there are small gap in some scenariosI would like to join gap between Line 3 and Line 4.gap between Line 5 and Line 6I am not interested in joining parallel line, as they are far from each otherAny help regarding the above would be much appreciated. Thanks

533
lambertus
Enthusiast
virtualcitymatt
Celebrity
virtualcitymattCelebrity
asked in Transformers
Why is my logger not logging

I’m seeing some weird behaviour on FME Flow (2024.2.2)I’m trying to debug a process on FME Flow which isn’t working properly. I wanted to see what was going on so I threw down a logger, republished, reran.To my surprise the feature never made it to the logger...now I know what you’re thinking. “oh you must be doing something wrong”. Well maybe.But the workspace is so simple. Creator>AttributeManager>Logger>File Copy Writer Here’s a snippet of the log:2025-08-22 12:19:45| 0.0| 0.0|INFORM|Creating writer for format: 2025-08-22 12:19:45| 0.0| 0.0|INFORM|Creating reader for format: 2025-08-22 12:19:45| 0.0| 0.0|INFORM|MULTI_READER(MULTI_READER): Will fail with first member reader failure2025-08-22 12:19:45| 0.0| 0.0|INFORM|Using Multi Reader with keyword `MULTI_READER' to read multiple datasets2025-08-22 12:19:45| 0.0| 0.0|INFORM|Using MultiWriter with keyword `PRIMARY_DEST' to output data (ID_ATTRIBUTE is `multi_writer_id')2025-08-22 12:19:45| 0.0| 0.0|INFORM|Wr

609
virtualcitymatt
Celebrity
virtualcitymatt
Celebrity
virtualcitymattCelebrity
asked in Transformers
FMEUniversalReader from a file like object?

I have a texture embedded in a binary file. I’m trying to extract the textures and apply them to the geometry I’m loading. I figured the easiest way to do this is to read the textures in with the FMEUniversalReader. I quickly found out that I need to pass the input file as a string (filename). Ideally I’d pass this as just a BytesIO object as the library I’m working with already loads the data as a PIL object.At this point I don’r really see a way around writing out the textures to disk and then reading them again with FME. Any other ideas?

121
virtualcitymatt
Celebrity
eric_armitage
Contributor
eric_armitageContributor
asked in Transformers
XML templater number format issue

HiI have an attribute value derived from an Excel sheet. The input attribute name is “Vægt”. FME data type is number(20,2). An example value for a feature is “2.95”. I’m trying to retrieve this value using the xml templater using <Cell><Data Type="Number">{fme:get-attribute("Vægt")}</Data></Cell>   But the output value in the xml is 2.9500000000000002 Could anyone explain why this is happening and suggest a fix? I have tried attribute rounding and changing the input Data Type but nothing seems to work. Thanks

172
eric_armitage
Contributor
tsirkuse
Contributor
tsirkuseContributor
asked in Transformers
How to dynamically write output shapefiles to specific folders & subfolders ?

I am using a python caller to read paths for files from my Input folder. Files in the input folder are ordered in a ClassName and AssetName folders. There is a variable number of AssetName folders under each class name folder. I am transforming data and using a schema mapper to read transformed schema A series of shapefiles is written with a dynamic writer.How can I copy the input ClassName and Asset Name folder structure when writing the output ? I tried using shp dataset fanout but I can’t get the configuration right.

776
tsirkuse
Contributor
afod
Contributor
afodContributor
asked in Transformers
Different/Incorrect results when using RasterCellValueReplacer

I'm doing a relatively simple task using a RasterCellValueReplacer, im filtering a few rasters by a defined filter parameter.However, if the filter value is typed into the transformer it works fine, if i try and pass the filter value by either user parameter or attribute the result is completely different and incorrect.What's a bit more of a concern, when i use an attribute or a parameter, the process seems to be making its own filter value out of thin air, the raster passes through as if filtered randomly   

494
takashi
Celebrity
tnarladni
Enthusiast
tnarladniEnthusiast
asked in Transformers
How to remove unexposed attributes from ChangeDetector without exposing them

I am trying to use the ChangeDectector to compare datasets before loading. First set is AGOL data, new set is SDE data. Every features is considered “changed” because of unexposed attributes that I don’t want to compare. When I have it set to “compare all except”, I am excluding attributes like “last_edit_user” and “last_edit_date”. There are only 4 to exclude and they are the same 4 for all the datasets so I am able to duplicate the transformer. But all records are exiting the “Updated” port because of these unexposed attributes: geodb_type, multi_reader_type, geodb_oid, etc. I dont want to compare these and I also don’t want to expose them first becuse the AGO layers don’t have some of them so I would have to create them and then exclude them. Alternatively, I could use “Only compare these attributes”, but because each set of data to compare have different attributes, I would have to fix the ChangeDetector transformer for each set. Is there a way to discard attributes that are NOT ex

679
tomf
Supporter
geodances
Contributor
geodancesContributor
asked in Transformers
Dynamic fanout shapefiles to folder/subfolder

Hello, The goal is to convert a large amount of DWG CAD files to SHP files.Each DWG file is located in a specific folder and subfolder corresponding to it’s location and level. Each DWG name has a prefix component indicating the plan’s specific location and a basename indicating it’s feature type.  The prefix component is identical in SHPs and DWGs The basemap depends on a combination of layer(s) and geometry type. There is also a conversion matrix identifying which combination of DWG basename, layer and geometry type result in which SHP basename.Schema mapper & scanner are used to convert schemas based on basename only.I can output the corresponding shapefiles as Prefix_Basename.SHP in one global output folder.However when I try to set the dataset fanout, the folders are created but the files aren’t. I created two separate shapefile writer for comparison. The general parameters are exactly the same, on the writer parameters change.For the dynamic output folderFanout Directory= \o

374
tomf
Supporter
francisco_1988
Contributor
francisco_1988Contributor
asked in Transformers
Escaped Characters ("&gt" and "&lt") Appearing in XML When Using xmlUpdater

Guys, I need some help with my XML. In some parts of my document, characters like "&gt" and "&lt" appear. Specifically inside the <data_dictionary></data_dictionary> tag, where I perform an update using the xmlUpdater transformer. What could be causing this?

232
francisco_1988
Contributor
katt
Supporter
kattSupporter
asked in Transformers
Get First and Last Vertex of aggregated lines

Good day, I have some line segments that I aggregate based on an attribute in common. After the aggregation I would like to extract the coordinates of the first and the last vertex of the aggregated line (in green). I am using the coordinate extractor at coordinate index -1 and 0. The coordinate values I get as the result are not the first and last vertex of the combined line. I think the problem is that the new line is a multi curve. How can I extract these coordinates (in green) ?

512
takashi
Celebrity
francisco_1988
Contributor
francisco_1988Contributor
asked in Transformers
How to Automatically Add New Attributes in an XML Template?

Hello everyone,I am using an XML template like the one below to generate fields dynamically in FME Workbench:<field> <name>cod_imovel</name> <description>{fme:get-attribute("cod_imovel")}</description> </field> <field> <name>tema</name> <description>{fme:get-attribute("tema")}</description> </field> <field> <name>dat_atuali</name> <description>{fme:get-attribute("dat_atuali")}</description> </field> My question is: if a new attribute appears in my source data (for example, atrr_1), is FME able to automatically add a corresponding field like this in the template:<field> <name>atrr_1</name> <description>{fme:get-attribute("atrr_1")}</description> </field> Or do I need to manually edit the template each time a new attribute is added?

668
takashi
Celebrity
mnash
Participant
mnashParticipant
asked in Transformers
Version 5 UUID

Hi all, I’m new to FME and would like to know if there is a way to generate a v5 UUID in FME 2024? From what I have read I can’t see a method for this. Thanks.

685
alexbiz
Influencer
B
bbunch
asked in Transformers
Why is it now so slow to read an AGOL service with attachments set to 'Yes'

Prior to Desktop Version 2022. I could read an AGOL service with attachments relatively fast. Now with 2022, it doesn't seem to work at all. I can view the source from the workbench ok, I can read the features in if I disable read attachments. But it doesn't seem to work with read attachments set to Yes any more. The log gets stuck at 'Updating Access Token for..." Updating the token doesn't help either. Has anyone else had this issue? Thanks

15021
kylied
Participant
francisco_1988
Contributor
francisco_1988Contributor
asked in Transformers
Extracting name and description Tags from xml_fragment Using XMLQueryExtractor

Hi everyone,I’m having some trouble with the XMLQueryExtractor. I need to extract from the xml_fragment field the values inside the <name> and <description> tags.Currently, the output from FeatureJoiner is in the format: Theme | ID | xml_fragment What I need is for the extraction to produce the following table: Theme | ID | xml_fragment | name | description

344
francisco_1988
Contributor
rajendarkarra
Participant
rajendarkarraParticipant
asked in Transformers
separate stacked point data in to individual points

i am trying separate stacked point data in to individual points, can suggest in FME or ArcMap 

564
david_r
Celebrity
ziur
Contributor
ziurContributor
asked in Transformers
List Value to Attribute

Hi all I have a list like somelist{0}.val = 'apple'somelist{1}.val = 'donut'somelist{2}.val = 'aardvark'somelist{3}.val = 'apple'somelist{4}.val = 'aardvark'somelist{5}.val = 'apple'  the list histogrammer transforms it into _histogram{0}.value = 'apple'_histogram{0}.count = 3_histogram{1}.value = 'aardvark'_histogram{1}.count = 2_histogram{2}.value = 'donut'_histogram{2}.count = 1  now I want this information as attribute pairs like attribute_name    attribute_valueapple                   3aardvark              2donut                   1 any Ideas how to do this in FME without fancy scripting or looping are much appreciated! 

9713
ziur
Contributor
mst
Contributor
mstContributor
asked in Transformers
Excel writer writes value 'No' as 'FALSE'

I’m using FeatureWriter to write data using dynamic schemas to multiple worksheets of an Excel file. In the particular case where I detected the issue, the data meant for the last worksheet contain just one row and value in just one of the columns. This value is ‘No’.As you can see, the native_data_type of the respective schema attribute for this value is ‘string’.In the result excel file, however, the ‘No’ value is changed to FALSE. I can’t figure out why this happens.The Writer writes other ‘No’ values to other worksheets and all of them appear to written correctly as ‘No’. This is the FeatureWriter setup:   Have I made a mistake somewhere, or is it a bug in the Excel Writer?

11414
crutledge
Influencer
mitra
Contributor
mitraContributor
asked in Transformers
Dynamic Writer Not Writing New Attribute Field

Dear FME Community,I’m using a dynamic writer in my workspace and have run into an issue with newly added attributes.In my workflow, I added a transformer to perform an analysis and wrote the result to a new attribute field. However, this new attribute is not appearing in the output file.I understand that the dynamic writer uses the schema from the reader, and since this new attribute doesn’t exist in the original schema, it seems to be excluded from the final result.How can I ensure that this new attribute is included in the output when using a dynamic writer?Is there a recommended way to update or override the schema dynamically?Thanks in advance for your help!

283
pratap
Contributor

Badge Winners

Show all badges

Community Stats

31,773
Posts
120,715
Replies
39,397
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.