Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,696 Replies
10000 Posts
francisco_1988
Contributor
francisco_1988Contributor
asked in Transformers
Problem in Feature reader

Hi everyone, I'm facing an issue in my workflow: when I process two shapefiles with the same name, the Feature Reader (in Generic mode) interprets them as a single file. This causes an error in my Join. Is there a way to handle this so both shapefiles are read separately?

412
francisco_1988
Contributor
evoteck
Enthusiast
evoteckEnthusiast
asked in Transformers
Data Type

How can I maintain the exact postgre data type of numeric , when write it back to database. The image below is the database datatype (numeric)  used used as a Reader but the above image is the writer output data type as numeric (1000,500) 

403
desiree_at_safe
Safer
kennethrichards
Contributor
kennethrichardsContributor
asked in Transformers
Writing Multiple shapefiles to different featuredatasets

 I have workflow that pulls large groups shapefiles of different geometry types from a folder using a feature reader and then exports them to a geodatabase. I would like to export them into a feature dataset inside the geodatabase. I have tried including the dataset in the file path but that either gives me an error or results in a blank geodatabase. If I don’t try and put the data in the featuredataset and just put them in the geodatabase everything exports without any problems. How can I get the data into featuredatasets?Creating the path using an attribute manager.Putting the path in the Feature Class or Table Name parameter.

230
kennethrichards
Contributor
gbcfgeo2025
Contributor
gbcfgeo2025Contributor
asked in Transformers
How to Mosaic a Large Number of GeoTIFFs in FME

Hi everyone,I have a very large dataset made up of numerous GeoTIFFs that I need to merge using FME’s RasterMosaicker. Unfortunately, the process stops due to memory issues, most likely because of the amount of data being processed.What’s the best way to get around this limitation and still perform the mosaic?

182
gbcfgeo2025
Contributor
nimeshg
Contributor
nimeshgContributor
asked in Transformers
Error Running Translation error when extracting AutoCAD References

Hi,I am using the AutoCAD Reader to extract external references from DWG files. When I get to the same file in the directory in results in an “Error running translation” error. However, if I run the Reader against the individual file, it works fine. I have removed the file from the directory and it then errors later on a different file. I believe this could be a memory issue? How can I resolve?I am only running the Reader and no other Transformers.Any help would be appreciated.Thanks.

70
nimeshg
Contributor
tullus
Observer
tullusObserver
asked in Transformers
FeatureJoiner failing

Hi all,I have two CSV files (A and B) that I've included using CSV readers, and I need to join them using a feature joiner on a specific column. CSV A contains numbers in all rows, whereas CSV B has numerous <Null> cells in the column. When I run the feature joiner it fails. I already tried:Changing both attribute types to number I included attribute managers before each CSV to include letters with the numbers of each CSV file to force matching as textDoes anyone have any suggestions? Many thanks.  

393
tullus
Observer
r_huesken
Contributor
r_hueskenContributor
asked in Transformers
StringReplacer does not replace newline

StringReplace does not do what I expect (version 2024.2.1.0)Newlines are not replaced, can someone please point out what I'm doing wrong?  

172
r_huesken
Contributor
francisco_1988
Contributor
francisco_1988Contributor
asked in Transformers
Issue Reprojecting Shapefile from SIRGAS 2000 to WGS84 in FME

Hello everyone,I’m having trouble reprojecting a shapefile. The file is currently in SIRGAS 2000, and I need to convert it to WGS84. However, when I run the reprojection, an error occurs (see attached image).Additionally, I need to extract the current coordinate system of the shapefile. In the table, the field shows up as _FME_0, but it should display SIRGAS 2000.Does anyone know how to fix these two issues?

295
takashi
Celebrity
marionmahot
Contributor
marionmahotContributor
asked in Transformers
retrieve value

HelloIn one tester I enter a value through a published parameter. Then I have a second tester in which I would like to retrieve the previously entered value. How can I do this?Thanks

281
hkingsbury
Celebrity
so_much_more
Supporter
so_much_moreSupporter
asked in Transformers
AttributeFilter does not list all available values

I want to filter all unique values of an attribute with the attributeFilter. Iam importing the values stright from the data source using the import Wizzard but it is failing to list all availabel values. It really caught me of guard.I checked the database for unique values marked “Correct” in the image vs the wrong output by AttributeFilter.I used DuplicateFilter to aslo check for unique values and it returned the same as my SQL Query. Am i using AttributeFilter wrong or is it not trustworthy?   

475
hkingsbury
Celebrity
lifalin2016
Supporter
lifalin2016Supporter
asked in Transformers
JSONTemplater fails on embedded HTML

Hi all.We’re migrating email submittals to a http based service, which takes a JSON body in a POST request.One of the fields in the post body is “emailBody”, which can be text or html.So I’m attempting to use a JSONTemplater to build this, but it fails:JSONTemplater (XMLTemplaterFactory): All features receivedJSONTemplater (XMLTemplaterFactory): The following error occurred near line 7, column 50 of the query:JSONTemplater (XMLTemplaterFactory): invalid expression: syntax error, unexpected "QName", expecting "," or "}"An error has occurred. Check the logfile above for detailsTranslation FAILED with 1 error(s) and 4 warning(s) (0 feature(s) output)Line 7 in the ROOT expression is the HTML, with escaped apostrophes and removed linefeeds and whitespace between tags:{ "emailFromId": "planinfo@lifa.dk", "emailFromName": "planinfo@lifa.dk" ,"emailAddresses": [{fme:process-features("TO")}] ,"emailCcToId": "","emailCcToName": "" ,"emailBccToId": "","emailBccToName": "" ,"emailSubject": "T

475
takashi
Celebrity
fmejohn93
Contributor
fmejohn93Contributor
asked in Transformers
GoogleBigQueryConnector Failed to get authorization header

I’m trying to query data from BigQuery using the GoogleBigQueryConnector and get a ‘Failed to get authorization header’ error message when trying to select a project. FME has been given access to my Google account to view and manage data in BigQuery.

888
fmejohn93
Contributor
vxn43
Supporter
vxn43Supporter
asked in Transformers
How to view/extract List from ChangeDetector?

I am using FME Form 2025 and the ChangeDetector to identify differences in records from two tables with the same schema. I have ChangedOutput create List(s) named “Changes”. What Transformer do I need to connect to the Inserted and Deleted Ports to get a look at the Lists? 

666
veschwab
Contributor
daniii
Contributor
daniiiContributor
asked in Transformers
Write 2D lines in IFC4x3

One of the greatest new features of the IFC4x3 schema is that we can write 2D lines to IFC, which was not supported in IFC2x3.Why does the new IFC writer support only 3D surfaces and solids and not 2D line geometries? 

1009
daniii
Contributor
iii4625
Contributor
iii4625Contributor
asked in Transformers
IFC_API Reader in FME 2025.1.1 fails to read features, reads Types only

Hello,I am currently learning how FME handles IFC HVAC structures and have been using some sample files from the RWTH-E3D DigitalHub repository (https://github.com/RWTH-E3D/DigitalHub) for my tests.While doing this, I'm having trouble getting FME to read all the features and their geometry correctly. The IFC file itself appears to be valid, as it displays correctly in an external IFC viewer like BimVision. (filename: DigitalHub_FM-HZG_v2.ifc)Here you can see the full HVAC system with pipes, tanks, pumps, etc.However, when I bring it into FME, I get incomplete results, and the behavior is different depending on the version I use.1. With FME(R) 2025.1.1.0 (Build 25615):The reader fails to read most features. The feature count for IfcPipeSegment, IfcTank, IfcPump, etc., is 0. The FME Inspector confirms that nothing is read.2. With FME(R) 2025.0.3.0 (Build 25241):This older version is partially successful:It correctly reads features like IfcPipeSegment and IfcTank with their geometry.Howev

471
desiree_at_safe
Safer
tsirkuse
Contributor
tsirkuseContributor
asked in Transformers
Troubleshooting ArcSDE Feature Updates: Workflow Runs Fine but Data Not Changing on Specific Layers

Hi everyone,I'm working on a workflow that writes/updates features to an ArcSDE database using FME. The process completes successfully without any errors or crashes. However, I've noticed that for certain tables, the geometry (and possibly other data) is not actually updated in the ArcSDE database.I'm fairly new to ArcSDE and would appreciate any guidance on what might be causing this issue. Specifically, I’d like to understand: What table properties or configurations could prevent updates from being written, despite a successful translation? Are there permissions, versioning, or schema-locking issues I should be aware of? This is a non versioned table but the writer only works if I select versioned. Archiving is activated for the specific table. Is there a difference in how certain tables are registered with the geodatabase that could affect write operations? Any tips on how to investigate this further or best practices when working with ArcSDE and FME would be greatly appreciated

182
hkingsbury
Celebrity
gbcfgeo2025
Contributor
gbcfgeo2025Contributor
asked in Transformers
Download multiple orthophotos from the web using a CSV file

Hello everyone, I would really appreciate your support.I have a CSV file that contains a column named "LINK" (file attached), which includes the URLs to download orthophotos (.tif).I’d like to understand how to download them all using FME: How should the HTTPCaller transformer be properly configured? Is it necessary to create an attribute to assign a name to the orthophoto files? Could someone share an example script or workflow? Thank you very much for your help and support!

211
hkingsbury
Celebrity
sbnikkou
Contributor
sbnikkouContributor
asked in Transformers
InlineQuerier Fails When One Input Port Receives No Data in FME Form 2024.2.1

Hi all,I’m encountering an issue with the InlineQuerier transformer in FME Form 2024.2.1 (pre-production environment) that seems to differ from previous behavior.(FME Form 2024.1.3 in developement environment)🔧 Workspace Setup:The InlineQuerier has two input ports:tubes (can sometimes receive no features)parametre_generique (always receives data)I’m using this request :❗ Problem:When no data arrives at the tube input port, the transformer throws the following errors:InlineQuerier_2 (InlineQueryFactory): Generating output 'tubes_statuts_inactifs' using query 'SELECT * FROM "tubes"WHERE (    UPPER("statut_administratif") NOT IN (        SELECT TRIM(UPPER(value))        FROM "parametre_generique",             json_each(                 '["' || REPLACE("valeur_parametre_text", '|', '","') || '"]'             )        WHERE code_parametre = 'STATUT_ADMINISTRATIF_RETENU_TUBES'    )    OR    UPPER("statut_operationnel") NOT IN (        SELECT TRIM(UPPER(value))        FROM "parametre_generiq

927
desiree_at_safe
Safer
B
bharat
asked in Transformers
Migrating Dimensions from AutocAD to ESRI

Hi All,I am trying to migrate Dimensions from AutoCAD to ESRI. But while doing so, i get an error "An error occurred while attempting to set the 'DimensionShape' property on the 'IDimensionFeature' interface for the dimension feature class 'PD_ServiceDim100'. The error number from ArcObjects is: '-2147220936'. The error message from ArcObjects is: {The coordinates or measures are out of bounds.}". I have assigned the coordinate system in dwg. I have tried by normally migrating the Dimension as well as re-projecting the same, but am getting the same error. To test, whether the coordinates are correct or not i placed a point feature in the same and was successfully able to migrate (without reprojecting) it to a point feature class in GDB. Not sure, whether any attribute is creating a problem for Dimensions. Any ideas ?

1465
evieatsafe
Safer
ares
Contributor
aresContributor
asked in Transformers
TIF to ECW: Keeping nodata value on ECW

I want to transform a geotiff to an ecw while removing the nodata. The geotiff has just one band (band 0: Gray8). I do not have a clipper, so I think cannot use option 2 or 3 mentioned here, but only the first: use a rasterbandnodatasetter.So I used a rasterbandnodatasetter to set 0 as nodata, but when writing to the ECW this is not retained and still a black border is shown around the georeferenced image.What should I do to remove it definitely? 

101
ares
Contributor
david_r
Celebrity
david_r
asked in Transformers
FME Transformer most in need of some TLC?

About once or twice a year I have to dig out the SystemCaller, mostly just because I have to trigger a PowerShell command or script file. Without fail, I end up frustrated by the byzantine syntax (quotes galore) and limited way to capture output, finally succumbing to unnecessarily re-implementing the whole thing in Python.So my pick for the transformer that really needs some love and attention from the developers is the good-old SystemCaller :-)Do you also have a pet peeve Transformer that you think could be improved upon?

35538
chriswilson
Enthusiast
willydevera
Contributor
willydeveraContributor
asked in Transformers
Transformer that reads PAGX layout file

Hi, Just wondering: Is there a transformer that reads Esri *.pagx layout file? Greatly appreciate your help. Thanks, Willy 

141
j.botterill
Influencer
wrijs
Contributor
wrijsContributor
asked in Transformers
replace points with a symbol (line geometries)

I have a point dataset representing the locations of streetlights. I want to replace each point with a small line drawing that symbolizes a streetlight. This symbol is stored as a set of line geometries and can stay line geometry.I suspect I may not be using the correct approach, but here’s what I’ve tried so far:I used a GeometryExtractor to extract the line geometry of the symbol, and a GeometryReplacer to apply that geometry to each point. This almost works — however, instead of placing the symbol at the location of each point, the points are being moved to the location of the symbol. As a result, I end up with over 4000 symbols stacked on top of each other at the original symbol location.I’ve included an image of my workspace to illustrate the issue. 

784
wrijs
Contributor
deanhowell
Influencer
deanhowellInfluencer
asked in Transformers
Oriented Bounding

I have a building footprint layer that I am using an oriented bounding box transformer (blue line) and trying to keep the result as close as possible to the original polygon (black line) but for some reason the bounding box is getting squeezed out of shape.  Does anyone have any suggestions as to why the bounding box is not aligning better?I am using it to try and automate the georeferencing of a CAD drawing and using the AffineWarper with lines that come from the corners of the bounding box. I am using the long side angle in the bounding box to rotate the CAD drawing, which in this example is still correct but the length of the long side is incorrect which puts out the affine points and scale calculation.  This is a case where the footprint is a basic rectangle but there are many cases where the footprint is an irregular shape.      

433
deanhowell
Influencer
francisco_1988
Contributor
francisco_1988Contributor
asked in Transformers
dynamically define the data type

 I have an Excel spreadsheet that serves as a data dictionary. After reading a shapefile in FME Workbench, is it possible to use this spreadsheet to dynamically define the data type of each field in the shapefile?

551
takashi
Celebrity

Badge Winners

  • English Speaker
    jamatsafehas earned the badge English Speaker
  • Student (Grey)
    hdnguyenhas earned the badge Student (Grey)
  • Teacher (Grey)
    hdnguyenhas earned the badge Teacher (Grey)
  • FME Certified Professional
    rune.van.sevrenhas earned the badge FME Certified Professional
  • English Speaker
    nasirhas earned the badge English Speaker
Show all badges

Community Stats

31,788
Posts
120,751
Replies
39,405
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.