Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,685 Replies
10000 Posts
susannel
Contributor
susannelContributor
asked in Transformers
FeatureWriter with Dynamic Schema Definition using JDBC does not work as expected

Hi all,I am fairly new to FME. What I wanted to implement I was able to figure out with the community here or the trainings at the Safe academy. But now I struggle as I do not understand, where my mistake is.Goal: I need to write features with a dynamic schema. So, I added via Readers a “Reader as Resource”. It is an Excel file from where I want to use a specific sheet. There a added my columns which shall be written to my target source. Writing a FFS file works as expected by using the following configuration.One important note: a sheet in excel has a limitation for the name. As I need to create a dynamic workbench which can read different source files and handle a different amount of dynamic columns per source file, I want to name it like the feature type - but shortened to what Excel can handle.Dynamic Schema Definition configured and working As I need also to write the same data to an EGDB, I use the JDBC format - with the same configuration:  This does not work as expected. I have

374
susannel
Contributor
angwan
Contributor
angwanContributor
asked in Transformers
SystemCaller to BinConverter(MapInfo)

I need to run a mapinfo data converter to convert tab file to map info bin. Wondering how to configure SystemCaller to run MapInfoDataconverter.exeI’m using version 2025.1 of FME. MapInfoDataConverter is an executable specifically aiming at RouteFinder / Drivetime BIN routing files, which is different from normal TAB export when using FME to write standard MapInfo TAB/BIN files (NativeX format).

443
j.botterill
Influencer
tiffany_deq
Contributor
tiffany_deqContributor
asked in Transformers
Reconcile and Post Branch Versions

Hello!Has anyone successfully used the ArcGISBranchVersionManager transformer to automate reconcile and post operations for branch versioned layers? I created the web connection to our enterprise portal and tested it as specified in this article and even connected to my version, so I know the web connection works but when I configure the ArcGISBranchVersionManager transformer to use the same feature layer with my version I get a rejected feature with this message: “`fme_rejection_message' has value `stopEditing failed for session {xxxxxxxxxxx}: The ArcGIS REST API returned an error: HTTP Error Code:  : 'The workspace is not being edited.' Message Code . Further details: '[]''”.  It seems like maybe I’m not configuring the workspace correctly but I don’t see any option to  start an edit session.  Below is the screenshot of my workspace. I am at FME(R) 2024.2.2.0 (20250114 - Build 24820 - WIN64) .Thanks! 

546
tiffany_deq
Contributor
doug_herrick
Contributor
doug_herrickContributor
asked in Transformers
The object at location ___ was previously deleted and cannot be retrieved from the Object Stash

When running an old script in FME 2024.1.1.0 we get 58 errors “The object at location ___ was previously deleted and cannot be retrieved from the Object Stash” (see attached log file).  It doesn’t appear to affect the output, the log file says “Translation was SUCCESSFUL” and CPU and Memory usage don’t get close to 100%.  Can we ignore these errors?This is part of a much larger script but only this part is producing the errors. We updated the transformers and saved the script to FME 2024 but still get the errors at the transformer FeatureJoiner_13.  The only way to not get the errors is to run the script up to the 2 preceding transformers (“Run to this”) and then run FeatureJoiner_13.  The output appears to be the same as when we were getting the errors.  We tried adding in FeatureHolders before FeatureJoiner_13 but still got the errors. ByeDoug

1866
geomancer
Evangelist
hasant1973
Contributor
hasant1973Contributor
asked in Transformers
XSD Driven XML Writer and _XML_FRAGEMENT_

Hi, I’m using XSDDrivenXMLWriter to write very dynamic XML to a file. There is one part of the xml with a lot of features that is very static and contains always the same data like origin and publisher… I don’t want to create all the 30 features with the XSDDrivenXMLWriter for this static part and thought I could use the _XML_FRAGMENT_ feature and 3 attributes like xml_fragment, xml_document_append_path and xml_document_append_as to tell the XSDDrivenXMLWriter to add my static xml to the output. But somehow I can’t get it working.Can you please provide me an example workspace? Unfortunately I cannot provide my workspace because it is restricted by the customer.Many thanks. 

331
kailinatsafe
Safer
F
fazsnatch
asked in Transformers
Pick up Latest File from Folder Location

Hi,Newbie type question. I am currently loading in files to a output on a weekly basis. Issue has been I have to edit the file in the workbench with the new filename. The file I upload changes on a daily basis with its name. How can FME pick up the latest file that has been updated without having to change the file path on a daily basis?I have tried to use this https://knowledge.safe.com/questions/65203/read-only-the-newest-file-from-a-directory.html method but unfortunately I am not getting it to work. I also do not need to generate any further data to my existing table, just was interested in the function where it can automatically pick up the latest file at folder level by date modified. Thank You

56911
crystalatsafe
Safer
nicole.mcstay
Contributor
nicole.mcstayContributor
asked in Transformers
Transformer to identify parts of a boundary (line) that are supported by an underlying line feature

What transformer could be used to identify if a townland border which is lines, is supported by an underlying line feature and any areas that are supported to be extracted.

371
lambertus
Enthusiast
bush_walker
Contributor
bush_walkerContributor
asked in Transformers
KML - hyper-linking to photos on local drive (relatively)

Hi all,I’m having issues trying to generate links within a kml file to a photos in the same folder.First I generate the Hyperlink:<a href="@Value(fme_basename).jpg">@Value(fme_basename)</a> Then I use the KMLPropertySetter The link comes into Google Earth: But the link doesn’t work:\\img_2416.jpgNot sure why there are two extra slashes!  Weirdly if I copy and paste the link into outlook or even this post, the link works, but it doesn’t work when you click on it in Google Earth.  Please can someone help me with the syntax?  Thanks. p.s. I’m after a relative link so I can zip up the folder and send it on  

183
crutledge
Influencer
jonathan.spark
Contributor
jonathan.sparkContributor
asked in Transformers
FTPCaller - Protocols and algorithms for SFTP - follow up

 Hi there,This is a follow up question to one I asked last year around the FTPCaller transformer:Our security team granted a 12 month exemption to our FME workspace and have asked for an update on the issue.Is there any change in the ability of the FTPCaller transformer to be able to view or configuring the cryptographic algorithms used? Thank you,Jonathan

403
j.botterill
Influencer
markcoopersdc
Contributor
markcoopersdcContributor
asked in Transformers
S3 Connector

HiI have recently upgraded the OS of the machine FME Form runs on to Win Server 2022 and upgraded to FME 2025.1.1Since this, I have been unable to connect to amazon s3 and get the following message:S3Connector: The specified AWS connection does not have permission to perform the requested action (Key: '', Bucket: ''). Please check the connection parameters and the relevant AWS security settingsDoes anyone know what the issue may be? Thanks

231
j.botterill
Influencer
francisco_1988
Contributor
francisco_1988Contributor
asked in Transformers
AttributeExposer

How can I automatically add all attributes in AttributeExposer after AttributeTransposer without having to manually select each one?

949
pratap
Contributor
pmcpherson
Contributor
pmcphersonContributor
asked in Transformers
New error with H3HexagonIndexer?

I recently upgraded to version 2025.1.0.1 and am seeing an odd error with the H3HexagonalIndexer, as follows:H3HexagonalIndexer (H3IndexerFactory): The clause 'GEOMETRY_HANDLING_Filling_Indexes Replace' within 'FACTORY_DEF {*} H3IndexerFactory FACTORY_NAME { H3HexagonalIndexer } INPUT FEATURE_TYPE Creator_CREATED INDEX_OPERATION { Index } DST_ATTR { _h3index } GEOMETRY_HANDLING { Replace } H3_RESOLUTION { 15 } GEOMETRY_HANDLING_Filling_Indexes { Replace } DST_ATTR_Index { _h3index } OUTPUT { OUTPUT FEATURE_TYPE H3HexagonalIndexer_OUTPUT } OUTPUT { <REJECTED> FEATURE_TYPE H3HexagonalIndexer_<REJECTED> }' is not recognized by the factory 'H3IndexerFactory'Has anyone else experienced something similar?

685
pmcpherson
Contributor
msestherli
Participant
msestherliParticipant
asked in Transformers
Help Using CodedDomainGDB Custom Transformer to Create Domains Dynamically from Excel

Hi all,I’m trying to figure out how to use the CodedDomainGDB custom transformer in FME to create domains in an Esri Geodatabase dynamically from an Excel input.I understand that FME does allow creating domains, but it’s generally a manual process—similar to what you’d do in ArcGIS Pro—and Safe Software doesn’t recommend creating domain in FME. However, I’d like to automate this process as much as possible. Input: An Excel file containing coded domain values and descriptions.Goal: Take those Excel values and feed them into the CodedDomainGDB transformer to create or update coded value domains in an EGDB or FGDB.I’m not fully clear on how to structure the input features for the transformer so it produces the correct output. These are the references I’ve found:CodedDomainGDB documentation: https://hub.safe.com/publishers/spatialexjames/transformers/codeddomaingdbExample workflow blog: https://www.spatialex.co.uk/blog/automating-coded-domains-geodatabase/ If anyone has an example workspac

170
msestherli
Participant
deanhowell
Influencer
deanhowellInfluencer
asked in Transformers
Adding to report

I have a workspace runner that runs a process to do a rough geo-referencing of multiple CAD drawings using a base polygon layer where each polygon matches each drawing.At the end of each drawing, I want to create a simple report with a bunch of attributes and a map / image of the CAD drawing overlayed on my reference polygon to visually see how close it is.I have hundreds of these drawings and don’t want hundreds of reports / images. Is it possible to append a page to a PDF or HTML report after each iteration of the process?   

323
david_r
Celebrity
jackyd
Supporter
jackydSupporter
asked in Transformers
SchemaMapper missing Microsoft SQL Server database format

I am upgrading a workbench from 2022 to 2025, this is updating the Schema mapper from 2 to 3, but SchemaMapper version 3 does not appear to have Microsoft SQL Server as a format type. Am i missing something?SchemaMapper Version 3SchemaMapper Version 2 

282
jackyd
Supporter
francisco_1988
Contributor
francisco_1988Contributor
asked in Transformers
Formatting Problems with XML Output Header and Footer in FME

Hello, I’m new to this forum and have been working with ETL and FME Workbench for a short time.I’m facing an issue with my XML output: the header and footer formatting come out messed up.This formatting problem does not appear inside the XMLFormatter transformer, but after saving the physical file, the formatting issue becomes clear.Has anyone experienced this or knows how to fix it?

282
francisco_1988
Contributor
thijsknapen
Contributor
thijsknapenContributor
asked in Transformers
How to differentiate Empty String and <null> value in XQuery/XMLTemplator

Hi, I was wondering if there is a way in which it is possible to differentiate between an Empty String and a <null> value when using (XQuery in) the XMLTemplator. As an example I created 4 features. The first having a regular string value, and the latter 3 having 'no value', but each a different type of 'no value' (empty string, <null>, <missing>);When creating a dummyXML, I would like to be able to be able to handle/create a different 'b' element, based on the value of the attribute b. Let's say I have two fixed elements 'a' and 'c', and I want my dynamic 'b' element to be placed in between these two, then iterating over the different 4 features I would like to obtain the following result;<dummyXML xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">    <a>value_a</a>    <b>value_b</b>    <c>value_c</c></dummyXML><dummyXML xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">    <a>value_a</a>    &l

6956
thijsknapen
Contributor
ssmith_ftr
Contributor
ssmith_ftrContributor
asked in Transformers
JSONUpdater and JSONiq

I’m trying to make use of the JSONUpdater transformer since it seems more clear than doing a search & replace. My issue is I just can’t understand the JSONiq enough to know what I need to do to always find the right JSON Path. I’m reading in a JSON template and in this template are 3 objects at json[“flowcontents”][“processors”]. The problem is the order can change for the processors. I might want 0, 1, or 2. The key is the object # I want always has “name : Build-Parameters”.I’m thinking I have two options.Is there a way with JSONiq to always specify the correct JSON Path in the JSONUpdater, based on the name of each object. Maybe I sort the processors objects in the JSON prior to the JSONUpdater transformer. Then I always specify the correct one to find path. (Thankfully the order doesn’t matter when I push the results back.)I went ahead and made a very simple Workbench which demonstrates my JSON and the problem. Could someone help with either solution or maybe something else I d

514
ebygomm
Influencer
lance
Contributor
lanceContributor
asked in Transformers
Creating a new feature class in a GEODATABASE from an ARCGISFEATURES source fails.

I am using FME Workbench 2022.1 along with ArcGIS Pro 3.0. I recently noted an issue when copying data from an AGOL MapService to a local GDB - if the feature class does not exist in the GDB, the Workbench will fail, only reporting "Error running the translation" and no further details in the log file. However, if I create a feature class in the GDB, even without any attributes, and change the writer to "Drop and Create" from "Create If Needed," the Workbench runs. Any Ideas?  Log File attached 

2686
crystalatsafe
Safer
jacintasomers
Contributor
jacintasomersContributor
asked in Transformers
FME 2024.1 SharePoint Reader

I have a workspace created in 2023.2 that reads an Excel workbook from a SharePoint library. It is working perfectly.I have upgraded to 2024.1 and the reader no longer works as expected. If I use the 2024 Data Inspector I can connect to the workbook and see the data. The FeatureReader obtains the schema and the number of records in each sheet and gives a “Translation was SUCCESSFUL” in the log. The issue happens after that - I get some sort of (possibly) Python related error. Log file of messages after the successful log entry is attached.I have tried changing the Python version but it didn’t make any difference. Has anyone had the same issue or any ideas what I could try to get it working again. 

35623
clang
Contributor
messagemauri
Contributor
messagemauriContributor
asked in Transformers
Esri Feature Service Insert operation failing

In ArcGIS Pro, I have a published a map service as a feature layer service to our ArcGIS Portal. I have published it as the owner and Admin with enable editing permissions etc. The layer source comes from an SDE with SELECT, INSERT, UPDATE, DELETE privileges.In FME Desktop 2025.1, I have a FeatureWriter using the new Esri ArcGIS Feature Service format. I have it successfully connected to our Portal via OAuth (safe.esri-agol) and with the the writer settings for Feature Operation set to Insert and feature type handling set to Truncate Existing. See image below.When I run the workbench, after a period of time, it outputs back an error: ArcGISFeatureServiceWriter: Feature Service 'Sample Layer(7ea7230cca1f4aeb9316ed1735cca5c2)' does not support feature operation 'INSERT'. Its owner may have disabled inserting or editing features. Writes may fail if the current user is not the owner or administrator.This process used to work at some point when it was using the old format Esri ArcGIS Portal

240
messagemauri
Contributor
tp_atkins
Contributor
tp_atkinsContributor
asked in Transformers
Unable to connect to PostgreSQL database server - FME Form 2025.1 - No module named psycopg2._psycopg

We have a PythonCaller which uses the psycopg2 import statement and then uses the pgsql server parameters to connect to a pgsql server and create database ((eg: https://wiki.postgresql.org/wiki/Using_psycopg2_with_PostgreSQL). This works fine in FME Desktop 2021.1 and FME Server 2021.1Currently we are migrating to FME Flow 2025.1 and this caller fails when run in Flow (server) and local desktop in Form, both in 2025.1. The location of the psycopg2 package is in \Documents\FME\Plugins\Python folder in the local desktop. With same setting, it works in 2021.1, but not in 2025.1Have I missed anything?The specifc error is: No module named psycopg2._psycopg 

392
tp_atkins
Contributor
tsirkuse
Contributor
tsirkuseContributor
asked in Transformers
Copying folder structure only with FileCopy ?

Hello,I am looking for additional insights on File CopyIs it possible to copy folder structure without copying files inside ? How do I set the writer ? What is the filecopy_type parameter ? and what are it’s possible values ? The parameter exists on the writer but I can’t find any information.Thank you 

683
geomancer
Evangelist
bubblebeb
Contributor
bubblebebContributor
asked in Transformers
Emailer - Improve detection of HTML content in message body. (FMEENGINE-86584)

I have an emailer in a routine which has html content and it has been working fine for years. I have just updated the emailer package and it is now emailing all the html code to the recipient rather than rendering the email using the code. I noticed in the change log that this version has “Improve detection of HTML content in message body. (FMEENGINE-86584)” but it looks like it has less detection of HTML. has anyone else come across this issue and how to resolve it. There doesn't appear to be any guidance on how to manage this change in the package / transformer. 

453
alexbiz
Influencer
galigis
Enthusiast
galigisEnthusiast
asked in Transformers
Transpose Excel Columns & Rows / AttributePivoter

Hi All,I’m not able to transpose rows to column and complete a count in the end of the workflow, I have followed the technical article but couldn’t make it to work:https://support.safe.com/hc/en-us/articles/25407761369741-Transpose-a-Table-Using-FMEAlso below an screenshot of the requested output which a excel pivot table: Attached a sample of the raw table that needs to be transposed (or pivoted!)Can I achieve this with the AttributePivoter?Thanks 

393
lambertus
Enthusiast

Badge Winners

Show all badges

Community Stats

31,773
Posts
120,715
Replies
39,396
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.