Skip to main content

Transformers

Using transformers to modify data.

  • 12,940 Posts
  • 51,654 Replies
10000 Posts
williamlin98
Contributor
williamlin98Contributor
asked in Transformers
Workspace process just stopping at 19%

I’ve been trying to process IFC data and convert it into a GDB format, however when running it will just stop processing at 19%. The workspace as worked with other IFC datasets but with a few of them it will stop at random arbitrary percentages too. Has anyone run into this issue before and is there a solution?

20
williamlin98
Contributor
moustik
Contributor
moustikContributor
asked in Transformers
SQLExecutor in FME2024.1 doesn't show Geometry of PostGIS raster, in contrary with FME2023.1

Hello, I am currently working with some database PostGIS rasters and wanted to import some into FME 2024.1, using a filter to only select 2 out of 11030.To do so, I tried both a SQL Executor and a FeatureReader (as both enables PostGIS raster reading).The SQL Executor filters the rasters correctly but doesn’t create the geometry and returns an error in the log file.The FeatureReader loads the 11030 rasters without filtering, suggesting a problem with the “WHERE clause”. I tried the same thing using FME 2023.1 and the SQL Executor is working under this version. I am wondering if there is a bug in the FME 2024.1 version.The problem was the same for the Feature Reader.A colleague said that the Feature Reader outputs everything as well in previous versions of FME (2022.2 and 2021.1). Do you know when the FME 2024.1 bug will be corrected?We are linking our work with ArcPro and we know we will have to use FME 2024. I am enclosing a share folder with the different logs (as txt) and the 2 work

25314
saraatsafe
Safer
aguan
Contributor
aguanContributor
asked in Transformers
Is there a way to extract coordinate system from datasets to be standard ESRI coordinate system names?

I am using the CoordinateSystemExtractor to extract CRS from shape files. The output attribute _coordsys is an abbreviated name and hard to make use of it downstream. For example. the shape file prj file has the name “NAD_1927_BLM_Zone_15N”, which is an ESRI standard name. But the _coordsys value is _NAD27.BLM-15N.ft_0. I would hope the output is NAD_1927_BLM_Zone_15N so that I can use it directly in EsriReprojector. Any idea to achieve this? I have an excel file with over 150 global CRSs that need to reprojected to WGS 84. Both the sources and transformations in this excel file use standard ESRI names. Want to use this excel file to reproject all source datasets (shape files) into WGS 84 using just one EsriReprojector for which both the source and destination CRS parameters are set directly from the excel file. If you know a solution, please send reply to my work email - allen.guan@woodside.com. Appreciate the help.

213
aguan
Contributor
langley.select
Contributor
langley.selectContributor
asked in Transformers
Workspace temp files management

I have a workspace that is moving 18million records between databases. Part of the translation involves updating geometry and reprojecting. I am running the workspace WITHOUT the option to cache features; however the GeometryReplacer transformer seems to be writing quite a bit of data to memory (expected) and that is not purged (reading 100k features at a time). Because it’s not cleaning up itself, the workspace is just erroring out because it’s running out of disk space. I can stop the translation and update the start feature number to continue, but this is cumbersome. Any ideas how to fix this so I can run this unattended?

9416
nielsgerrits
VIP
andrej
Contributor
andrejContributor
posted in Transformers
TesseratCaller partially broken - potential fix

Hi, The TesseractCaller appears to be partially broken at the moment. It sometimes doesn’t return all words from the OCR process and the results aren’t transformed correctly to fit on the page. I suspect that this is the results from Tesseract having been updated since the release of the transformer. See the images below as documentation. Where the existing TesseractCaller produces 38 word results from my input image and the fix produces 81. (This difference is the result of a listexploder rejecting features not containing a list, so nothing has been changed about how FME interacts with Tesseract) The results are also correctly flipped and scaled in FME to match the input image. I have supplied the fixed transformer as a zip to this post. Differences: Before, text is missing, scaled incorrectly and flipped from the image After, all text is included and correctly aligned with the image

71
hkingsbury
Celebrity
lifalin2016
Contributor
lifalin2016Contributor
asked in Transformers
2024.2 yields an error in SharepointOnlineConnector ?

Hi. I built a workspace in 2024.1, that fetches a number of files from a customer Sharepoint site. It works (in 2024.1) without problems. I just installed 2024.2, and ran the workspace (with no changes). Now it issues an error with a SyntaxWarning from the package “safe.microsoft-sharepoint”: C:\Users\xxx\AppData\Roaming\Safe Software\FME\Packages\24783-win64\python\safe.microsoft-sharepoint\stringcase.py:247: SyntaxWarning: invalid escape sequence '\W' return re.sub("\W+", "", string) Is this something that I should worry about ? SharepointOnlineConnector is not listed as an upgradable transformer in 2024.2 Cheers.

15316
sfb
Contributor
riplizard
Contributor
riplizardContributor
asked in Transformers
Transforming heights (Germany)

I need to transform XYZ data from the currently used DHHN2016 height (EPSG:7837) to the older DHHN12 height (EPSG:7699). Unfortunately, the various transforming options don't seem to be able to do this. E. g. EsriReprojector, with "Use Vertical Transformation" checked, only lists <None> as option under "Vertical Transformation". To complicate things further, the switch to DHHN2016 did not happen directly from DHHN12, but first to DHHN92. So the transformation might need to be done with an extra step: DHHN2016 height (EPSG:7837) -> DHHN92 height (EPSG:5783) -> DHHN12 height (EPSG:7699). However there is no option for this way either. Perhaps a combination is necessary? In this case it would be 25832+7837 to 31468+7699 (or 25832+7837 -> 31468+5783 -> 31468+7699). I added the Reproject files to the install directory but that had no effect. I also don't have "PROJReprojector" available for some reason(?). Version: Data Interoperability Fixed OEM LicenseFME(R) 2024.1.2.1 (20240920 - Build 2

280
riplizard
Contributor
Z
zacharylee1204
asked in Transformers
How do I create "points" and import to 3ds max

Hello Sir/ Madam, So I have a .txt file with Points Name, X, Y, Z. So I would like to create points and import in 3ds Max. My .txt table is as follow Point X Y Z A 822041.761 833958.234 13.519 B 821997.708 833954.943 16.341 I create points by using vertex creator transformer. Then I convert to .dxf and import to 3ds Max. It works fine. However, all the points are named "Point" in 3ds Max. Is there anyway that I can use the Point name "A", "B", etc instead of point? Other formats is fine, as long as I can get the coordinates and point name. Hope somebody can give me a hand. Thank you.

613
risamon
Participant
G
gisgis
asked in Transformers
How can I read everything from File GDB except one feature type ?

I am reading some feature types from File GDB as "Single merged Feature Type". One of these feature types while reading is giving me an error saying "Read feature (or portion thereof if SPLIT_AT_ARCS is YES) from the feature class 'xxxyyy' that contains only zero length segments...." How can I read all feature types but ignore this one which is causing error or maybe any Idea how to solve the error problem ? p.s. In different Databases there can be different feature types thats why I am always reading everything but trying to exclude one which name is always the same. Any Idea ?

1797
gwn
Participant
javierml
Contributor
javiermlContributor
asked in Transformers
Custom Transformer - Input attribute values can't be exposed nor used on the prompt

Hello everyone I've been designing a new custom transformer to sum up part of my workflow (in FME Form 2025.0). The issue is that I can't add any of my attributes to the text editor even though all attributes are selected to be exposed in the input parametres. Moreso, If I edit it individually, no attributes appear (as obvious), but if I edit them inside a workbench session and I choose specific attributes to expose, they are still not availaible in the text editor, but they get instead automatically added as user parametres for the custom transformer. Can anyone explain me how this works? I don't get a clear answer from looking at https://docs.safe.com/fme/2025.0/html/FME-Form-Documentation/FME-Form/Workbench/Using_Custom_Transformers.htm#Editing_Input_Output_Ports It also irritates me that it’s theoretically a copy of another transformer with a couple of changes (only adding transformers or changing their parametres, none with the inputs) and that transformer allows to add feature at

692
javierml
Contributor
philiqq
Contributor
philiqqContributor
asked in Transformers
Error when using GoogleCloudStorageConnector on MacOS

Since the last update of the GoogleCloudStorageConnector (on 26.03.2025, safe.google-cloud-storage [2.5.0]), it no longer works.I always get this error message: Message Type: fme::internal::_v0::py::Exception Python Exception <TypeError>: JSONConnection.api_request() got an unexpected keyword argument 'extra_api_info' Error encountered while calling method `input' GoogleCloudStorageConnector_CALLER (PythonFactory): PythonFactory failed to process feature I am using FME 2025.0.0 with Python 3.13 on a macOS Sequoia (15.3.2).Except of the transformer update nothing has been changed.The error does not appear on Wondows with the same FME settings.

193
jbradfor
Contributor
mr_fme
Enthusiast
mr_fmeEnthusiast
asked in Transformers
remove duplicates values from Excel

Hi, I have one column in my excel file that show tha values like below: VARIEDADE ABB4, ABB2, ABB4, ABB5 ABB4 ABB2, ABB5 ABB2, ABB2 ABB4, ABB4, ABB4, ABB4 The two last lines have the same value separated by comma. I would like to simplify like below: ABB2 ABB4 How Can I do this? Thank´s

393
devbyisty
3d_ff
Contributor
3d_ffContributor
asked in Transformers
FME Python Script for Automated DDH Desurveying (Minimum Curvature, Flexible Intervals)

​@daveatsafe Dear FME Community, I am seeking assistance in developing a Python script for use within an FME workspace to automate the desurveying of diamond drill holes (DDH) using the minimum curvature method. I aim to create a flexible solution that allows users to specify a custom desurvey interval (e.g., 1m, 3m, etc.). Background: Desurveying a drill hole involves calculating the actual XYZ coordinates along its length based on the collar location and survey data (azimuth and dip at regular downhole distances). I've researched existing methods and found the following resources helpful: Understanding Drillhole De-surveying: https://seequent.zendesk.com/hc/en-us/articles/360001547955-Understanding-drillhole-de-surveying Desurveying Methods and Interactive Tool: https://endarthur.github.io/writting/desurvey.html Drillhole Desurveying Python Code (GitHub): https://github.com/WilliamsB39/Drillhole-Desurveying QGIS Geoscience Plugin: https://www.spatialintegration.com/processing-drill-h

303
3d_ff
Contributor
koala_pond_03
Observer
koala_pond_03Observer
asked in Transformers
Looping a list to clip features

Hi everyone, can you please help me out with this one? I have a vector layer with canopy heights. For example: name, index0-1m, 01-2m, 12-3m, 23-4m, 34-5m, 4 As the features had been captured by LiDAR, they overlap each other. I am trying to clip the features to show max canopy heights, if that makes sense. 0-1m will be clipped by canopy heights >1m, 1-2m will be clipped by canopy heights >2m, 2-3m will be clipped by canopy heights >3m, etc. I don't understand how to set up a loop in a way that can filter and dissolve higher canopy heights. All feedback and suggestions are appreciated.

492
takashi
Supporter
agelfert
Contributor
agelfertContributor
asked in Transformers
BUG? Dis/Enabling transformers within bookmarks - FME 2024

Working in FME Workbench (Form ) 2024.2. When I disable all transformers inside a Bookmark (via right-click => “Disable all Objects in Bookmark”) and then enable them again using the same method, those transformers are still all listed as ‘Disabled’ in the Navigator. FME “knows” they are enabled because the right-click now allows me to “disable” them. But this seems like a bug. How do you disable a disabled transformer?! Not a functionality issue but kinda annoying, as I’m upgrading a bunch of large workbenches and like to turn things on/off for testing.

371
hkingsbury
Celebrity
mk-det
Participant
mk-detParticipant
asked in Transformers
Unable to authorise Slack Connector due to unsupported browser

FME Form 2024.2.4 on Windows Server 2016 I’ve been using the SlackConnector transformer for quite some time to send messages when jobs have finished in both FME Form and Flow. It’s been working without fail for the past two years. Just recently we had to reinstall a few things on our VM which caused our user accounts to be wiped. This meant all our existing connections had to be recreated. Unfortunately I’m no longer able to create the webconnection in FME for Slack as it keeps failing on the authentication step telling me “your browser is not supported”. Slack stopped supporting older browser on 15 March 2025 I initially thought the default browser was causing issues so I set it again to Chrome, but I think FME Form must be running an in-built version of IE or something. I’ve also tried recreating to connection of various other machines running windows, but same issue. I can’t seem to find any way of forcing FME to use another browser. I saw on the FME known issues page a workaround b

301
hkingsbury
Celebrity
ecx
Contributor
ecxContributor
asked in Transformers
Unexpected Behaviour: Null Treated as a Number in TestFilter

I recently discovered that when using a TestFilter in FME, Null values are treated as numbers, seemingly to behave like negative infinity If someone is not aware of this (such as myself) this leads to incorrect output data. My expectation was that Null should be routed to the 'Unfiltered' port, rather than being processed as a valid numerical value. It is not even treated as zero, as it is in other applications/programming languages, which would at least have some logic to it. I am of the opinion that this issue has impacted MANY of your users who were unaware of this.If there are default options which can be set somewhere to change this functionality, the default should be to rout the null values to the unfiltered port. try it out for yourself:

302
ecx
Contributor
valiiien
valiiien
asked in Transformers
Add creation date of file A as data in a new column of file B

I have a file A from which I am reading the creation date through a “Directory and File Pathnames Reader”. Now I want to add the date as data in a column of file B. It should look like this: ID path_created_date 1 2025-04-04 2 2025-04-04 I tried using AttributeManager, but what I get is this: ID path_created_date <missing> 2025-04-04 1 <missing> 2 <missing> I am very thankful for any other ideas or solutions.

171
ebygomm
Influencer
galigis
Enthusiast
galigisEnthusiast
asked in Transformers
Neighbourfinder - One to one Relationship

Dear All, I am attempting to spatially join the nearest points based on a one-to-one relationship but cannot get it to work. Below is a graphical example of my query: I aim to join the closest yellow dot (627 records) to the nearest black dot (71,533 records). Essentially, I want the Neighbourfinder to identify the closest one-to-one relationship and disregard the others. The default settings of the transformer calculate the nearest points for all 71,533 records, which I wish to avoid. My objective is to integrate the information from the yellow dots into the black dots for only the 627 closest records. Any ideas? Thanks :)

475
galigis
Enthusiast
F
fentanyl
asked in Transformers
Each column value in separate row

I am new to FME and I wish to make the following transformation. From:IDColAColBColC1A1B1C12A2B2C23A3B3C34A4B4C45A5B5C5 To:IDColumnNameValue1ColAA11ColBB11ColCC12ColAA22ColBB22ColCC23ColAA33ColBB33ColCC34ColAA44ColBB44ColCC45ColAA55ColBB55ColCC5 Can anyone help me out?

214
drandall
Participant
kristen
Contributor
kristenContributor
asked in Transformers
Extend Lines to a Point

Hello Safers, I have a layer of tie points, and another layer of line segments. I was wondering how would get FME to snap segments to these tie points? I believe I have to use the line extender, and intersector without incorporating my tie points. Or, is there another way? Basically, I have roadcentrelines from various locales and I have to snap lines together from them to make an unified dataset. Thanks!

281
crutledge
Enthusiast
vxn43
Supporter
vxn43Supporter
asked in Transformers
Automatically change year in new attribute

I have a new attribute named EXPORT_YEAR. I want the Attribute Value to automatically change to 2026 at 12:00AM Jan 1, 2026. Until then it will stay 2025. Is this possible? if yes, what expression do I use?

271
takashi
Supporter
bromp
Contributor
brompContributor
asked in Transformers
Esri Portal Connection for Survey123ReportGetter

Hi there, I am trying to generate a survey123 report using FME. I have downloaded and added the custom Survey123ReportGeter transformer however I am using a portal connection instead of an AGOL connection: After this step i have the Tester that checks for the submit_response_body beginning with {"jobId" however the flow always fails here. I get an invalid token message in my submit_response_body: {"error":{"message":"498: Invalid token.","code":498},"success":false} I am not sure if the request URL needs to be different for portal? or if the token i am providing in my query string parameters is not being read in properly… Any help would be greatly appreciated. This is what my transformer looks like:

221
bromp
Contributor
armando_amador
Contributor
armando_amadorContributor
asked in Transformers
Saving images from data inspectors

Is it possible to save the frame of the data inspectors?I mean, I have this: Two layers overlapped Is it possible to save this image at certain zoom directly in FME from data inspector or the regular translation environment?

312
max_h
Contributor
colejo02
Contributor
colejo02Contributor
asked in Transformers
Organization's locator not working with Geocoder transformer

Hello FME Community, can someone help me configure the Geocoder transformer to use our County geolocator service? I’m using a single-line address, with the locator on an ArcGIS Server. The URL is https://gis3.montgomerycountymd.gov/arcgis/rest/services/geocode/Composite_Locator/GeocodeServer. This is a public-facing locator service for Montgomery County, MD. I’ve tried: Using the above URL Using the locator as an AGOl item in the transformer, both fail. Setting the URL with different paths to the operation or the base geocode folder. Setting the transformer geocoding service parameter as ArcGIS Server or ArcGIS Online. I can successfully use the geocoder transformer with the ArcGIS Global geocoder, but I prefer the County geocoder to ensure the addresses and intersections are within our County. All rows/addresses are rejected with the FME Rejection Code ERROR_DURING_PROCESSING. The County Locator Service works properly in ArcGIS Pro or when an address is presented to the Address Candid

222
colejo02
Contributor

Helpful Members This Week

Badge Winners

  • Student (Grey)
    williamlin98has earned the badge Student (Grey)
  • Teacher (Grey)
    williamlin98has earned the badge Teacher (Grey)
  • Welcome Back
    mcseamushas earned the badge Welcome Back
  • Socializer (Ice Breaker)
    cbrienhas earned the badge Socializer (Ice Breaker)
  • Conversationalist
    cbrienhas earned the badge Conversationalist
Show all badges

Popular Tags

Community Stats

31,044
Posts
117,693
Replies
38,824
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.