Skip to main content

Transformers

Using transformers to modify data.

  • 12,947 Posts
  • 51,689 Replies
10000 Posts
norris
Contributor
norrisContributor
asked in Transformers
How to serve folder/files created by SystemCaller (python) in FME Flow?

I am using SystemCaller to run a pyton script (uses conda env) that creates a bunch of files and I am trying to figure out how I can get FME to then read the folder location and serve that to the user as a .zip file. The folder location is an attribute that I use to pass to SystemCaller but I cant figure out how to pass this attribute value to say a FileCopy or even a FeatureReader. The output folder is a concatonated path $(FME_WORKSPACE_DIR) + _output that I made as a new attribute value (_output_folder). In the pic below, I tried to connect the Logger to FileCopy but that doesnt seem to do anything here is the FileCopy settings i am using. Am I doing this correctly or any other suggestions?

90
norris
Contributor
tb09114
Supporter
tb09114Supporter
asked in Transformers
How to transpose an attribute table?

I need to transpose an attribute table and tried so far the StatisticsCalculator as well as the AttributePivoter, but do not get the result I need. In addition I was following the advice of Mark (@mark2atsafe​ ) in this posting at StackExchange. While the advice from mark looks 'straight' forward, I struggle with the reader-as-resource since the data are produce through analysis within the workspace where I need to transpose the attributes. After sorting my results I get the following attribute table and what I need is a structure like So, the attribute values from the 'label' column have the provide colum names, while 'Area_perc' has to provide the corresponding values for these columns, and everything is grouped by 'Sectorname'. How can I achieve that within FME?

4964
pgammie
Contributor
sijmensp
Contributor
sijmenspContributor
asked in Transformers
stringcasechanger upgrade

Currently I am testing the upgrade of FME Form 2024 (from FME form 2022) for my electrical company. When doing auto-update I found out that my stringcasechanger set on lowercase were updated to UPPERCASE. The same behaviour occurs when you update the transformer manually and choosing the default setting. It would be better if it can take over the old setting.

463
jovitaatsafe
Safer
agelfert
Contributor
agelfertContributor
asked in Transformers
VertexExtractor not working in FME 2024.2

As mentioned in another post, I'm currently upgrading a bunch of workbenches to run on FME Flow 2024, some of them many years old. Typically, for anupgrade, I will go through each workbench, upgrade all transformers, readers, and writers, then run it in test desktop (workbench) environment, then publish to and test in a test server (flow) environment. In, FME 2024 the Vertex Extractor gives me bogus results, even after upgrading all the constituent transformers in this custom transformer. It looks like X and Y, or Lat and Lon, are reversed. When I open the CoordinateConcatenator (arrow above), I see this: Default setting While I haven’t dug through the rest of the custom transformer, this - frankly - looks counter-intuitive. When I change that to “XYZ”, everything runs just fine and results are as expected. My tweak I have tried to compare my version (I’m assuming that upgrading all components makes it uptodate) to older versions to see whether upgrading might have introduced this prob

797
DanAtSafe
Safer
ryan_k
Contributor
ryan_kContributor
asked in Transformers
Updating M measures

I have been able to extract polylines from esri fgdb, combine the lines into one record but I cannot seem to figure out how to now recalculate all the M-measures in that line. In arcmap I would manually use the Route Measure editing tools, Set As Distance to 0 and Apply Factor of 0.00018939 to recalculate the line M-measures in miles for the line. I couldn’t seem to get the measure transformers to get the result I was looking for. This was probably user error. Thanks, Ryan

222
ryan_k
Contributor
hnahoulder
Contributor
hnahoulderContributor
asked in Transformers
Attributes key and value to list

Hello, I need your help. I'm looking for a workflow to transform my keys and values into a list. Here is an example: I have this table: Key Value a 1 b 2 c 3 a 4 b 5 c 6 a 7 b 8 c 9 and I wanna transform it to a b c 1 2 3 4 5 6 7 8 9 Thank you

463
hnahoulder
Contributor
riplizard
Contributor
riplizardContributor
asked in Transformers
Transforming heights (Germany)

I need to transform XYZ data from the currently used DHHN2016 height (EPSG:7837) to the older DHHN12 height (EPSG:7699). Unfortunately, the various transforming options don't seem to be able to do this. E. g. EsriReprojector, with "Use Vertical Transformation" checked, only lists <None> as option under "Vertical Transformation". To complicate things further, the switch to DHHN2016 did not happen directly from DHHN12, but first to DHHN92. So the transformation might need to be done with an extra step: DHHN2016 height (EPSG:7837) -> DHHN92 height (EPSG:5783) -> DHHN12 height (EPSG:7699). However there is no option for this way either. Perhaps a combination is necessary? In this case it would be 25832+7837 to 31468+7699 (or 25832+7837 -> 31468+5783 -> 31468+7699). I added the Reproject files to the install directory but that had no effect. I also don't have "PROJReprojector" available for some reason(?). Version: Data Interoperability Fixed OEM LicenseFME(R) 2024.1.2.1 (20240920 - Build 2

572
daveatsafe
Safer
katt
Supporter
kattSupporter
asked in Transformers
Define Categories based on values

Hello, I have a table with 3 records per house. The table includes hundreds of houses. I want to create a new attribute called Type. There are two types only : A and B. For Type A: two values of attribute a1 per house equal the value of attribute a2 of another record of the same house. For Type B: two values of attribute a2 per house equal the value of attribute a1 of another record of the same house. How can I automatically assign the type to each record of any given house? Thx.

603
takashi
Influencer
stinah
Contributor
stinahContributor
asked in Transformers
See if all attributes has value missing

I am downloadning data by several url from different organisation webpages that I later import to tables in a Microsoft SQL server database.I want to get the information if all the attributes that I exposed for a datasorce isn’t containing any values (the value is missing).Is it a way too choose all or multiple attribute at the same time and test if they contain any values?I have data that has like 50 attributes and it is going to take a long time to manually set like a test for each of this attribute individually.

1066
crystalatsafe
Safer
gogopotter90
Contributor
gogopotter90Contributor
asked in Transformers
How to avoid Manual X/Y Adjustments in PDF page formatter

Hello , Is it possible to control the position of Upper left x and Upper left y in a PDF formatter by setting their values in an attribute beforehand, so that the PDF formatter reads and uses them directly? I don’t want to keep adjusting the x and y positions directly inside the PDF page formatter every time I find that the output is not properly aligned. Do you have any tricks or suggestions to help me arrange my PDF layout more quickly?It takes a long time to design the PDF layout . Thanks in advance .

290
gogopotter90
Contributor
norris
Contributor
norrisContributor
asked in Transformers
How to pass an filename (from excel reader) to systemcaller (python script)?

I am fairly new to FME and I am trying to pass an Excel file pathname to systemCaller so I can use it in a Python script. I need to use the SystemCaller as I am using a bat file to change virtual environment and then call Python. What I am trying to do is get FME to just pass the Excel filename via a user parameter to SystemCaller using this statement "C:\temp\Excel_processing.bat" --input "$(excel_infil)" where excel_infil = “C:\temp\Excel_processing\infile.xls” But I get a “File path is incorrect” error in the logger (not in english, so the error is a translation). I have even tried to just hardcode the input filename to the statement but get the same error. I tried this: "C:\temp\Excel_processing.bat" --input “C:\temp\Excel_processing\infile.xls” If i just use the statement "C:\temp\Excel_processing.bat" in SystemCaller, then I dont have any issues and the .bat/python script works as expected but I need FME to pass the filename along. I have a bunch of echo statements in the .bat fi

151
norris
Contributor
valiiien
Participant
valiiienParticipant
asked in Transformers
Add creation date of file A as data in a new column of file B

I have a file A from which I am reading the creation date through a “Directory and File Pathnames Reader”. Now I want to add the date as data in a column of file B. It should look like this: ID path_created_date 1 2025-04-04 2 2025-04-04 I tried using AttributeManager, but what I get is this: ID path_created_date <missing> 2025-04-04 1 <missing> 2 <missing> I am very thankful for any other ideas or solutions.

282
valiiien
Participant
williamlin98
Contributor
williamlin98Contributor
asked in Transformers
Workspace process just stopping at 19%

I’ve been trying to process IFC data and convert it into a GDB format, however when running it will just stop processing at 19%. The workspace as worked with other IFC datasets but with a few of them it will stop at random arbitrary percentages too. Has anyone run into this issue before and is there a solution?

265
williamlin98
Contributor
javierml
Contributor
javiermlContributor
asked in Transformers
Custom Transformer - Input attribute values can't be exposed nor used on the prompt

Hello everyone I've been designing a new custom transformer to sum up part of my workflow (in FME Form 2025.0). The issue is that I can't add any of my attributes to the text editor even though all attributes are selected to be exposed in the input parametres. Moreso, If I edit it individually, no attributes appear (as obvious), but if I edit them inside a workbench session and I choose specific attributes to expose, they are still not availaible in the text editor, but they get instead automatically added as user parametres for the custom transformer. Can anyone explain me how this works? I don't get a clear answer from looking at https://docs.safe.com/fme/2025.0/html/FME-Form-Documentation/FME-Form/Workbench/Using_Custom_Transformers.htm#Editing_Input_Output_Ports It also irritates me that it’s theoretically a copy of another transformer with a couple of changes (only adding transformers or changing their parametres, none with the inputs) and that transformer allows to add feature at

904
javierml
Contributor
mk-det
Contributor
mk-detContributor
asked in Transformers
Unable to authorise Slack Connector due to unsupported browser

FME Form 2024.2.4 on Windows Server 2016 I’ve been using the SlackConnector transformer for quite some time to send messages when jobs have finished in both FME Form and Flow. It’s been working without fail for the past two years. Just recently we had to reinstall a few things on our VM which caused our user accounts to be wiped. This meant all our existing connections had to be recreated. Unfortunately I’m no longer able to create the webconnection in FME for Slack as it keeps failing on the authentication step telling me “your browser is not supported”. Slack stopped supporting older browser on 15 March 2025 I initially thought the default browser was causing issues so I set it again to Chrome, but I think FME Form must be running an in-built version of IE or something. I’ve also tried recreating to connection of various other machines running windows, but same issue. I can’t seem to find any way of forcing FME to use another browser. I saw on the FME known issues page a workaround b

432
mk-det
Contributor
koala_pond_03
Participant
koala_pond_03Participant
asked in Transformers
Looping a list to clip features

Hi everyone, can you please help me out with this one? I have a vector layer with canopy heights. For example: name, index0-1m, 01-2m, 12-3m, 23-4m, 34-5m, 4 As the features had been captured by LiDAR, they overlap each other. I am trying to clip the features to show max canopy heights, if that makes sense. 0-1m will be clipped by canopy heights >1m, 1-2m will be clipped by canopy heights >2m, 2-3m will be clipped by canopy heights >3m, etc. I don't understand how to set up a loop in a way that can filter and dissolve higher canopy heights. All feedback and suggestions are appreciated.

643
koala_pond_03
Participant
aguan
Contributor
aguanContributor
asked in Transformers
Is there a way to extract coordinate system from datasets to be standard ESRI coordinate system names?

I am using the CoordinateSystemExtractor to extract CRS from shape files. The output attribute _coordsys is an abbreviated name and hard to make use of it downstream. For example. the shape file prj file has the name “NAD_1927_BLM_Zone_15N”, which is an ESRI standard name. But the _coordsys value is _NAD27.BLM-15N.ft_0. I would hope the output is NAD_1927_BLM_Zone_15N so that I can use it directly in EsriReprojector. Any idea to achieve this? I have an excel file with over 150 global CRSs that need to reprojected to WGS 84. Both the sources and transformations in this excel file use standard ESRI names. Want to use this excel file to reproject all source datasets (shape files) into WGS 84 using just one EsriReprojector for which both the source and destination CRS parameters are set directly from the excel file. If you know a solution, please send reply to my work email - allen.guan@woodside.com. Appreciate the help.

325
aguan
Contributor
moustik
Contributor
moustikContributor
asked in Transformers
SQLExecutor in FME2024.1 doesn't show Geometry of PostGIS raster, in contrary with FME2023.1

Hello, I am currently working with some database PostGIS rasters and wanted to import some into FME 2024.1, using a filter to only select 2 out of 11030.To do so, I tried both a SQL Executor and a FeatureReader (as both enables PostGIS raster reading).The SQL Executor filters the rasters correctly but doesn’t create the geometry and returns an error in the log file.The FeatureReader loads the 11030 rasters without filtering, suggesting a problem with the “WHERE clause”. I tried the same thing using FME 2023.1 and the SQL Executor is working under this version. I am wondering if there is a bug in the FME 2024.1 version.The problem was the same for the Feature Reader.A colleague said that the Feature Reader outputs everything as well in previous versions of FME (2022.2 and 2021.1). Do you know when the FME 2024.1 bug will be corrected?We are linking our work with ArcPro and we know we will have to use FME 2024. I am enclosing a share folder with the different logs (as txt) and the 2 work

26614
saraatsafe
Safer
langley.select
Contributor
langley.selectContributor
asked in Transformers
Workspace temp files management

I have a workspace that is moving 18million records between databases. Part of the translation involves updating geometry and reprojecting. I am running the workspace WITHOUT the option to cache features; however the GeometryReplacer transformer seems to be writing quite a bit of data to memory (expected) and that is not purged (reading 100k features at a time). Because it’s not cleaning up itself, the workspace is just erroring out because it’s running out of disk space. I can stop the translation and update the start feature number to continue, but this is cumbersome. Any ideas how to fix this so I can run this unattended?

9816
nielsgerrits
VIP
andrej
Contributor
andrejContributor
posted in Transformers
TesseratCaller partially broken - potential fix

Hi, The TesseractCaller appears to be partially broken at the moment. It sometimes doesn’t return all words from the OCR process and the results aren’t transformed correctly to fit on the page. I suspect that this is the results from Tesseract having been updated since the release of the transformer. See the images below as documentation. Where the existing TesseractCaller produces 38 word results from my input image and the fix produces 81. (This difference is the result of a listexploder rejecting features not containing a list, so nothing has been changed about how FME interacts with Tesseract) The results are also correctly flipped and scaled in FME to match the input image. I have supplied the fixed transformer as a zip to this post. Differences: Before, text is missing, scaled incorrectly and flipped from the image After, all text is included and correctly aligned with the image

81
hkingsbury
Celebrity
lifalin2016
Contributor
lifalin2016Contributor
asked in Transformers
2024.2 yields an error in SharepointOnlineConnector ?

Hi. I built a workspace in 2024.1, that fetches a number of files from a customer Sharepoint site. It works (in 2024.1) without problems. I just installed 2024.2, and ran the workspace (with no changes). Now it issues an error with a SyntaxWarning from the package “safe.microsoft-sharepoint”: C:\Users\xxx\AppData\Roaming\Safe Software\FME\Packages\24783-win64\python\safe.microsoft-sharepoint\stringcase.py:247: SyntaxWarning: invalid escape sequence '\W' return re.sub("\W+", "", string) Is this something that I should worry about ? SharepointOnlineConnector is not listed as an upgradable transformer in 2024.2 Cheers.

15816
sfb
Contributor
Z
zacharylee1204
asked in Transformers
How do I create "points" and import to 3ds max

Hello Sir/ Madam, So I have a .txt file with Points Name, X, Y, Z. So I would like to create points and import in 3ds Max. My .txt table is as follow Point X Y Z A 822041.761 833958.234 13.519 B 821997.708 833954.943 16.341 I create points by using vertex creator transformer. Then I convert to .dxf and import to 3ds Max. It works fine. However, all the points are named "Point" in 3ds Max. Is there anyway that I can use the Point name "A", "B", etc instead of point? Other formats is fine, as long as I can get the coordinates and point name. Hope somebody can give me a hand. Thank you.

633
risamon
Participant
G
gisgis
asked in Transformers
How can I read everything from File GDB except one feature type ?

I am reading some feature types from File GDB as "Single merged Feature Type". One of these feature types while reading is giving me an error saying "Read feature (or portion thereof if SPLIT_AT_ARCS is YES) from the feature class 'xxxyyy' that contains only zero length segments...." How can I read all feature types but ignore this one which is causing error or maybe any Idea how to solve the error problem ? p.s. In different Databases there can be different feature types thats why I am always reading everything but trying to exclude one which name is always the same. Any Idea ?

1827
gwn
Participant
philiqq
Contributor
philiqqContributor
asked in Transformers
Error when using GoogleCloudStorageConnector on MacOS

Since the last update of the GoogleCloudStorageConnector (on 26.03.2025, safe.google-cloud-storage [2.5.0]), it no longer works.I always get this error message: Message Type: fme::internal::_v0::py::Exception Python Exception <TypeError>: JSONConnection.api_request() got an unexpected keyword argument 'extra_api_info' Error encountered while calling method `input' GoogleCloudStorageConnector_CALLER (PythonFactory): PythonFactory failed to process feature I am using FME 2025.0.0 with Python 3.13 on a macOS Sequoia (15.3.2).Except of the transformer update nothing has been changed.The error does not appear on Wondows with the same FME settings.

233
jbradfor
Contributor
mr_fme
Enthusiast
mr_fmeEnthusiast
asked in Transformers
remove duplicates values from Excel

Hi, I have one column in my excel file that show tha values like below: VARIEDADE ABB4, ABB2, ABB4, ABB5 ABB4 ABB2, ABB5 ABB2, ABB2 ABB4, ABB4, ABB4, ABB4 The two last lines have the same value separated by comma. I would like to simplify like below: ABB2 ABB4 How Can I do this? Thank´s

403
devbyisty
Participant

Helpful Members This Week

Badge Winners

  • Teacher (Grey)
    oskarhas earned the badge Teacher (Grey)
  • Welcome Back
    pgammiehas earned the badge Welcome Back
  • Welcome Back
    casperroelofshas earned the badge Welcome Back
  • Student (Grey)
    oskarhas earned the badge Student (Grey)
  • Welcome Back
    marloeshas earned the badge Welcome Back
Show all badges

Popular Tags

Community Stats

31,080
Posts
117,833
Replies
38,837
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.