Using transformers to modify data.
Recently active
Greetings everyone,I have a large number of 2D polygons for which I want to determine the Z value. I also have a DTM (digital terrain model).Now I have observed the following: If I take only one polygon and, using the FeatureReader, read in only exactly those triangles of the DTM that are touched by the polygon in 2D, and then determine the Z values of the polygon using the SurfaceDraper (always carrying forward only z_max and using that as the Z value via the 3D_Forcer), I get different Z values than when I first create a buffer around the polygon and then pass the buffer to the FeatureReader and include the triangles around the polygon in the SurfaceDraper.The triangles from the DTM do not touch each other.There are deviations of several meters, depending on how strongly the terrain height varies around the polygon.It seems as if the SurfaceDraper somehow takes the surrounding terrain into account, even if it does not touch the polygon.It cannot be due to the tolerance; I have alread
Oh no, I put my question into the wrong Category (Community Q+A). I cant move the thread.Sorry for the double posting, but it seemed, that in the Q+A category is nobody who can move my thread (or?).So I post this one here with the link to my wrong settet Post.
Hello,I am testing out the Esri ArcGIS Feature Service writer that is in the Esri ArcGIS Online Connector package (Esri ArcGIS Connector v3.13.2). I’m using Form 2024.2.2.0 (20250114 - Build 24820 - WIN64). Screenshots are edited to remove confidential information. I have noticed that the “Target WKID” cannot be left blank even if you have selected “Feature Service Handling: Use Existing” If I am understanding the documentation correctly, this parameter is only needed if the writer is creating a Feature Service. However, as the default is set to WKID 102100, if you don’t change this to the correct WKID, it will write the data out to the wrong location. I initially made this mistake before I realized I had to input my data’s WKID. For the old Esri ArcGIS Portal Feature Service Writer, you were able to leave this parameter blank: I think this parameter being a required parameter is unnecessary when Feature Service Handling is set to “Use Existing” and I like the way it was in the older w
hi everyone! some of my line features (pipes) have text features floating above (top left) of the line, describing what type of pipe it is. I want to add that text as an attribute field to that feature. but also not all of the lines have one and I want it to only match if it's describing that feature (not grabbing a random text field nearby). I'll also note that everytime I've tried to use neighborfinder, the autocad_text_string AND fme_text_string values of lines show numbers (ex. 356.77, 623.44) instead of the descriptive text it should have shown. I've been trying this for hours and would appreciate any help given. thanks in advance!my workflow is: DWG Reader → Attribute exposer → Feature joiner1 CSV Reader → Duplicate filter → Feature joiner1 Feature joiner1 → Deaggregator → 2D forcer → Geometry filter → point/text & lines Point/Text → Tester (if fme_type = text) → Attributemanager (create new attribute field: final_textstring, set to @value(autocad_text_string) & dele
Hi,In the headers section, it seems it’s mandatory to define the header parameter immediately.Is there any way to push a Json or a FME attribute to define a dynamic header to use?My issue is, the client API Rest has many methods with different header parameter. I’m trying to setup a custom transformer that will be able to handle dynamically the header to set. But it doesn’t seem possible to do it right now?Any workaround to achieve it?Regards,Jean
Hi FME Community,I’m working on a project where I need to create a 3D cone shape in FME 2025 and publish it to ArcGIS Online 3D viewer. The cone should:Start at ground level (let’s say Cape Canaveral X, Y, Z coordinates). Have a base radius of 500 m. Extend in a cone shape getting wider upwards at a 7° angle. Reach approximately 50 km into space (so it’s a very tall, tapered cone).I’ve tried using combinations of Creator, Taper Line Bufferer, Rotator, and SurfaceBuilder, but I’m struggling to generate the correct geometry and export it in a format that ArcGIS Online accepts (e.g., Collada, OBJ, or multipatch).Challenges I’m facing:Generating the circular base and apex points accurately. Applying the 7° tilt without breaking the geometry. Ensuring the output works in ArcGIS Online’s 3D environment.Has anyone successfully built something similar in FME?Which transformers or workflow would you recommend? Any tips for handling such large Z values (50 km) and coordinate systems? Variable in
Hi, I have a workspace in which I read features from different postgis tables and attach their schema with the FeatureReader.Then I want to write dynamically the features in a geopackage.When writing, the gpkg writer tries to use the fields defined as primary key in the schema, but sometimes I have several or the primary key is not an int as requested by the gpkg format.How can I easily delete the information on the primary key fields in the list attribute{} created by the FeatureReader ? I assume I have to delete if in the subattributes fme_data_type and native_data_type in the list.Furthermore, some features read contains id column, how to handle this to not interfere with the gpkg writer ? In the past there was an option in the writer to specify the name of the gkpg primary key.Maybe the creation of a gpkg_id field defined as Primary key is enough ? Thanks for any advice !P.S. : I use FME Form 2025.
I have a workspace where the DateTimeCalculator is failing for all records. The rejection code is always INVALID_INPUT. And yet, when I view the data in Inspector the two input fields I’m using both list as Date under Data Type. The dates look fine fine (e.g. - 20251216). It fails for any mode - Add or Subtract, Calculate Interval, etc. Any ideas why it’s failing and what I need to do to fix it? (FME Form 2025.1.0.0)
I have a schema JSON file that I want to use to validate various JSON files. What transformers can I use to perform this functionality? JSON Validator only validates syntax and not schema so what's the alternative for this?I have added pictures of the sample JSON schema and also the JSON file that needs to be validated against that schema.
Hi everyone!I’m learning about dynamic flows in FME and I’ve encountered two issues that I haven’t been able to resolve yet. I’m reading multiple .gpkg files from a folder, but in the output, all the data is saved in a single .gpkg file. I need FME to generate a separate output file for each .gpkg read. How can I set this up? When I insert the Attribute Manager and rename the attribute from acm_id to id, the values of that attribute (acm_id) turn null after the renaming, and the new attribute (id) does not appear in the final output file. Does anyone know how to prevent this from happening? Thanks in advance for any help or suggestions!
I have used a Directory and File Pathnames reader to generate an attribute holding file paths for the .xlsx files that I need to read in to my workbench. My plan was to use a FeatureReader to subsequently read these files in but I am struggling to get this to work.There are multiple worksheets in each .xlsx and I only need the contents of one - in all cases the applicable worksheet has the same name and an identical schema, the column headers are all on the same row as well.I haven’t been able to work out how to configure the FeatureReader as when specifying the dataset from an attribute the parameters to specify ‘Sheets to Read’ and ‘Field Names Row’ are not available.I would be very grateful for any advice - thanks in advance.
I’m currently updating all of our tools to a new input dataset. In the process, I’m relying on the transformers to tell me when there are issues with the new schema. The issue I have found is the TestFilter is not flagging these as Incomplete Transformers. Build is 25237, and all transformers are up-to-date.I want to believe I have seen this behavior on other transformers, but the TestFilter is by far the most prevalent case and has the potential to cause the most problems in our workflows.Is there a work-around to check for Incomplete Test Conditions? Original configurationWhen the connection is removed, the transformer does not become Incomplete. It’s only when you drill down into the Test Conditions that you see the issue.To rule out something weird going on with my workspace, I created a fresh test from scratch. The issue persisted here as well.
I have an existing process that processes versioned views from an ESRI SQL Server Geodatabase to another SQL Server Database creating SQL Spatial tables with a geometry column that I have reprojected to WGS84 Lat Long. Can I add a second geometry field to the SQL spatial tables and populate that column with Web Mercator geometry? I am trying to figure out a single workflow that would calculate both columns in the same table. Or am I restricted to calculating one geometry column at a time in separate processes?
Hi, I have set the spike remover to 3D dimensions to read 3D solids however everything is being rejected due to - ‘Invalid Geometry Types’. Any ideas?
Hello, I am struggling with using the ArcGIS Attachment Connector to upload multiple attachments in an ArcGIS Online Feature ServiceI am able to add one attachment but for some reason it will not add multiple photos. This is for a Survey123 that I set up an automation in FME Flow with webhook to add certain features to a hosted feature layer in ArcGIS Online. It runs fine, adds the data, but the moment there is more than 1 photo that needs to be attached, it only uploads 1 photo. Any advice would be greatly appreciated. Thank you!Edit: This works perfectly fine on the workbench (it will add all attachments) but when I try to run it on flow, it will only add 1 attachment. I do receive the following error message: 158 2026-1-2 10:50:31 | Message Type: fme::internal::_v0::py::Exception 159 2026-1-2 10:50:31 | Python Exception <TypeError>: Unknown output tag 'Output' passed into pyoutput() 160 2026-1-2 10:50:31 | Error encountered while calling method `input' 161 2026-1-2
FME Form 2025.1SQL Query in SQLExecutor: SELECT * FROM table_name WHERE ID BETWEEN $(polystart) AND $(polyend);Oracle tableWorks fine in DBeaver with actual ID numbersFails in FME with actual ID numbersFails in FME with User Parameters for the numbersError Message:Execution of statement `SELECT * FROM table_name WHERE ID BETWEEN 35480 AND 35484;' did not succeed; error was `ORA-00933: SQL command not properly ended'.Does FME just hate a BETWEEN statement?Going mad trying to figure out where I am going wrong 😂
I try to find a text ending with a newline. Using the inbuilt regular expression editor (with the regex #! <DATASET\n) shows a result so the regex looks correct to me:StringSearcher unfortunately doesn’t find the line: (see attached workbench)Where are things going wrong?
!--startfragment>I want to find the deltas from A(users are editing) & B(for analysis) environments and want to update the deltas in B environment on daily basis. My workspace created as below ESRI feature class from A as rader and same feature class from B as readers, thenNoFeaturesTester - If the database disconnected or any reason to unable to read the sources, it will terminate the process through "NoInput" port from both A & B readers, thenChangeDetector - This will finds the DELTAS from A & B and will update B feature class based on GLOBALID Configured 22 feature classes as above in one workspace. Want to execute this process one after feature class after one feature class, like FeatureClass1 -- Reader A > Reder B > NoFeaturesTester A > NoFeaturesTester B > ChangeDetector > Writer, thenFeatureClass2 -- Reader A > Reder B > NoFeaturesTester A > NoFeaturesTester B > ChangeDetector > Writer, thenFeatureClass3 -- Reader A > Reder B &g
Hey all, I currently have a workflow in place to pull a list of files from an SFTP server, download the latest file, and rename it with a .csv extension (the files do not have extensions by default). This process works fine, my problem is when I try to pass this value onto the systemcaller transformer, it seems to just run the workspace in the systemcaller without reading the updated file, which is problematic. I am taking the _downloaded_file_path from the FTPCaller, and adding “.csv” to it, so that it reads the file. (There is a separate transformer which replaces the file with a file of the same name to add .csv). In the workspace logs, it looks like SystemCaller is interpreting this literally as Filename + ‘.csv’ and that file does not exist. Code to run the workspace has this in it: -SourceDataset_CSV2_4 "@Value(_csv_path)" --FME_LAUNCH_VIEWER_APP "YES" Couple of perhaps dumb questions… does the SourceDataset_CSV2_4 need to be changed to _1 or something? Or is there an issue wi
I have a process in FME and I want to send an email with the Emailer transformer at the end. I've already written in the email body the data I want to appear in the email, but the problem is that I want to send it in plain text format and not in HTML. The Emailer transformer always wraps my text in HTML, even though I already changed it to FME's format; it seems that every time I exit the transformer to run the process, it doesn't save the text settings in the transformer. Does anyone know how to change this?
I’ve been struggling with the File Geodatabase Open API FeatureWriter in FME. When I create a new file geodatabase from scratch, everything runs successfully. However, when I switch the FeatureWriter to Drop and Create, I encounter random failures with the error:Geodatabase Error (-2147467259): General function failureHere’s my setup:The workbench consists of a series of Oracle SQLExecutors that read each table, followed by a FeatureWriter to convert the data into feature classes in the file geodatabase. I originally used a dynamic workspace, but after seeing this error (and reading advice to limit the number of features processed dynamically), I changed the design so each table is processed in series. The failures occur at different FeatureWriters each time, so it’s not tied to a specific table. I tried using Truncate instead of Drop and Create (since truncating is better for avoiding file locks), but it was very slow, so I abandoned that approach. As a workaround, I check for lock fi
Hi, The workbench to convert the File geodatabase to CAD was working until the FME/ArcGIS upgrade. The workbench is now not writing many line features with the following warning The following feature is not valid because its entity type of 'fme_no_map' and its geometry type of 'IFMELine' do not match. The geometry failed to be converted to match the type, so the feature will be skipped. Warning : Attribute(string; UTF-8) : `autocad_entity' has value `fme_no_map' FME version : FME(R) 2025.0.0.0 (20250228 - Build 25208 - WIN64) How can this be fixed? ThanksSresree
I have a raster broken up into a grid of raster cells using RasterTiler. I want to rotate each cell X degrees (not the whole raster) in place. I do *not* want to rotate around the upper left corner. I need the cell to rotate and remain in the exact location.As I understand it, my process is using the following transformers:RasterCellOriginSetter: Set to 0.5,0.5 (the center) Rotator: Set Rotation Angle to X. RasterRotationApplier: Interpolation Type = Bilinear.When I do this, the cells are rotated around the upper-left corner rather than the centroid.Do I have the correct transformers & settings for this application?
I need to take hundreds of thousands of connected 3D faces in DWG files and write them to separate IFC files, where each IFC file contains a single surface made up of the multiple 3D faces in each DWG.I have a working solution to accomplish this without merging the surfaces but it is very resource heavy and creates large IFC files, about 10x as large as the DWGs. Using SurfaceModeller accomplishes what I want, however the resulting TINsurface is extrapolated along the entire circumference of the combined features which creates geometry that doesn’t exist in my source data. How can I merge the surfaces without changing them?My workspace:
Hi all,Got a strange situation with the SharePointOnlineConnector (both in FME Form 2024 & 2025.2).I want to upload a file towards a certain sharepointsite. In the GUI I can select my site: ‘https://mysharepoint.com/teams/teamA, my library and my Path. If I want to make my site dynamic, so File A needs to to go site from TeamA and File B needs to go to site from TeamBI’m not able to do this. User Parameter does not work. Making the url like this: https://mysharepoint.com/teams/@teamValue does not work → Even for the File for TeamB it still refers to the site from TeamA (or whatever team I selected to create the workspace).Even using the setup of getting the <HostURL>,<siteID>,<webId> provided from attributes: It still points towards the old setup and not a dynamic one. Am I missing a certain step? the used Authentication account has rights towards the sharepoint (setup via this guideline: How to Create a SharePointOnlineConnector Single Tenant Web Connection – F