A space to discuss FME Form
Recently active
Hello,I have an FME 2018.1 tool that updates an ArcGIS Online-hosted feature service (Writer Mode: INSERT, Truncate First: YES). The feature service has about 15,000 parcel polygons. Typical changes: a dozen or so new polygons per month, a dozen to a hundred attribute table changes per month.The tool/transformers all work when attempted on a local geodatabase feature class. Therefore I am able to rule out transformer problems. But when the tool runs on AGOL-hosted feature services sometimes it works. Other times it fails and returns these various errors: - The error code from the server was '504' and the message was: 'Your request has timed out.'- The app domain with specified version id (xxxx) was unloaded due to memory pressure and could not be found- Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was '('Connection aborted.', error(10053, 'An established connect
Hello,So we have some workbenches (FME 2018.1.1; 20181203 - Build 18578 - WIN64) that either read or write to AGOL after performing a bunch of operations on the data. These workbenches were working fine up until a week ago, when all of a sudden they started throwing a very generic 503 error message and failing completely.If I understand correctly, a 503 means it's a server side error (so it's likely something with ESRI), right?We've been having issues with our organization's ArcGIS Online portal for the last couple of days (layers being randomly dropped from maps, apps refusing to load) and I'm starting to think that their December 2018 AGOL update messed some things up, including the way FME's readers/writers communicate with it. Is anyone else having trouble working with AGOL lately?Thanks!
Today I'm breaking my rule of never manually (or automatically) editing a workspace file, in order to dynamically update a choice-type user parameter.Question of the WeekThis question was asked by @philippeb who needs to send a list of names to a survey choice field. Q) Our employees fill a weekly survey about their health and their kids going to summer camp activities.The survey [fields] change in time, depending on the kids that subscribed. The subscribed kids are exported into an Excel file every week. I thought to read the file with FME and push the kids into the survey every week. That way the list of kids in the survey could change without our help. And the kid (or his parent) could select his name to fill the survey.The issue is that we don't know any survey platform able to change automatically from a script. Do you know if any kind of platform could change when FME pushes new values into it?A) I know of a platform that could be used to provide a weekly survey: FME Server! Aft
We are looking to set up an integration between Snowflake and ArcGIS Online and need some assistance with network security. We've found that ArcGIS Online encrypts all traffic to and from through TLS 1.2 or later with AES256. We also found that Snowflake operates in the same manner. This would mean all web traffic to and from both data sources and the FME Flow server would be secure through the above protocols, correct?
Just want to check I’m not missing something obvious.I want to dissolve some polygons and then aggregate distinct areas into multipolygons. One of the attributes of the original polygons needs to be concatenated into a single line with no duplicates. Fairly simple with a list builder/listduplicateremover/listconcatenator if i was only using the dissolver. But if i want to get combine attributes from both processes it seems unnecessarily complicated without resorting to python (which only requires a couple of lines). Am I missing an easier way to do this?StartEnd
I’m working on a flood-affected buildings project in St. Pauli, Hamburg, using FME’s SpatialFilter transformer. I uploaded an image of my setup (see attached). Almost all buildings are being rejected, and I’m not sure why. My buildings are the "generic object" and flooding areas are the clipped ones
Hi there,Input data:list with numerous entries, sorted, with changing name excerpt: name from to 947606 2041.020 2045.574 947606 2045.574 2055.574 947606 2055.574 2065.574 947606 2065.574 2079.880 947606 2079.880 2083.168 947606 2083.168 2089.880 947606 2089.880 2099.880 list with ‘exceptions’ excerpt: name from to 947606 108.459 108.747 947606 2070.204 2074.543 947606 6071.987 6100 Goal:I need to find ‘matching’ rows, where from(1) <= from(2) AND to(1) >= to(2) [colored lines].What I already tried:I already attached the second list as an list attribute to every single line to the first list (FeatureMerger) and than tried to find the matching line with two ListSearchers. This is limited as the ListSearcher only finds “First ...”.Can somebody help?
Hello,I would like to perform queries on a branched electrical network composed of sections interconnected according to the current direction. However, the "TopologyBuilder" and "NetworkTopologyCalculator" transformers facilitate this task, but have limitations regarding the manipulation of downstream sections. For example, I have the entity "i" and I want to collect and query the values of the entity "i+1" (by analogy with the "for" loop in Python), then "i+2", etc.Do I have to use Python development, or are there other, simpler solutions?Thank you in advance for your valuable assistance.
I’m connecting a Sharepoint dataset to a portal dataset, with the intention of creating geospatial data in portal, each record having an object-id along with geometry. The Sharepoint record would be manually linked via this object-id, and then FME would sync changes of related columns.My question is which transform (there are so many!) makes the most sense, and how can I limit the updates to only those records that have a matching object-id?In my writer, the upsert action exposes a match column config, but the update action doesn’t. I feel like I’m missing something, as an update statement still needs something to match on.
I’ve reached the workflow stage, but I can’t proceed further. I’m trying to extract multiple tables from a PDF file. I’ve been following https://support.safe.com/hc/en-us/articles/25407564475277-Extracting-Text-and-Tabular-Data-from-PDF#h_01HW3Z9Z37Q33NQQ7R0XBGEVB0, but the structure of my PDF is quite different.I only want to extract the tables—nothing else. In my case, the table has titles on the right and content on the left. I used the StringSearcher to extract the titles, since they are easier to identify (usually one word).The challenge now is that I can’t extract or separate the content, as it’s made up of long sentences that are mixed with the titles. I'm looking for a solution to: Separate the content from the titles Structure the extracted data into table as the source data
I’m hoping to use a DTM service provided by the Environment Agency to extract the height for locations I have (points or polygons I haven’t decided yet). They provide WMS, WCS, WMTS, OGI API: LIDAR Composite Digital Terrain Model (DTM) - 1mI believe it’s the WMTS I want, it has the elevation data layer within it. https://environment.data.gov.uk/spatialdata/lidar-composite-digital-terrain-model-dtm-1m/wmts?request=GetCapabilities&service=WMTS&version=2.0.1My plan was to use a WMTS reader, and the PointOnRasterValueExtractor to get the heights for the points I supply.I can’t even seem to read in the WMTS data, because I’m not putting in the correct parameters?I’m not sure what format I need, or if it even matters for what I’m doing – vnd.jpeg-png8 seems to be the most versatile so that’s what I’ve been trying? Not sure what the Tile Matrix means? The different zoom levels, but I don’t know how I’d know what I need? I obviously don’t want to read in the entire WMTS service, so I
Hi, I am trying to run a custom python code that uses QGIS library in PythonCreator. However when I run the code I get this error:Python Exception <ImportError>: DLL load failed while importing _core: The specified procedure could not be found.I tried everything, I followed the documentation/manual how to setup custom python interpreter, I tried to setup dependencies and environment variables but none of that worked. Can someone tell me what am I doing wrong? Thanks!
I want to run a batch process to load a series of file-based datasets in a folder, do some simple transformations and export each to a database table. The workspace in the image below is run by a workspace runner. The complication is that each source has some standard columns and an unknown quantity of additional columns, which need to be loaded into the database as a new table. If I configure the workspace with one source file, the schema config will not be correct for another file. How can I set the schema definition to be dynamic? I’ve been researching the subject but have not found the answer.
when I am using AnchoredSnapper Reader Cad civil Writer : oracle spatial Anchor : arcsCandidate : pointsSnapping Type : vertex Snapping it working fine Anchor : arcsCandidate : pointsSnapping Type : Segment SnappingTolerance zeroerror ORA-13347: the coordinates defining an arc are not distinct same Snapping Distance in both Why does this error occur when using Segment Snapping, The anchor is not supposed to move even with the Segment Snapping selected
Hi all,I’m trying to create clean cutouts (like donut shapes) from overlapping polygons in FME.For example, lets say I have four geometries A, B, C, and D, with each progressively larger and fully containing/overlapping the smaller ones. I want to subtract the inner shapes from the outer ones (e.g. D minus C, B, A; C minus B, A; etc.) so that only the ring-like areas remain. I’ve previously used the AreaOnAreaOverlayer with overlap counts to determine hierarchy (e.g. a shape with 1 overlap is the largest, and one with 3 overlaps is the smallest, so I can then figure out what is what).However, this approach breaks when some of the smaller shapes are missing. I still need the output features to retain their original attributes (e.g. A, B, C, etc.), regardless of which shapes are present. For example, shape A might be missing, or both A and B but you’d never have A and C without B. So I need a method that can still produce correct results even when some of the smaller shapes aren’t ther
I am building a workbench that has a GeoTiff Reader, and uses the RasterPropertyExtractor and CoordinateSystemExtractor transformers to report on various qualities of the input image. The bounds, the cell sizes, etc.I am hoping for a transformer that reports on the compression method of the input image. LZW or JPEG or something else?Something similar to CoordinateSystemExtractor but instead a CompressionExtractor
I thought I had a good idea to simplify our in-house processes by using FME Form startup python script to use subprocess.run to run external python files. That way we wouldn’t need to copy all the python code into the startup script and could easily make changes to it.Unfortunately, it doesn’t seem to work.subprocess.run FME Form runs the python script, but errors with “ModuleNotFoundError: No module named ‘boto3’. The python script itself works fine when run manually. It also works when copied into the FME startup section (in other words, boto3 runs successfully in both).But for some reason, running subprocess.run within FME Form will not find boto3 in the external python file (even though it works if the python code in is the startup script section of FME Form).I hope that description made sense. Is there a parameter for subprocess.run that I’m missing? Is there another way to run an external python file from FME startup?Software and Settings:FME Form version 2023.2.3.0 (20240313 - B
So I was testing the 2025.1 Beta and was curious to try the new DocumentPDFStyler after seeing it mentioned in Seattle a few weeks ago at The Peak of Data and AI 2025. This caught my eye and I cannot find anything about this new “Safeguard”. What is it and why are the run icons disabled and not the same as other transformers (ex: Run from this, run to this...)?
Since version 2025, we've had warning messages in the log file when we start the Workbench via batch call. When we start the Workbench manually, we don't see these warning messages. How can we disable them? Is there an FME parameter for this?Example Reader-Warning (see red columns):2025-06-02 13:14:05| 5.0| 0.0|INFORM|Executing metadata query: 'SELECT f_table_name, f_geometry_column, coord_dimension, srid, type FROM geometry_columns WHERE f_table_schema = 'public' AND f_table_name = 'example_for_fme''2025-06-02 13:14:05| 5.0| 0.0|INFORM|spatialColName: -> 'geom'2025-06-02 13:14:05| 5.0| 0.0|INFORM|spatialColDim: -> '2'2025-06-02 13:14:05| 5.0| 0.0|INFORM|spatialColSRID: -> '2056'2025-06-02 13:14:05| 5.0| 0.0|INFORM|spatialColGeomType: -> 'POINT'2025-06-02 13:14:05| 5.0| 0.0|INFORM|spatialColType: -> 12025-06-02 13:14:05| 5.0| 0.0|INFORM|authority query:2025-06-02 13:14:05| 5.0| 0.0|INFORM|select auth_name, auth_srid, srtext from spatial_ref_sys where srid = '2056'2025-06
I am merging incoming attributes in Aggregator. I concatenate the values from a field but I am getting duplicate values. How do I create a cleaner attribute without duplicates?
Hello, I have an AGOL Hosted Feature Layer that contains Fire Hydrants. There are 5,000 points.I want to update from a File Geodatabase with new Fire Hydrants. There are 5,004 points (meaning there are 4 new hydrants that do not exist in the Hosted Feature Layer).In the AGOL Feature Service Writer (highlighted in blue in the screenshot), to update this Hosted Feature Layer, would I use INSERT in Writer Mode? I want to upload only the 4 new Fire Hydrants to the Hosted Feature Layer from the Fire Geodatabase, thus preserving the existing records in the Hosted Feature Layer. Would I use Truncate Yes or No?
Hi community, does anyone know how I can convert a LAS file into an RCP point cloud file using FME?
Hello, I have a field consisting of two lines:Line 1: (empty space) String1 (empty space) String2 (empty space) String3 (empty space)Line 2 : (empty space) String5 (empty space) String6 (empty space) String7 (empty space) String8Both lines exist within the same field.My objective:If I choose to keep, for example, **String1** from Line 1 and **String5** from Line 2, then all other strings in their respective lines should be replaced with empty spaces.Alternatively, if I choose to keep **String3** from Line 1 and **String7** from Line 2, the rest of the strings in each line should become empty spaces.In short, I want the ability to retain specific strings from each line while replacing all others with empty spaces.example : Thanks in advance
Hello,I have recently upgraded from fme flow 2024 to 2025.0.1. - (still using fme form 2024 for now)(EDIT: I have since aligned the versions between form and flow, and still getting the same error.)I have a workbench which uses the SharePoint online connector transformer I am currently using python version 3.12+.I can run this workbench without any errors on fme form 2024, but when uploaded to fme flow 2025 I am getting the following issue: Any tips on how to resolve this?Thanks.
I created models in QGIS Desktop. These models repair geometries of lines and polygons. Now I want to reduce the working steps, so that the data gets directly repaired in FME. Does anyone has experience in that?