Best Answers

Good morning,I have a folder in an S3 bucket that contains a folder for each day of the year and each of those folders contain about 24 files. Since I need to download the data in order to process it, is there a way to only download the folders that contain the word “2025”?  I have not been able to format a wildcard that works for a folder. I could also potentially use a wildcard to select the files, if there is a way to do that.Thank you,Peter

I have a problem. I've built a workbench that allows me to dynamically pull in various data sources. This also pulls in lists, depending on the situation. But FME doesn't know anything about these lists. How can I expose them dynamically? I have an attribute that contains the list name. At the end I have to explode the list, edit it and reassemble it with the same name.Thanks for your supportMichael

Example of idea: 

Hello,So we have some workbenches (FME 2018.1.1; 20181203 - Build 18578 - WIN64) that either read or write to AGOL after performing a bunch of operations on the data. These workbenches were working fine up until a week ago, when all of a sudden they started throwing a very generic 503 error message and failing completely.If I understand correctly, a 503 means it's a server side error (so it's likely something with ESRI), right?We've been having issues with our organization's ArcGIS Online portal for the last couple of days (layers being randomly dropped from maps, apps refusing to load) and I'm starting to think that their December 2018 AGOL update messed some things up, including the way FME's readers/writers communicate with it. Is anyone else having trouble working with AGOL lately?Thanks! 

It is common knowledge that Flow has to be on the same server as ESRI ArcGIS Server for all the ESRI toys to function correctly.How does this work with a Remote Engine? If we have 2 servers, one with Flow and the other with ArcGIS Server, can we overcome the licencing issue by installing a remote engine on the ArcGIS Server machine?I see from this article Using FME Flow with Esri ArcGIS Software – FME Support Center that it states“ArcGIS Server must be installed and licensed on the same machine as the FME Flow Engine Service”, but what does this mean in practice…???? The “Flow Engine Service” means the main installation of Flow, rather than Remote Engine, yes? Any help will be warmly appreciated.RegardsStu 

Just want to check I’m not missing something obvious.I want to dissolve some polygons and then aggregate distinct areas into multipolygons. One of the attributes of the original polygons needs to be concatenated into a single line with no duplicates. Fairly simple with a list builder/listduplicateremover/listconcatenator if i was only using the dissolver. But if i want to get combine attributes from both processes it seems unnecessarily complicated without resorting to python (which only requires a couple of lines). Am I missing an easier way to do this?StartEnd  

Hello,I would like to perform queries on a branched electrical network composed of sections interconnected according to the current direction. However, the "TopologyBuilder" and "NetworkTopologyCalculator" transformers facilitate this task, but have limitations regarding the manipulation of downstream sections.  For example, I have the entity "i" and I want to collect and query the values ​​of the entity "i+1" (by analogy with the "for" loop in Python), then "i+2", etc.Do I have to use Python development, or are there other, simpler solutions?Thank you in advance for your valuable assistance.

I’ve reached the workflow stage, but I can’t proceed further. I’m trying to extract multiple tables from a PDF file. I’ve been following https://support.safe.com/hc/en-us/articles/25407564475277-Extracting-Text-and-Tabular-Data-from-PDF#h_01HW3Z9Z37Q33NQQ7R0XBGEVB0, but the structure of my PDF is quite different.I only want to extract the tables—nothing else. In my case, the table has titles on the right and content on the left. I used the StringSearcher to extract the titles, since they are easier to identify (usually one word).The challenge now is that I can’t extract or separate the content, as it’s made up of long sentences that are mixed with the titles. I'm looking for a solution to: Separate the content from the titles Structure the extracted data into table as the source data    

I’m hoping to use a DTM service provided by the Environment Agency to extract the height for locations I have (points or polygons I haven’t decided yet).  They provide WMS, WCS, WMTS, OGI API: LIDAR Composite Digital Terrain Model (DTM) - 1mI believe it’s the WMTS I want, it has the elevation data layer within it. https://environment.data.gov.uk/spatialdata/lidar-composite-digital-terrain-model-dtm-1m/wmts?request=GetCapabilities&service=WMTS&version=2.0.1My plan was to use a WMTS reader, and the PointOnRasterValueExtractor to get the heights for the points I supply.I can’t even seem to read in the WMTS data,  because I’m not putting in the correct parameters?I’m not sure what format I need, or if it even matters for what I’m doing – vnd.jpeg-png8 seems to be the most versatile so that’s what I’ve been trying? Not sure what the Tile Matrix means? The different zoom levels, but I don’t know how I’d know what I need? I obviously don’t want to read in the entire WMTS service, so I

Hi all,I’m trying to create clean cutouts (like donut shapes) from overlapping polygons in FME.For example, lets say I have four geometries A, B, C, and D, with each progressively larger and fully containing/overlapping the smaller ones. I want to subtract the inner shapes from the outer ones (e.g. D minus C, B, A; C minus B, A; etc.) so that only the ring-like areas remain.  I’ve previously used the AreaOnAreaOverlayer with overlap counts to determine hierarchy (e.g. a shape with 1 overlap is the largest, and one with 3 overlaps is the smallest, so I can then figure out what is what).However, this approach breaks when some of the smaller shapes are missing. I still need the output features to retain their original attributes (e.g. A, B, C, etc.), regardless of which shapes are present. For example, shape A might be missing, or both A and B  but you’d never have A and C without B. So I need a method that can still produce correct results even when some of the smaller shapes aren’t ther

I am building a workbench that has a GeoTiff Reader, and uses the RasterPropertyExtractor and CoordinateSystemExtractor transformers to report on various qualities of the input image. The bounds, the cell sizes, etc.I am hoping for a transformer that reports on the compression method of the input image. LZW or JPEG or something else?Something similar to CoordinateSystemExtractor but instead a CompressionExtractor

I thought I had a good idea to simplify our in-house processes by using FME Form startup python script to use subprocess.run to run external python files. That way we wouldn’t need to copy all the python code into the startup script and could easily make changes to it.Unfortunately, it doesn’t seem to work.subprocess.run FME Form runs the python script, but errors with “ModuleNotFoundError: No module named ‘boto3’. The python script itself works fine when run manually. It also works when copied into the FME startup section (in other words, boto3 runs successfully in both).But for some reason, running subprocess.run within FME Form will not find boto3 in the external python file (even though it works if the python code in is the startup script section of FME Form).I hope that description made sense. Is there a parameter for subprocess.run that I’m missing? Is there another way to run an external python file from FME startup?Software and Settings:FME Form version 2023.2.3.0 (20240313 - B

Hello, I have an AGOL Hosted Feature Layer that contains Fire Hydrants. There are 5,000 points.I want to update from a File Geodatabase with new Fire Hydrants. There are 5,004 points (meaning there are 4 new hydrants that do not exist in the Hosted Feature Layer).In the AGOL Feature Service Writer (highlighted in blue in the screenshot), to update this Hosted Feature Layer, would I use INSERT in Writer Mode? I want to upload only the 4 new Fire Hydrants to the Hosted Feature Layer from the Fire Geodatabase, thus preserving the existing records in the Hosted Feature Layer.  Would I use Truncate Yes or No?    

Hello,I have recently upgraded from fme flow 2024 to 2025.0.1. - (still using fme form 2024 for now)(EDIT: I have since aligned the versions between form and flow, and still getting the same error.)I have a workbench which uses the SharePoint online connector transformer   I am currently using python version 3.12+.I can run this workbench without any errors on fme form 2024, but when uploaded to fme flow 2025 I am getting the following issue:  Any tips on how to resolve this?Thanks. 

Can you help us complete this list of URLs used by FME? Some of our users work in environments with limited access to the internet and need to request access to specific URLs via a proxy . We are building a list of URLs used by FME and we are asking you for more input. Below are URLs we know FME may access in typical use. Are there other URLs you think we should add to the list? We will edit this list as answers come in.Of course, there is a multitude of web services you can connect to with FME using Web Connections and the HttpCaller transformer, and we don't want to add them all here. We are looking for URLs used by FME Workbench, standard FME readers and writers, and FME transformers. Please note: You can, of course, run FME without any internet access at all but you won't be able to use the FME Hub or access resources on the web.Workbench Startupwww.safe.com/ *fmestartup.safe.com/Help and docs:docs.safe.com/ FME Hubhub.safe.com:443**fmehubproductionopsworks-appstorage-c2mc0

Hello,Does anyone know how to create triangles between two 3D lines using FME tools? The triangles can also be vertical.

I am creating a PDF report in a PythonCaller and currently I am writing it into a subfolder of FME_SHAREDRESOURCE_TEMP.I would like to know where I have to write the file to be able to generate a download link for it.When I use normal writers than I reference the writer in the Download Service… but with a PythonCaller?

I have a HTTPCaller to access an API from the Dutch road service Melvin. It returns an attribute with the json including geometry (response_body - here renamed to ‘gegevens’). I am quite new to JSON.In order to extract the features I use 2 JSONFragmenters: one for the attributes and one for the geometry. I've tried many other setups with JSONfragmenters,-flatteners,-extractors etc, but I can't seem to find an answer as to how to get geometry and attributes from a json nicely joined back together.Current setup below. First I extract the geometry from the attribute (gegevens) and then from the same attribute (as the resulting attribute gets changed, thus I created another with the same information named gegevens_basis) by the fragmenter for the attributes. However it multiplies the number of attributes (700+ to 500,000+). Another setup (also below) sent all geometry to rejected. I also tried to do it from the same attribute from a junction but then I cant join then as I cannot get the id

Hi,i have an problem with the Oracle Non-Spatial (and Spatial) Reader / Writer.FME seems to have an issue when the password contains a section sign (§).Other special characters don't seem to cause any problems - at least dollar signs ($) and slashes (/) work.As soon as a § is included, the login fails.Version: FME Form 2024.2.1.0 (Build 24801)I tried with Named-Connection and with Embedded Connection Parameters.Maybe it is a similar problem as this post:Error Message:Creating reader for format: Oracle Non-SpatialCreating reader for format: Oracle Non-SpatialEnvironment variable ORACLE_HOME is not set.Connecting to ORACLE database `ABC' with user name of `CARLO_TEST' and password of `***'Error connecting to Oracle database: message was `ORA-01017: Benutzername/Kennwort ungültig; Anmeldung abgelehnt'. (serverType=`ORACLE8i', serverName=`ABC', userName=`CARLO_TEST', password=`***', dbname=`')Failed to obtain any schemas from reader 'ORACLE_NONSPATIAL' from 1 datasets. This may be due to

Question:Is there a way to speedup the geocoding process or an alternative approach like a diifferent Geocoding service people got good results from?Background of question:I have a dataset of 21.000 adresses and want to geocode them using the Geocoder.Geocoding Service: OpenStreetMapMode: FowardTo run the first batch of 500 adresses took approx. 10 minute to run which is not that fast to be honest.  

Hi, I use a FeatureReader for two purposes: to clip features with a polygon, and to select some desired geodatabase layers (of several geometry types: point, line and polygon).After the “succesful translation” the new geodatabase has been created. However, this database seems to be empty.What could be possible causes? Wrong Schema/Data Features of the FeatureReader? In the Reader I have:In the Writer I have:Connectiefile is the file where the polygon for the clipping purpose can be found. Other schema sources are not available.Any ideas?

​  TLDR: sys.path does not contain FME_MF_DIR, so I can’t directly import a local Python module. This contradicts FME’s documentation. What am I missing? Hi all,I’m having problems importing a local Python module located in the same directory as my FME workspace. Could you help me find out what the problem is or am I missing something?According to the PythonCaller documentation,FME will search both the standard Python module locations and the workspace location to find the module to be imported.However, when I try to import my module in <workspace directory>/feature_processor/__init__.py with the following code:from feature_processor import FeatureProcessorI get the following exception:Message Type: fme::internal::_v0::py::ExceptionPython Exception <ModuleNotFoundError>: No module named 'feature_processor'Error executing string `from feature_processor import FeatureProcessor'Factory proxy not initializedFeatureProcessor (PythonFactory): PythonFactory failed to process featu

I'm working with FME 2021 and have run into a challenge regarding dynamic GeoJSON handling.I use the HTTPCaller to retrieve GeoJSON from several hundred different services. Each service returns features with different attribute schemas. My goal is to dynamically expose all attributes and the geometry from each GeoJSON response and write them to various formats (e.g., GDB, Shapefile, etc.).I've tested workflows using JSONFragmenter and manually selected attributes, but this approach doesn't scale—it’s not feasible to manually configure the schema for hundreds of unique GeoJSON sources.Is there a robust and dynamic way in FME 2021 to automatically expose all properties (attributes) in each feature, regardless of schema, along with the geometry?Appreciate any guidance or best practices for handling this kind of dynamic schema in FME 2021.

I need to get from an Excel configuration file a parameter for the Buffer distance of a Bufferer transformer.What’s the best way to do this in order for the parameter to be accessible by the Bufferer transformer ?I have tried the VariableSetter and VariableRetriever transformers but what I don’t like about it is that I give the value to every feature that passes through VariableRetriever.Plus the VariableSetter/Retriever method doesn’t work well with cache.

Hello, I want to replace the list of attributes of the ChangeDetector with a user parameter. The attributes of the original and revised features are not exposed. The user parameter is in Python: it's a string derived from another parameter (example: 'field1 field2 field3'). I don't get any error but I guess values are not considered.I have the same problem​ with other transformers based on the same attribute list type (AttributeExposer).It is an issue or a problem with the string? Thank you