Data

Has anyone in the UK who is using the Ordnance Survey Maps API managed to get them added into FME for use as a background map.  I have tried and get nothing to display….Any advice welcome...

We are preparing to upgrade to FME Form 2025.  I am running a job in the 2024 and 2025 version to compare the output.  I have found that in 2024 the FeatureReader didn’t reject any records, but now in 2025 some records are being rejected.  FME(R) 2024.1.3.0 (20240927 - Build 24627 - WIN64)FME(R) 2025.1.3.3 (20251104 - Build 25648 - WIN64)The rejected records say:fme_rejection_message    buffer    Coordinate system does not match first feature's coordinate systemfme_rejection_code    buffer    INVALID_GEOMETRY_COORDINATE_SYSTEM Any thoughts on why the records fail in 2025 but not 2024?I will continue working backwards to see what is unique about these records.

Hello Hello,I would like to ask about Custom Transformers.I am a beginner and I am very confused. I have three questions.First question:When I input the value 345/1000 into a Custom Transformer attribute include field, it is automatically divided and get 0.345 as a result . I want to keep the value exactly as 345/1000.Even outside the Custom Transformer, the value is 345/1000. I understand that the Custom transformer is treating it as a number. I tried converting it to text before entering the Custom Transformer, but none of my attempts worked.@Text(@Value(attribute)) does not work.I also checked the shared parameter, and it is set as Text.and another issue if I have value 900 A , custom transformer read it as null .I do not know how to solve issuesSecond question:The Custom Transformer works correctly, but when I

FME Form Excel writer warns of reserved characters in the name of my Named range and appends an underscore to it. I am getting a lot of warnings similar the following:Excel Writer: Feature Type '/AH_4_3_Housed_Part_Time_Replacement' has been modified to '/AH_4_3_Housed_Part_Time_Replacement_' to avoid reserved characters for Named Ranges and Tables in Microsoft Excel   

Why does XML header of the FME generated file displays the XML header as <?xml version="1.0" encoding="UTF-8" > instead of <?xml version="1.0" encoding="UTF-8" standalone="yes"?>

Hi everyone,I have a geometry problem in FME and I’m not sure about the best workflow.In the image below, the red point belongs to a feature that is connected to a black point (the black point is the reference).What I need to do is: Take the line highlighted in green. Starting from the black point, find a position 10 cm along the line. Move (or recreate) the red point exactly at that location — meaning: the new point must lie on the line, and must be 10 cm away from the black point. I know the relationship between the red point and the black point from an ID attribute, but my problem is:How do I calculate this “point on line at 10 cm distance” inside FME?  

Hi, I updated a workspace from FME 2020 to FME 2025, and I have an error in 2025 that I haven’t in 2020, with the same input data.On the Excel writer, I get an error on a specific string regarding the validation as UTF-8.ERROR : XLSXW writer: The encoded string is not a valid UTF-8 string: 'S\x00u\x00r\x00 \x00c\x00h\x00a…….'Any idea why and how I can check the strings before the writer so it doesn’t stop the workspace with an error ?

Hi,I’d like to read a folder of documents and a set of points (say from a csv) and then join these together (filename of documents might match an attribute on the points), then write them all to an ArcGIS Online feature service with the documents as attachments.  I would ideally like to do this in one workspace and not have to hardcode anything.I don’t think this is possible without using one workspace to write the CSV to feature service, and then another to read it and add attachments using the ArcGISAttachmentCOnnector, as that requires the feature service URL, which may not be known at the time of creating the feature service.Thanks,Marc

When using the new ESRI ArcGis Feature Service I get this error when trying to write fme_aggregate geometry to AGOL: Python Exception <FMEException>: FMEException: 1: <class 'fmeobjects.FMEAggregate'> cannot be converted to esriGeometryPolylineWith the old writer I did not have this problem. Is there some solution for this? Deaggregating is not the solution i neede. The multi part geometry is only contaning lines. I have tried GeometryCoercer, but without effect. 

Using various recent versions of FME Form, I’ve discovered that a common key field that we use to join datasets on has a sloppy join when the FeatureJoiner Comparison Mode is set to Automatic.Since Automatic is the default comparison mode and the results are not at all what I would expect, I find this somewhat concerning. One needs to get into the data a bit to realize that the join is happening in a sort of loose/”like” fashion instead of a clean match.The key values are alphanumeric plus other characters such as a period or hyphen. As an example, on a subset of data, these are the record counts with the default Automatic comparison mode: And these are the record counts with the String comparison mode: 

Most efficient way to read folders of excel and constrain by a date range. each excel has the date field. Hi,I have a folder structure based on YEAR folders which contain MONTH folders which contain WEEK excel files. The WEEK excel files may contain date ranges which may go outside the month range of days.After reading all the necessary excels I  only want data of a whole month of days - e.g.  so all the days in January 2025 say.What would be the most efficient way to do this? For example there could be days at the start of January 2025 in the folder 2024, folder December.i’m not too familiar with where clause before and after and whether they would apply to excel data.Would inline sql be an efficient way?Or, as in my example, will I have to read in December 2024, January 2025 and  February 2025 before filtering to make sure i have all the days of January? Thanks for any advice.

Hi all,I have a workflow in FME where I need to iteratively buffer a feature and check for neighbours, until no neighbour is found.The logic I want is roughly this: Buffer the feature by 10 m Use NeighborFinder to check if any neighbour exists If a neighbour is found, increase the buffer by 5 m Check again with NeighborFinder Repeat (increase buffer by 5 m each time) Stop when no neighbour is found and output that feature So the buffer distance sequence would be something like:10 m → 15 m → 20 m → 25 m → … until no neighbour exists  What is the recommended way in FME to build this kind of iterative / looping buffer logic?  Thanks in advance!

I have images taken by a camera mounted on a vehicle, with GPS (4326) coordinates recorded every millisecond. I also have a road reference dataset in a shapefile (epsg :2154) and I need to match my millisecond-spaced images (and their GPS coordinates) to this road reference. There will obviously be some discrepancies between the GPS measurements and the reference dataset, but how can I best align the GPS data with the road reference? What is the best method to do this?If you’d like, I can also help you rephrase it more formally or technically.Thank you

My scope currently is to produce an excel output using FME ensuring the template is being leveraged to populate the values in this columns. Some of these columns have formulas which have been coded in FME as AK.formula if the column AK has formula. However when I convert the FME produced Excel to XML and investigated this, the formula seems to be converting “ into &quot. However I get to know about this only when I checked XML since Excel exactly imprints the formula as coded in FME. What is the best way to resolve this issue?

I have a field with city names and state names in this format:Oklahoma City OKOakland CADallas TXForth Worth TXAugusta ME  I want to do the following:Extract the City name into one field and the state abbreviation into another field. The only consistent pattern in the data is the state abbreviation always comes after the last space in the string. I think I need to create a RegEx expression to do be able to do this. Can someone help me with how do this? 

I'm trying to write AGOL features and attachments coming from a feature service tied to a Survey123 survey into a SQL Server geodatabase. I've looked through most of the tutorials and questions about this, but in my use case I need to maintain Global ID's on both the features and the attachments. The feature GlobalID's are being used to name photos that get stored in S3, so I can't use the examples that use a counter to create a new relational ID. I have set the "Maintain Global ID's" parameter on the AGOL reader and have exposed the AGOL attachment attributes. The attachments have a Global ID and Parent Global ID, and I figured it would be simple enough to use both of those to create the relationship class in the GDB since that's what the AGOL service is doing. When I query the service, I can see a feature's Global ID and the attachment's Global ID and its Parent Global ID (the GID of the feature it's attached to).

HiIs it possible to connect fme to a Microsoft Fabric Lakehouse? And read data?I use fme 2022.2 

We have multiple workspaces that write to ArcGIS Online with multipart geometries. The old ARCGISONLINEFEATURES writer works and correctly writes the geometries. The new (2025) Esri ArcGIS Feature Service Writer returns an error rejecting the features and the following warning:ArcGISFeatureServiceWriter: INSERT error for a feature in Project Stats by State. The error code from the server was '1000' and the message was 'Adding/updating geometries that result in SQL GeometryCollections is currently not supported (SQL Server performance).' Using a Deaggregator seems to fix this in most cases. However, we want to retain the multipart geometries. In other cases, I see a similar warning and the following error after using a Deaggregator:ArcGISFeatureServiceWriter: INSERT error for a feature in Terracon Offices Closest Areas. The error code from the server was '1000' and the message was 'Data is Null.

Recently upgraded a dev environment to FME Flow 2025.1.1We have some workspaces that use FileCopyWriters to move files.These workspaces still run on FME 2025 but now throw out a warning message for each fileThe move request details the correct move, but then there is a failed to delete message that appears to be saying it can’t delete from the destination not the source. The files are in fact deleted from the source, so it’s actually all working as it should be and as it did previously with the exception of these warning messages. I note that the FileCopyWriter now has a delete option so wonder if this is related somehow. Can anyone confirm they see the same behaviour in 2025.1.1.  The same warning error messages is seen in FME Form 2025.1

Hello fellow FME enthousiasts, We have been running into an issue when using the new Esri ArcGIS Feature Service [Writer] (from the new Esri ArcGIS Connector v3.13.2 package) to write to a Hosted Feature Layer on ArcGIS Online. The Hosted feature layer is created by Survey 123.Previously we used the old Esri ArcGIS Online (AGOL) Feature Service [Writer], since this won't be supported anymore in 2026 we started experimenting with the new one. When we try to update the hosted Feature layer with FME using the old one, all goes well, data gets written as expected and the geometry is visible.But when using the new one from the package we get a few warnings and no error's. The process tells us it's succesfull, we see the new records appearing in AGOL and the attributes seems to be as expected. The geometry is not visible either. When we try to zoom to a record nothing happens. When i open the layer in ArcGIS Pro nothing happens either when i try t

I’ve been trying to load some .nwds files, and they’re taking days to fully open. The files themselves aren’t very large—around 180 MB—but some of the geometry has extremely large coordinate offsets. For example, certain objects are located around X=10,000 and Y=10,000, while others are positioned near X=1,200,000 and Y=1,200,000. Could these large differences in coordinate magnitude be contributing to the slow load times?

Hi, I have a report i make where from the data i get out the following (where / separate's attributes)Field / SubField / YYYYMMDD / ValueX / ValueYFor the last date of the Subfield, i would need a line where Value X and Value Y are zero - the end date is specific to the Subfield. Is there a way to get it to reach - for Subfield - find last date - create +1M from YYYYMMDD with X and Y equal to zeroI know how i would do it in a excel macro, but i dont know how to replicate this in FME /Emma

I'm trying to use FME 2025.0 to create a GeoPackage tiles file. It should contain a few Norwegian raster products, such as N50, N100 and N250. The idea is to mimic the properties of the Swedish product “Topografisk webbkarta Nedladdning, raster”, in the sense that the Swedish product contains a single table in the gpkg file and it shows different raster data at different scales. I am having trouble recreating this with the Norwegian products. I´m stuck at creating a separate tables for each data set or a single table that only contains a single data set. This use case is not discussed at, for example, https://support.safe.com/hc/en-us/articles/37417604217357-Creating-OGC-Compliant-GeoPackage-Files#h_01JXXGG7338W04GD0DRBY7VJCV. Any help appreciated. Norwegian products: 

Hello, so we regularly download the whole catalogue of polygons for England, seen here:Dataset Download - Use land and property dataI would very much want to automate this as its a tedious task to manually download them all one by one, so I’ve investigated the calls that my browser makes when calling this data and it first sends a very simple call to very simple URL’s containing the Zipped data, as seen here:https://use-land-property-data.service.gov.uk/datasets/inspire/download/Amber_Valley_Borough_Council.zipWhich in turn takes you onward to a Amazon service that just gives you 60seconds to fetch the data, as seen here:

I’ve been trying to read a layer that has 16.1 million points and 7 fields into FME Form.  After 10-12 minutes I get the following long-winded 504 error:ArcGIS Online Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='services6.arcgis.com', port=443): Max retries exceeded with url: /PZSz9p6KxGzrnOUT/arcgis/rest/services/PHH_43_FullGeo/FeatureServer/0/query?f=json&token=3NKHt6i2urmWtqOuugvr9TpluUwD-K0TsTS8M3vWY6dKMXWdi_tH3WBIMlCuSgEpXHlYlhwKYwGuuQlZCRtBPNkiJDV5CIz_E4rWysxVYMtf2LCRDhJuovK2hsyIHZ78x99hsJVaIrIbEUFTrqdJzb_qpnp_vjly88FyTaaYsMGr8ItOJpumuJhFox3VA6NXh9o64ZVluadt9ApVCcvpmElqPgAf1TPFnSerF1uG4nnxdUFYdsd3QRvQmGuNsAYYh7s2BHXFM6Rh9P7H5jTyxQ.. (Caused by ResponseError('too many 504 error responses'))' Python Exception <FMEException>: FMEException: 926856: ArcGIS Online Feature Service Reader: Could not connect