Data

I have images taken by a camera mounted on a vehicle, with GPS (4326) coordinates recorded every millisecond. I also have a road reference dataset in a shapefile (epsg :2154) and I need to match my millisecond-spaced images (and their GPS coordinates) to this road reference. There will obviously be some discrepancies between the GPS measurements and the reference dataset, but how can I best align the GPS data with the road reference? What is the best method to do this?If you’d like, I can also help you rephrase it more formally or technically.Thank you

My scope currently is to produce an excel output using FME ensuring the template is being leveraged to populate the values in this columns. Some of these columns have formulas which have been coded in FME as AK.formula if the column AK has formula. However when I convert the FME produced Excel to XML and investigated this, the formula seems to be converting “ into &quot. However I get to know about this only when I checked XML since Excel exactly imprints the formula as coded in FME. What is the best way to resolve this issue?

I have a field with city names and state names in this format:Oklahoma City OKOakland CADallas TXForth Worth TXAugusta ME  I want to do the following:Extract the City name into one field and the state abbreviation into another field. The only consistent pattern in the data is the state abbreviation always comes after the last space in the string. I think I need to create a RegEx expression to do be able to do this. Can someone help me with how do this? 

I'm trying to write AGOL features and attachments coming from a feature service tied to a Survey123 survey into a SQL Server geodatabase. I've looked through most of the tutorials and questions about this, but in my use case I need to maintain Global ID's on both the features and the attachments. The feature GlobalID's are being used to name photos that get stored in S3, so I can't use the examples that use a counter to create a new relational ID. I have set the "Maintain Global ID's" parameter on the AGOL reader and have exposed the AGOL attachment attributes. The attachments have a Global ID and Parent Global ID, and I figured it would be simple enough to use both of those to create the relationship class in the GDB since that's what the AGOL service is doing. When I query the service, I can see a feature's Global ID and the attachment's Global ID and its Parent Global ID (the GID of the feature it's attached to).  Feature popup: Quer

HiIs it possible to connect fme to a Microsoft Fabric Lakehouse? And read data?I use fme 2022.2 

Recently upgraded a dev environment to FME Flow 2025.1.1We have some workspaces that use FileCopyWriters to move files.These workspaces still run on FME 2025 but now throw out a warning message for each fileThe move request details the correct move, but then there is a failed to delete message that appears to be saying it can’t delete from the destination not the source. The files are in fact deleted from the source, so it’s actually all working as it should be and as it did previously with the exception of these warning messages. I note that the FileCopyWriter now has a delete option so wonder if this is related somehow. Can anyone confirm they see the same behaviour in 2025.1.1.  The same warning error messages is seen in FME Form 2025.1

Hello fellow FME enthousiasts, We have been running into an issue when using the new Esri ArcGIS Feature Service [Writer] (from the new Esri ArcGIS Connector v3.13.2 package) to write to a Hosted Feature Layer on ArcGIS Online. The Hosted feature layer is created by Survey 123.Previously we used the old Esri ArcGIS Online (AGOL) Feature Service [Writer], since this won't be supported anymore in 2026 we started experimenting with the new one. When we try to update the hosted Feature layer with FME using the old one, all goes well, data gets written as expected and the geometry is visible.But when using the new one from the package we get a few warnings and no error's. The process tells us it's succesfull, we see the new records appearing in AGOL and the attributes seems to be as expected. The geometry is not visible either. When we try to zoom to a record nothing happens. When i open the layer in ArcGIS Pro nothing happens either when i try to zoom to layer/or zoom to selection. It's li

I’ve been trying to load some .nwds files, and they’re taking days to fully open. The files themselves aren’t very large—around 180 MB—but some of the geometry has extremely large coordinate offsets. For example, certain objects are located around X=10,000 and Y=10,000, while others are positioned near X=1,200,000 and Y=1,200,000. Could these large differences in coordinate magnitude be contributing to the slow load times?

Hi, I have a report i make where from the data i get out the following (where / separate's attributes)Field / SubField / YYYYMMDD / ValueX / ValueYFor the last date of the Subfield, i would need a line where Value X and Value Y are zero - the end date is specific to the Subfield. Is there a way to get it to reach - for Subfield - find last date - create +1M from YYYYMMDD with X and Y equal to zeroI know how i would do it in a excel macro, but i dont know how to replicate this in FME /Emma

I'm trying to use FME 2025.0 to create a GeoPackage tiles file. It should contain a few Norwegian raster products, such as N50, N100 and N250. The idea is to mimic the properties of the Swedish product “Topografisk webbkarta Nedladdning, raster”, in the sense that the Swedish product contains a single table in the gpkg file and it shows different raster data at different scales. I am having trouble recreating this with the Norwegian products. I´m stuck at creating a separate tables for each data set or a single table that only contains a single data set. This use case is not discussed at, for example, https://support.safe.com/hc/en-us/articles/37417604217357-Creating-OGC-Compliant-GeoPackage-Files#h_01JXXGG7338W04GD0DRBY7VJCV. Any help appreciated. Norwegian products: https://www.kartverket.no/en/on-land/kart/kartbilderSwedish product: https://www.lantmateriet.se/sv/geodata/vara-produkter/produktlista/topografisk-webbkarta-nedladdning-raster/ Magnus

Hello, so we regularly download the whole catalogue of polygons for England, seen here:Dataset Download - Use land and property dataI would very much want to automate this as its a tedious task to manually download them all one by one, so I’ve investigated the calls that my browser makes when calling this data and it first sends a very simple call to very simple URL’s containing the Zipped data, as seen here:https://use-land-property-data.service.gov.uk/datasets/inspire/download/Amber_Valley_Borough_Council.zipWhich in turn takes you onward to a Amazon service that just gives you 60seconds to fetch the data, as seen here:https://datapub-prd-s3-bucket.s3.amazonaws.com/inspire/Amber_Valley_Borough_Council.zip?response-content-type=application%2Fforce-download&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIASNNJI2YGUWCWQTWF%2F20250522%2Feu-west-2%2Fs3%2Faws4_request&X-Amz-Date=20250522T125638Z&X-Amz-Expires=60&X-Amz-SignedHeaders=host&X-Amz-Signature=c8a03845

I’ve been trying to read a layer that has 16.1 million points and 7 fields into FME Form.  After 10-12 minutes I get the following long-winded 504 error:ArcGIS Online Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='services6.arcgis.com', port=443): Max retries exceeded with url: /PZSz9p6KxGzrnOUT/arcgis/rest/services/PHH_43_FullGeo/FeatureServer/0/query?f=json&token=3NKHt6i2urmWtqOuugvr9TpluUwD-K0TsTS8M3vWY6dKMXWdi_tH3WBIMlCuSgEpXHlYlhwKYwGuuQlZCRtBPNkiJDV5CIz_E4rWysxVYMtf2LCRDhJuovK2hsyIHZ78x99hsJVaIrIbEUFTrqdJzb_qpnp_vjly88FyTaaYsMGr8ItOJpumuJhFox3VA6NXh9o64ZVluadt9ApVCcvpmElqPgAf1TPFnSerF1uG4nnxdUFYdsd3QRvQmGuNsAYYh7s2BHXFM6Rh9P7H5jTyxQ.. (Caused by ResponseError('too many 504 error responses'))' Python Exception <FMEException>: FMEException: 926856: ArcGIS Online Feature Service Reader: Could not connect to server. Check that yo

Hello fellow FME-ers,I am working on making an xml from an Oracle database (with metadata). I am using the FME template for this in the XML Writer. Using the list builder I have generated two lists. One with the keywords and one with the attribute values. See below as an example (List_Trefwoorden and List_Attribuutinformatie):How do I make sure these lists (standard FME template for xml) are saved in my XML writer? Greetings, Wim 

Hi,Trying to use a clipper for 3d intersections but some 3d solids getting rejected i think due to geometry errors in 3d solids. I have ran the 3d solids through geometry validator but does not fix the geometry errors. Geometry errors include - Non-Planar Surfaces, Incorrect Solid Orientation, Invalid Solid Boundaries. Any other ideas to fix? Thanks

Hi,I would like to convert an image symbol from Esri CIM JSON to AutoCAD DWG format. The JSON file looks like this: {  "type": "CIMPointSymbol",  "symbolLayers": [    {      "type": "CIMCharacterMarker",      "enable": true,      "anchorPoint": {        "x": 0,        "y": 0,        "z": 0      },      "anchorPointUnits": "Relative",      "dominantSizeAxis3D": "Y",      "offsetX": -3.3333333333333335,      "size": 5.555555555555556,      "billboardMode3D": "FaceNearPlane",      "characterIndex": 85,      "fontFamilyName": "Tahoma",      "fontStyleName": "Regular",      "fontType": "TTOpenType",      "scaleX": 1,      "symbol": {        "type": "CIMPolygonSymbol",        "symbolLayers": [          {            "type": "CIMSolidStroke",            "enable": true,            "capStyle": "Round",            "joinStyle": "Round",            "lineStyle3D": "Strip",            "miterLimit": 4,            "width": 0,            "height3D": 1,            "anchor3D": "Center"::],  "haloSize": 1,

Wie lässt sich aus einer Spalte der Strassenname, Hausnummer und Zusatzinfo in eigene Spaltenextrahieren? Ackerstr. 9 - 4733 - Adlerbrücke Tunnel B 7 - 9814 - Adolf-Röder-Gasse o. Hausnr. - 8104 - Adolf-Vorwerk-Str. / Hohenzollernstr. - 9251 - Agnes-Miegel-Str. 6 - 9630 - Agnes-Miegel-Str.14 Miet - 5680 - Agnes-Miegel-Str.33/37 Miet - 5498 - Agnes-Miegel-Str.20/26 Miet - 5498 - Ahrstr.90 - 7943 - Ahrstr.35 - 7543 - Musterstraße 123a - 4102 -  

Hi, I have some 3D fencing data in IFC format and I want to work out the height of the objects. I been  x,y,z co-ordinates and the ‘Bounds Extractor’. However, due to the data being long linear features and thus the underlying height of the ground negatively affecting the height. I get strange results (as fencing goes up and down underlying elevations).I think the only method is to take cross sections of the fencing and work out the distance (height) between the highest and lowest z value from the cross section. However, this seems difficult to do. Any ideas? ta

FME Form Version: FME(R) 2024.2.0.0 (20241102 - Build 24783 - WIN64FME Flow:  2024.2.1 Build 24801 - win64 I have created a bunch of User parameter type: Groups Box in a skript. Within those Group box are a bunch of parameter type: yes/no. These parameters are used in an FME Flow APP. However. They’re not working as I want them to work. When a Group box is unchecked in the FME Flow APP then I want all the layers inside the group box to get unchecked.However in FME APP, it doesnt do that. Please see picture below attached to this question. All the layers inside the Group Box (byggnadsdelar) are still checked. What am I doing wrong?Please see my konfiguration for the group box parameter and the yes/no parameters inside Group Box. 

Is there a method to import CAD graphic elements, line, Arcs, etc. with the geometric attributes readable by Arc map such as Radius of arcs, bearings of lines.  When I import CAD graphics, I get polylines, but they do not really have readable geometry like Line Length, Arc Radius, Line Bearing etc.  I would like to import CAD graphics like road centerline geometry and have the geometric data in a Table like format, similar to the old COGO formats.

I have a list of client records with a start-date and an end-date. In some cases there are multiple lines for a client, identical except for start-date and end-date. I need to somehow either concatenate them into one client record which contains the minimum start-date and the maximum end-date from each of those client’s records, or create a new client record for each client with the minimum start-date and the maximum end-date. All other data can be discarded in the process.For example, I start with:JohnDoe, startdate: 1 Jan 2024, enddate: 1 August 2024JohnDoe, startdate: 3 Mar 2024, enddate: 31 August 2024JohnDoe, startdate: 3 Mar 2024, enddate: 15 Dec 2024DavidSmith, startdate: 1 Feb 2024, enddate: 15 Oct 2024DavidSmith, startdate: 3 Mar 2024, enddate: 18 Oct 2024 And I want to end up with:JohnDoe, startdate_min: 1 Jan 2024, enddate_max: 15 Dec 2024DavidSmith, startdate_min: 1 Feb 2024, enddate_max: 18 Oct 2024 I have managed to create a really intricate and clunky solution which kind

Good evening,I am wondering what the community thinks about this situation:FME Form 2024.1.3.0 (20240927 - Build 24627)Writing to Esri Enterprise Geodatabase (SDE) 10.9.1 - MS SQL Server 2022I have almost 700,000 records that need to be written out to our SDE into 1 feature class.Currently I have 1 Writer using the Esri Geodatabase (ArcSDE Geodb) format.The 1st attempt to write the data failed after 22 hours because I had a loc on the destination feature dataset.  doh!On the 2nd attempt to write the data to the SDE, the job has been running for 12 hours.  I cancelled the job, and below are snippets from the logfile highlighting how many records have been written, and how much time passed.  This shows a pattern that: as time progresses, the processing time is becoming exponentially longer.  I am thinking of breaking the data into 100,000 chunks, with the first chunk first truncating the table and then loading, and the sequential chunks appending to the table.Is this performance hit expe

I am trying to validate some properties of objects in DWG files, and some of the things I’d like to check require me to know what paper space viewport an object is visible through, but I have been unable to get the autocad_viewport_handle attribute to show up.I’ve tried a few combinations of reader parameters, including checking all boxes in the “Model and Paper Space Options” section, unchecking some options while leaving “Read Model Space Entities Through Viewports” checked, and tried reading multiple DWGs, but so far I have not had any luck. I am thinking this must be a “me” problem, but I’m kind of at a loss. Is there a certain set of parameter settings required to get autocad_viewport_handle to show up? I am setting the reader to expose the attribute, but so far, it is always missing. I’m using FME 2025.0. 

Hi all,I hope all is well! I am very new to FME and data products.We use FME 2022.2 but we thought it will be time to upgrade to the latest version to benefit from the updates.I have installed 2025.1 and the first thing that I can see is the reader format has changed I would use “Microsoft SQL Server Spatial” in 2022 but in 2025 it is “Microsoft SQL Server (MSSQL)”I would assume they have aggregated both non-spatial and spatial into one reader format.I go to add the connection that we normally use - in this case it is called GisAzureView which is a hosted server for us. I would then need to select which tables I would like to read from but I get this error: 2025.1 Error when reading hosted SQL database“Failed to obtain any schemas from reader 'SQLSERVER' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information” - is the error that comes up - so it is failing to open the reader

I’ve been needing to identify leading and trailing spaces across many attributes, with a significant number of features. I don’t need to trim them, but rather identify their existence.The only solution I’ve been able to come up with so far is to use AttributeValidators - this way, I can set it to run against the 50 or so fields that need to be validated. I’m using Regex and the rule “^ +” for leading spaces, and a second AttributeValidator with the rule “ +$” (double quotation marks only for readability here, not used in the Rule Configuration) for trailing spaces.This works, but it is very slow. Is there a better way to do this within FME, without resorting to some Python?Thanks in advance for any thoughts on alternative approaches!

Is FME able to read the MicroStation DGN file geographical coordinate and use this information when creating esri geodatabase features?  I see several tutorials and methods that seem to suggest CAD data such as DGN (MicroStation Design Files) do not contain geographic Coordinate systems but is not totally true.  Design files do or can have coordinate systems, and most do when relative to Transportation Civil Engineering Design.