Data

I am currently using FME 2025.1.1 (Build 25615) and have had some issues with inspector crashing. I have tried multiple different ArcGIS Online provided background maps and they seem to be causing both Data Inspector and occasionally Form (when using Data Preview) to crash. I have tried with multiple different types of data, of various feature counts, sometimes it crashes on initial load of background map, other times when it reloads it after zooming in. Wondering if anyone else has run into this?

I’ve got some JSON data where the key/value pairs are separated so the keys are in one JSON block and the values in another (see the example below). I’m using:A JSONExtractor to get the "columns" fragment and then a StringReplacer and AttributeSplitter to convert it to a list. A JSONFragmenter to convert the "values" to a list. A PythonCaller to loop through the two lists and create the attributes.Is there a way to do this without python? I’ve attached a zipped file of my workbench, Example JSON============{    "columns": [        "sub_organisation",        "system_id",        "type",        "mounted",        "location",        "road_id",        "offset",        "side",        "geometry"    ],    "rows": [        {            "message": null,            "values": [                24,                8,

Hey,I am mega confused with something that I thought would be relatively simple. I have a Survey123 feature layer in ArcGIS Online that automatically places survey points at 0 lat 0 long (west coast of Africa). What I would like to do is read the Survey layer into FME, geocode the data via an address attribute, and then write back the geometry updates to the layer without altering the attribute table at all. I can do all of that fine except for the final Write/update operation.I have confirmed that the layer in AGOL is editable and allows for Updates (attributes and geometry). I have the correct AGOL permissions to do these edits. In the parameters for my AGOL Writer, I have the Layer settings as: Update, Use Existing, Update Spatial Column = Yes. The operation completes successfully, but then when I check AGOL it appears that the layer’s geometry has disappeared. The table attributes are there, but no geometry is present.I can also see that AGOL recognizes some

I am trying to see if I can update a feature layer in our ESRI Portal from a FGDB. We know we can insert, update, and delete features and have success on those fronts. However, we will like to also have dynamic schema available as we may change the data in our FGDB by removing/adding fields. I have tried several times to get a dynamic writer working to account for a schema change but without luck. I have tried to delete data in the feature layer to then insert but that had errors. Does anyone have advice or has done this? The FGDB is a testing stage as eventually we would want to update directly from SDE. 

Hello community,i am using an Feature Writer to write Feature classes in an Feature Dataset in an EGDB.I found out that i need to enter the Feature Dataset Name/Feature Class Name hardcoded. For Example: FeatureDatasetName/FeatureClassName descriped in the following picture: SDE Feature Writer with hardcoded (static) Feature Dataset and Featureclass NameAn dynamically generated Value like “@Value(FD_Name)/FCName” or even the whole value @Value(FD_name_and_FC_Name) is not working as Feature Class.How i found that out? The Features get inserted in the Feature Class, even if i set Table Handling to drop and create. When i use the hardcoded (static) Feature Dataset and Featreclass Name the Table got dropped and created new, so it was working as expected.

Hi, I have a very simple FME worskspace that reads a shp-file and via Esri ArcGIS Feature Service updates a Feature Layer (hosted) on Portal for ArcGIS.The data is simple plygons with a few attribute. The  Feature Layer is published from the same data in ArcGIS Pro.When i run my FME script the polygon ends up aprox 2000 km wrong. It does not matter if I have Feature Type Handling: Use existing or Truncate. If i use the old Esri ArcGIS Portal Feature Service writer it works fine. I am using FME 2025.1, Portal for ArcGIS 11.4 and PCS is EPSG:3006   

Hi all.I need to identify (and convert) multisurface /curve polygons in a GDB.The GDBs contain one feature class with many polygons: some of these records are multipart polygons. The data I am working with comes from uncontrolled sources using different GIS programs, so the GDBs are put through a workbench to identify obvious spurious geometries like self-intersections (this works well). However, I am having a recurring problem where the downstream processes in other systems are failing due to multisurface /curve polygons.I have tried exposing the fme_type and geometry, but they are always “fme_areas”. However, if I run GDAL ogrinfo tool identifies lots of Multisurfaces, some are also CURVEPOLYGONs. For example, GDB today with 8 records had 64 multisurfaces.Any anyone help point me in the right direction for how I might Id these issues in FME, or incorporate the GDAL tool somehow?Note: I cannot share example data due to its sensitive nature.

What is the process for ensuring that a custom coordinate system defined using the recipe from ​@daveatsafe below is reliably used by all members of a team using FME Desktop and also Server?(better yet: implement Update all available Coordinate Systems with EPSG Codes so it’s not necessary) 

I have many parquet files stored in an s3 bucket; when I use the s3 connector to download the parquet file, I am able to read it successfully, but passing the s3 uri (“s3://”) raises an error:PARQUET reader: PARQUET reader: Failed to open file 's3:\my-bucket-s3-test\fme-test\test.parquet' for reading.  Please ensure that the file exists and you have sufficient privileges to read itFailed to obtain any schemas from reader 'PARQUET' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationWhen I try to pass the url:PARQUET reader: PARQUET reader: Failed to open file 'HTTPS:\s3.us-west-2.amazonaws.com\my-bucket-s3-test\fme-test\test.parquet' for reading.  Please ensure that the file exists and you have sufficient privileges to read it When I use the feature reader, r

Hello everyone,A colleague is trying to read a CSV file in FME 2024.2, but the file appears to be generated by Linux-based software. As a result, FME interprets the entire file as a single block of text instead of recognizing each line as a new row. Does anyone know how to ensure FME correctly identifies each line break in this file?  

Hello, its me again.So I’m playing with changing excel documents in Form 2024.1 and its going superb, except from the fact that when Form writes out my changed excel it adds an @ in front of some of the formulas. So for example the formula that gets read in as:=XLOOKUP(blabla)Gets written out as:=@XLOOKUP(blabla)Which then makes the whole outcome excel document breaks.I have ran this with caching and see that at last cache before writing then the formulas are intact, so this must happen in the writer or that the excel gets written out in some manner that my excel setup *misunderstands* it?As always, all comments are welcomed (as long as you not a person just looking to score some points by copy/pasting what AI said the problem was).-Hlynur

Hi all,I am currently using ArcPro 3.5 DI tool that uses,FME(R) 2025.0.0.0 (20250228 - Build 25208 - WIN64)Some of my FME scripts are failing when reading an excel file if it as a python start up script that imports arcpy specifically. If i remove arcpy, the excel reader works fine.Is this a bug with the FME build that came with our ArcPro 3.5 or is it consistent with a stand-alone FME install?Some of the warnings are:----------------------------------------------------------The Startup Python Script changed the current FME process locale from 'English_New Zealand.utf8' to 'English_New Zealand.1252' and FME has restored it back to 'English_New Zealand.utf8'. It is undefined behavior to change locale and doing so may cause unexpected errors. For more information, visit http://fme.ly/PythonLocaleError-----------------------------------------------------------Excel Reader: Could not read cell at row '0', column '1' for sheet

This morning I tried to import data using a WFS concerning a Dutch data source. I got into a weird error:Used WFS: service.pdok.nl/kadaster/kadastralekaart/wfs/v5_0?request=GetCapabilities&service=WFSDoes this look familiar to someone?

Wow - new marketing campaign?!https://youtu.be/XaXGa_zijlo?si=_6mP-oYSZanl9ZfII think Im a fan

Hello everyone,We just upgraded to FME Form 2024.2.1 and we currently encounter one problem. For the users, the personal database- and web connections were inititally not migrated. Thus we sent first a mail to the users that they coud export the database- and webconnections in FME Form 2023 and then import  the exported file in FME Form 2024. It looked like it solved the problem, however when the users logged in the next day on an new machine, they lost all their personal database-  and webconnections.We read the following link: Changes to Connection Storage in FME Form 2024 – FME Support Center and it became clear to us that's due to the new way that personal database- and webconnections are stored. They are stored in fme_userconnection.data and the machineID is hardcod

Hey everyone, I'm writing some data into a Snowflake database and getting a geometry validation error on the Snowflake side: SnowflakeSQLException: Geography validation failed.When I run it thru the FME GeometryValidator - it passes.If I run it thru the SQLExecutor and call ST_ISVALID it returns false so in theory, I could call the SQLExecutor for every record however with a million records, this really isn't feasible. I thought about grouping the inserts by 1000 and if it fails, run those 1000 thru the SQLExecutor however I couldn't figure out how to have the FeatureWriter continue if it fails on a group.Does anyone have any ideas on how to get these records to continue. I really just want FME to remove any bad geometries and log which one's failed. Thanks!

After a week+ of trial and error I wonder. Have anyone managed to create an FBX-file with FME that contains terrainmodel + ortophoto draped on top. That can be opened WITH materials/texture directly in Navisworks? I have tried all settings - but can not make it work. The files open correctly in FME Data Inspector, Autodesk FBX Reviewe, 3dsmax, Lumion and even Infraworks. And also the export from Infraworks to Navisworks work OK! However I cant seem to be able to open the FBX-file directly in Navisworks - it only shows the terrain with no texture/material. Even when it shows the texture in the "materials" pane. Material is added on a Mesh-group and displays nicely before writing and as mentioned in the other software above.Some stuff I have tried:- All settings on the FBX-writer- Manually changing the scaleuints on the ASCII- file from 1 to 100 to scale to meters instead of default cm. It seems that there is some scaling issu

Hello, I just upgraded to FME Form 2025.1.2 and am having a problem with the Google Sheets Reader. The Reader previously worked in FME 2024.x, but I am now getting a very ambiguous error whenever I try to read a sheet into a workspace. I literally just upgraded this morning after initially opening the workspace in Form 2024 and successfully running it, so I know nothing has changed on my computer or anything otherwise. Any ideas what I am doing wrong? 

Hi,I wonder if someone could help me?I would like to merge pdf files in one folder (folder1.png)with pdf files in different folder (folder2.png) based on data in excel (merge.png). For an example, merge 1.pdf in folder1 with 421.pdf,422.pdf,423.pdf in folder2 like it says in the table. And 2.pdf in folder1 with 424.pdf, 425.pdf in folder2 and so on...Is that possible?Thank you, Jasna 

I have a fileGDB with many records, of which I only want to read a Selection.I know how to use the Search Envelope to select records in a bounding boxIs there also a way of Selecting records where an Attribute equals a value? (actually one of three values)Or is the only way with a Transformer after the Reader?Just trying to optimise

Hi,I want to automate the process of downloading a dataset that comes as a zipped folder. Inside the folder, there is a GeoTIFF file that I want to read into FME. After that, I want to write it to a new GeoTIFF file, which should automatically update when the dataset is updated.What is the simplest way to do this?The file i want to work with is this: https://ext-dokument.lansstyrelsen.se/sodermanland/Geodata/Gron_infrastruktur/LstD_GI_Ädellöv_int.zip

Hi everyone,We recently switched to the new version (2024) of FME. I ceated a new fmw-file to convert gml to dgn. But when opening the dgn, I noticed that every level that uses an attribute value has the colour ‘white’ instead of the intended colour.Is this a bug? Can somebody help me how to solve this?Thanks in advance. 

 Hi folks! As I was using AI tools like ChatGPT and Copilot to troubleshoot, I suddenly received information from the AI about the "Generate Workspace Documentation" function. Here's what I learned:-------------------------------------------------------------------------------------------------------------------------------Generate Workspace DocumentationThis feature allows you to automatically generate comprehensive documentation for your FME workspace. The output is typically an HTML file that provides detailed insights into your workspace structure, parameters, and transformations. It's incredibly useful for sharing with colleagues or for archiving your workflows. How to Use It: Usage in FME Workbench (GUI):Open the FME Workbench application. Load the workspace you want to document. From the Tools menu, select Generate Workspace Documentat

I am trying to get my few MS Excel as a reader and then write them to a new Excel all together however, I got this error that says Excel Writer: xlsx row limit of 1048576 exceeded for New. The first 1048576 features of New will be written to file. Ending translation ? Is there a way around to pass this ?

I would like to fill the holes or patch the gaps that are not really holes (see image), but in the output I don’t get any attributes. Why is that, and what is the best method? I try Areaamalgamator but ii cannot retrieve the attributs in output…thank you