Data

Hi.I'm looking for a way to compute the average while excluding outliers. This average is based on 5 attribute values for each record. To expand, i am QCing pole counts within permits. Each permit is a record. There are a bit over 10k records. I have 5 attributes, with pole counts, each coming from a different source.Example:permit a, pole counts = 1, 4, 5, 28, 6permit b, pole counts = 2, 10, 14, 80, 12Manually, for permit a, i'd exclude 1 and 28 and my avg would be 5. For permit b, i'd exclude 2 and 80 and my avg would be 12. The final goal for this exercise is to pick the value closest to the average computed without outliers. Pls help. Thank you.

I’m reading Survey123 results into FME where one question allows multiple selections. The answers come through as a comma-delimited string (e.g. Need_PD,Need_TMA,Frozen).I want to validate the responses against a known list of allowed values (CSV/XLSX), so that: each selected value is validated individually any invalid or new value (even if it hasn’t appeared yet) is flagged I don’t need to handle every possible combination of selections I understand that Tester “Cached Values” only shows existing data values and that Survey123/ArcGIS domains aren’t directly usable here.What is the recommended transformer pattern to: split the multi-select field so I can edit testers for looking for certain selected options and not others

This is really strange—I’ve never seen this behavior before.After saving and closing my workbench, all other FMW files in the same folder disappeared automatically.At first, I thought I was imagining things, but other users have reported similar issues before. [Post link]Version: 2024.2.1 (Build 24801)OS: Windows 11 24H2 (26100.2894)The only change I can recall is that I recently uninstalled all old FME versions, but that shouldn’t somehow trigger file deletion, right?

I have a list of points which I want to connect to lines. But one line should contain only points with a specific value in a field. At the end I want to have multiple lines in one feature class. How can I do that?

I have a source SDE Geodatabase reader and destination File Geodatabase writer, both with the exact same attributed relationship classe schemas. The File Geodatabase being written to is blank (I’m using a template) and I don’t need to re-establish any relationships, I want to write the records exactly as they appear in the SDE Geodatabase, to the File Geodatabase. I’ve read in feature types using Ignore relationships, making them type geodb_table, and the destination feature types are also geodb_table (though obviously both are in fact attributed relationship classes).FME (2024.1.1.1) seems to want to recognize the writer feature types as relationship classes, no matter how I define them. I don’t want to have to establish the whole geodb_rel_origin_oid and geodb_rel_destination_oid values since I know what they should be already from the source (and there is no common attribute between the two source relationship class tables anyways). Is there a way to forc

a file like the following.I am reading it using a Text Reader dataset in XML format.I would like to use XML Fragment / XML Flattener to extract the Name attribute and its value, but I always get no result from the XML Fragment.I am not sure what the reason is. Could someone please help me?Thanks in advance.FME 2021<processXMLRequest  ><field ><name>text1</name><value>value1</value></field><field ><name>text2</name><value>value2</value></field><field ><name>text3</name><value>value3</value></field><field ><name>text4</name><value>value4</value></field><field ><name>text5</name><valu

Hi.I have built a workspace for data generation that runs for several hours. To log the process input for documentation purposes, I write them to an FFS file, that is about 765 Mb. It includes both spatial and non-spatial data.I now try to open it in Workbench (2025.2.1), but it fails with this error message:No geometry mapping entry found for 'varchar(200)' in metafile 'C:\Program Files\FME 2025\metafile\FFS.fmf'. Please visit http://www.safe.com/supportHowever, the curious/funny thing is, that I can open the file in the Data Inspector program without any errors:What can be done to remedy this ? Are there any work-arounds for this error ?

I’m working on trying to automate some of my company’s reporting, like the one partially shown in this screenshot. So far, I am able to get pretty much most of this information through to the Attribute Pivoter, but I am pretty new to getting this information properly into a Google Sheet. I have the Customer side (left side) and Company side (right side) going through separate channels because they’re from different layers...and I’m starting to wonder if it’s even possible to populate this information in this way from Attribute Pivoter or if I should just switch to separate tabs within the Google Sheet. Second screenshot is what the attribute pivoter summary results look like for the right hand side which is essentially what I want...just not broken down the way I want. 

Hi, I am having a problem with FME doing truncates/inserts to an ArcGIS Online hosted layer. Sometimes the number of records in AGOL is 1000 more than FME says it is writing. If I run FME again it is 2000 records too many, 3000 when run again. This is happening in Workbench and Server 2020.2 but does not happen all the time. Features per request in the writer is set to 1000. This has not been a problem writing to other formats and I have other FME services writing to other AGOL layers without issues. Thanks, David

I’m working in an FME Form workbench reading in CSV files that reflect database updates and then using them to update a central XLSX file. However, when the CSV reader is pulling in a column with values of either ‘TRUE’ or ‘FALSE’, it is automatically converting them to ‘true’ or ‘false’.Has anyone ever noticed this with a CSV reader?Unfortunately the domain I am describing with this data has capitalized values, so reporting the codes as lower case somewhat defeats the purpose. I know the parameter for Case Sensitive Field Names would resolve the issue if i were seeing this in the attribute names but unfortunately i haven’t been able to find a similar parameter for the data itself.Is this just an inherent setting to the CSV reader format?

Hello,My team has developed a workspace for data collection of publicly available GIS-data. The workspace uses HTTP-callers to download the data from different URL:s, and then the data is clipped from a predefined area of interest. The schemas and the features area separated and the rejoined later in the workspace. The output is written to an ESRI Geodatabase. Everything is working fine using FME Flow 2023.2.2.0 - Build 23781, but when I tried upgrading to FME 2025, I get an error:“Esri Geodatabase Writer: Feature Type Definition 'd_y_n' was requested, but not defined. Please visit https://www.safe.com/support”Does anyone have any insights into this issue?Thanks in advance /Ville

Hi , I am working a lot of the DWG files and I had somebody did the work. So when I  received the DWG files and review them.  I have ArcGIS Pro and I looked at them and I was not sure about the  coordinate system there… so I pulled the file in FME Data Inspector and found them that they are not in the right place I am in Colorado…Question first is : What does the red symbol mean here ?Black square with blue point is where the DWG is. The record information shows the coordinate system is Unknown.

Hi,I have a dgn file created from OpenBuildings. Within OpenBuildings you can see attributes attached. However, they only seem to show in OpenBuildings not Microsation or FME (i.e they are not tags or xrecords). Therefore, the attribute data must not be stored as tags or xrecords. Does anyone know how attribute data is stored within OpenBuildings application and how fme can read them? Ta

Hi there,I am assessing a dataset for changes that took place since 2012. This data contains these two fields of interest:change_date reason_for_changechange_date contains multiple dates that a separated by a comma and reason_for_change contains strings of change types separated by a comma.An example of the data structure is Feature 1:change_date: 2016-10-20reason_for_change: New Feature 2:change_date: 2009-06-15, 2013-09-04, 2016-10-05reason_for_change: New, Attributes, Modified Feature 3:change_date: 2010-09-11, 2014-04-09reason_for_change: New, Attributes Is it possible within FME to pair each individual reason for change to a change date and then test if it matches the follow conditions of reason_for_change = New or Modified and change date greater than 2012-12-31?Using the three examples above, feature 1 and 2 should be highlig

Hi everyone,I’m struggling with a limitation in the Excel Reader and I’m hoping someone has a reliable workaround for a fully dynamic workflow.I have an automated FME Flow workspace where multiple users upload Excel files through an FME Flow App. These files contain yearly planning data for different teams. The challenge is that users will sometimes rename existing columns and sometimes add completely new columns to the Excel sheet.Even when I configure the Excel Reader with Dynamic Schema by using Single merged feature type, FME does not refresh the schema at runtime. It only updates the schema if I manually right click the reader in the Navigator pane and click Update reader. Simply running the workspace does not trigger a schema rescan.I have tested using CSV instead of Excel but the schema still remains locked to whatever was detected when the reader was first added. As a result, any renamed columns

Hi - I’m trying to write small areas of map data from a Geodatabase as a DWG / DXF file.The spatial data is available when I open the exported file, but none of the attributes, only a single column called <no schema>:I’m wanting to include the following attributes: but I have tried countless variations of the available Writers:I just can’t get around the <no schema> issue.Is it actually possible to include attributes within a DWG / DXF Writer?If anyone can offer some step by

Hi everyone, forgive me if this is a basic question but I’m trying to understand best practices for our database setup. We have a GIS Edit database and GIS Production database. Both are Postgresql 12.22, Enterprise 11.3. We have a lot of jobs doing a basic ETL from Edit → ProdHavent had too many issues with these over the years with some occasional data type errors mostly. The problem is I have never been certain what combination of reader/writer I should be using. For some reason, we’ve had the best luck using an ArcSDE Geodb reader and a postgis writer. And when I say this, for example an error I’ve run into many times is that the objectid (Esri’s UID column) has duplicate values when running the job so it fails. So then we do something like adding a counter transformer in between and then writing that to the Production db table objectid column. I’d prefer not to have to add steps like this obviously.We’re in the process of preparing to upgrade our FME workben

Hi, Can anyone help me read and write an XML file to SHPs? I've already managed to read it, but then I have to map everything myself, but I've found XSD schemas. I should use two, but I can't get it to work.According to Copilot, FME 2025.1 no longer supports XSD schemas, but they don't really offer me an alternative either. Nothing they suggest works or is correct.So I think I'm better off with your expertise than with AI :-)  

Hi thereI’d like to convert the whole OS MasterMap Topography layer for our district in to individual 1km DWG tiles which are to be accessed in a variety of CAD packages.I have had some success in converting a Geopackage of the above layer, through a MultiClipper to create the individual grid squares and finally written as a DWGs with the output ‘fanned out’ by each 1km grid reference number.When one of the resulting files was opened in CAD, the geometry was present, but none of the attributes. However, I will try the UK OS MasterMap Topography Layer (GML) Reader, once my GML download is available from the OS Data Hub site.Would anyone who has had some experience with this type of conversion kindly forward me some tips or advice on how best to achieve populating a DWG, or series of DWG exports with the attributes from the file which is being converted, please?Many thanks :)

Hi all,I am attempting to create an FME script that looks at the FWI information provided as a WMS by NRCAN to perform some risk analysis based on the WFI cell values. When I load the WMS into ArcGIS Pro and examine a cell, I can see a discrete WFI value: (It is hard to tell from the picture, but this display is showing up when I click to examine a single cell. As I click around in the polygon, the WFI value changes.)When I load the data into FME, I cannot seem to get that FWI value to be exposed. When I click a cell in the investigator, this is what is returned:

Hello,I have a main FME workspace where I call multiple child workspaces using WorkbenchRunner.The issue is that even when one of the called workspaces is terminated, the WorkbenchRunner still reports the execution as successful.My goal is to stop the main workflow immediately if any problem occurs in one of the child workspaces, so that the next WorkbenchRunner does not execute. What is the correct way to ensure that: If a child workspace fails (error or termination), the main workspace stops immediately, And subsequent WorkbenchRunners do not run? Any recommended best practice for this scenario?Thank you.  

Does anyone know a good built-in or pre-created solution to read “Tabular JSON” that’s in a format of schema followed by values rather than key:value? See example below. I have ~40 schema values but only included 2. I’m looking for something dynamic rather than manually assigning column names in a specific order.{ "schema": { "title": "Data Export", "type": "array", "properties": { "id": { "title": "id", "type": "integer", "default": "", "minimum": -2147483648.0, "maximum": 2147483647.0 }, "code": { "title": "code", "type": "string", "default": "" } } }, "data": [ [ 1, "DEMO1234" ] ]} 

Hello everyone,I looked at thread DGN writer RGB color | Community and I am dealing with the same problem.Ideally I would like to get the RGB color (true values) instead of the colorindex from the color table.I read in the above thread that true color should be available from FME Form 2023 on, but I still get the index number from the color table. Iam using FME Form 2024.2.1 by the way.I do the following thingI have a dgn styler configurated as follows in the Writer I use a seedfile with RGB values for the layers Output is 

Ive been wondering about this for quite some time now, but couldn’t get any satisfying reply so far. The only solution I had in mind was to create a pythoncaller that automatically checks this..but that does feel a bit supoptimal. Maybe I am missing something? I’m building a daily monitoring workflow in FME Flow (REST API v4 / fmeapiv4). Goal: once per day I want to store counts like “successful runs” and “failed runs” for a specific repository + workspace.I currently use the /jobs endpoint like this:GET /fmeapiv4/jobs ?status=success &repository=repo%20Name &workspace=workspace.fmw &limit=1000 &offset=0Problem: I only want today’s runs (or a specific day), but according to the Swagger docs for GET /jobs the available query params are things like status, repository, workspace, sort, limit, offset, etc. There is no start / end or other date range filter.Swag

Hello,I am a student who is discovering FME and learning it through self-training. I have a dataset that I need to process in FME, and I have been given the following technical requirements:Expected specifications:Each linear segment must not be longer than 10 meters. If there is no network point at a vertex of a linear feature, a point must be created with the following two attributes: Network depth (in cm): to be calculated according to the interpolation rules below: If there is no depth value at both the upstream and downstream ends of the linear feature → set depth to 100 cm. If there is a depth value at either the upstream or downstream end only → interpolate from the known depth to 100 cm at the unknown end, ensuring that the difference between two consecutive points does not exceed 20 cm.