Data

Hello Folks,I have been presented with an interesting issue.I have a CSV which consist of data with multiple headers and related data for those headers.  #header 1 and valuesobservationId,broid,_response_body_new,_http_status_codeid_01682157639,GLD000000036023,"""BRO-ID"",""bronhouder"",,""kwaliteitsregime"",""datum eerste meting"",""datum recentste meting""GLD000000036023"",""50200097"",,""IMBRO"",""(2005-11-27, JJJJ-MM-DD)"",""(2025-04-10, JJJJ-MM-DD)"",,,,,#header 2 and values""put BRO-ID"",""put buisnummer"",,""monitoringnet BRO-ID"",,GMW000000074173"",""2"",,,,,,,,,#header 3 and valuesobservatie ID"",""start observatieperiode"",""eind observatieperiode"",""observatietype"",""mate beoordeling"",""observatieproces ID""id_OMO_95135"",""(2024-07-18, JJJJ-MM-DD)"",""(2025-04-10, JJJJ-MM-DD)"",""reguliereMeting"",""volledigBeoordeeld"",""id_OP_95135"",,,,,#header 4 and values""tijdstip meting"",""waterstand"",""status kwaliteitscontrole"",""censuurreden"",""censuurlimietwaarde"",""inter

Hi everyone,I’m pretty new to FME and I’m using FME Workbench 2024.2 to move data from my sde gdb schema to an Esri Parks and Grounds solution fgdb schema. I’m having trouble with the SchemaMapper and moving my domains(attribute values) to the fgdb’s schema. Currently they are not mapping.  Previous SchemaMapper parameter settings moved the source attribute value over to the target attribute, but kept the same source attribute value (MULTI-FEATURE STRUCTURE should’ve changed to Jungle Gym but instead it stayed as MULTI-FEATURE STRUCTURE). Can anyone help provide more instruction on how to get the source attribute values to move to the target attribute name and change to the target attribute value?Here’s the .xlsx I’m referencing Here’s my SchemaMapper Parameters 

I have an ArcGIS Online hosted feature layer containing point features that have attachments enabled. Could someone help me with some advice for how to use the ArcGIS Online feature reader that will allow me to access the features and their associated attachments (if there are any-not all features have an attachment)? It is easy enough to get the features, but I can't see a way to access the attachments. Thank you!

Hi,  I am using a bufferer and a dissolver transformer to generate a buffer polygon from an aggregated set of 500+ geometries. The Inspector is showing the generated geometry but the Oracle Spatial writer is unable write the geom into the spatial table. I am getting the error "Bad geometry detected in the following feature; Geometry could not be encoded for Oracle".  I have added a GeometryValidator after the Dissolver transformer. The generated geom comes through the PASSED output but still the error remains.  FME Desktop 2013 is used.  Regards, Ananda

I’ve got a weird problem where an Excel reader is reading an entire file correctly, except for one column where it is only getting part of the data. When I decode the XML of the Excel file (change extension to .zip and expand), I can look at sheet1.xml and I see the following data:<c s="12" t="inlineStr" r="AK10"> <is> <r> <rPr> <b val="0"></b> <i val="0"></i> <strike val="0"></strike> <u val="none"></u> <sz val="10"></sz> <color theme="1"></color> <rFont val="Courier New"></rFont> </rPr> <t xml:space="preserve"> </t> </r> <r> <rPr> <b val="0"></b> <i val="0"></i> <strike val="0"></strike>

I’m using FME 2021.WAL is possible pour SQLite since 2010, Geopackage is based on SQLite. I didn’t find any way to activate WAL on a Geopackage FeatureWriter in order to avoid lock problems.How can I use WAL on Geopackage ? Is it available in later release ? 

Hello, I am using FME Form 2025 and looking to write  shapefiles/ geodbs dynamically to an ArcSDE Geodb.My issue is that  where my source data has the data type VARCHAR2 it is written into Oracle as NVARCHAR2.According to our database manager our preference is VARCHAR2 due to: “VARCHAR stores each character using a single byte, NVARCHAR columns typically consume twice as much storage space as equivalent VARCHAR columns.”I have tried multiple options of resetting the data types and writing out either using automatic attribute definition or dynamic (using the readers schema), but in any case the final table stores NVARCHAR2.Is it possible to change the data type from within FME?Many Thanks!

Hi all, how do I easiest update change the field type in a GDB?Esri Introduced the BigInteger, which is giving me a lot of issues. It dosn’t work in all applications, and I can’t even do a relate or join on it. I need to get it into a integer. For some reason the data we get delivered now on a weekly basis has all the number fields in BigInteger.I need it to find the BigInteger Fields, and change the type, without loosing data. The data also fits an normal integer.Any thoughts would be much appreciated. Thanks  

Hi, I'm having an issue with a Microsoft Access Reader. I have a script that reads a query from Access. This query is a subquery of two other queries. Until now, the script has always worked, but now the query reader doesn't show anything.  

Hi, taking my first steps in the FME REST API and webhooks, and struggling on passing coordinates. I published a simple workspace to FME server using the Geometry Pïcker as only parameter, the drawn polygon is noted in GeoJson, like:{"type":"Polygon","coordinates":[[[3.732869,51.016178],[3.733537,51.016688],[3.734896,51.015998],[3.734086,51.015473],[3.732869,51.016178]]]} I created a webhook from this workspace, the URL preview shows the special characters should be encoded, like:https://FMEserver/workspace.fmw?DrawnPolygon=%7B%22type%22%3A%22Polygon%22%2C%22coordinates%22%3A%5B%5B%5B3.732869%2C51.016178%5D%2C%5B3.733537%2C51.016688%5D%2C%5B3.734896%2C51.015998%5D%2C%5B3.734086%2C51.015473%5D%2C%5B3.732869%2C51.016178%5D%5D%5D%7D&opt_showresult=false&opt_servicemode=sync  but, when I GET-request through this URL, the workspace fails:55 2021-12-7 17:05:35 | A JSON syntax error was found at line 1, column 256 2021-12-7 17:05:35 | Unexpected character: 't'. One of the following ch

Hello FME Community,I need to divide a line FC into 100 m segments. I can reach that with the IterativeSnippet transformer, but I have an issue with the leftovers; I don't want to divide the leftovers. In another way, I need to keep the leftover to be joined or merged with the last segment to avoid generating segments with 0. X values or other small values like 1 or 2 meters.Is there any possible way to reach this in FME? 

Hi, I’m struggling to tag a set of features with an ID, input data looks like the left case in this image:What I want is shown on the right. My input has a line of data with the ID, and it’s implied each record after that has that ID, until a record resets the ID for the subsequent features. Here’s a very similar example but differs from mine in that my ID is on a separate line: It seems like a Python caller might work, but I’m not very handy with Python & FME. Any suggestions welcome. Thanks in advance!

I am trying to do a very basic read/write of an annotation feature class from one file geodatabase to another. In my case, I’m first running a PythonCaller transformer to remove any and all annotation feature classes in the target file geodatabase, then I use a FeatureReader to read the annotation feature class from the source file GDB, and then run a FeatureWriter to write the annotation FC to the target geodatabase with “Insert” and “Create if Needed” options selected for the table, which I assume is creating a new annotation feature class in the target FGDB.Regardless of minor tweaks I make to both the FeatureReader and FeatureWriter transformers, FME Flow keeps writing these as individual features instead of bulk features. There are ~450k annotation features in the feature class, so running this by writing individual features takes over an hour, which will not work for our scenario.Interestingly, the first time I ran this in an earlier workspace, FME Flow used the bulk feature sett

Hi all,Trying to set up workspaces in Form that read files directly from my ACC project using a web connection. However, my project isn’t appearing under my Hub? Appreciate this is vague but any suggestions would be great! Update - there seems to be two environments - one linked to autodesk EU and one linked to autodesk UK - not sure if this is impactful!  2nd update - one (UK) environment i can install the FME app on Autodesk but on the EU one i dont have this option - will the project not appear if the Autodesk FME app is not installed? Thanks  

Hello...I've created a HTML report using HTMLReportGenerator/HTML Writer and am trying to write this report to a pdf but have not been successful. I've tried connecting both a pdf FeatureWriter and a PDF Writer to the HTMLReportGenerator output and do get a pdf file created but it's blank. Thanks.

I've run into this issue multiple times now, and it's quite serious. My SQL table writer was set to automatic and selected TINYINT as the datatype. However, one of the values I attempted to write was 5000, which exceeds the valid range for TINYINT. As a result, I expected 57 rows to be written, but only 51 actually made it into the database. Because the system only throws a warning (and buries it in a long list of logs), this kind of data loss can easily go unnoticed unless you're scanning through potentially hundreds of warnings. The warning I wish to flag or somehow cause the workbench to fail if it occurs:2025-07-17 14:15:40| 0.5| 0.0|WARN |Microsoft SQL Server Non-Spatial Writer: Failed to parse Unsigned TinyInt' from attribute value 5000' for column `How many kilolitres (kL) of liquid waste was generated?' Silent data loss is extremely dangerous in data pipelines. How can I flag this better. I am quite surprised FME doesn’t do this by default. I am sure this has impacted many peop

I’m working on a flood-affected buildings project in St. Pauli, Hamburg, using FME’s SpatialFilter transformer. I uploaded an image of my setup (see attached). Almost all buildings are being rejected, and I’m not sure why. My buildings are the "generic object," and the flooding areas are the clipped ones.  

I want to re-project an image file into CRS EPSG 20047 BCSG2020But that CRS is missing from my drop-down list.I am running FME Desktop FME(R) 2022.1.3.0 (20220928 - Build 22630 - WIN64) Is CRS EPSG 20047 BCSG2020 available in a more current version? 

I know I that you cannot delete feature under DWG, but what if you want seleteed a few because one of them is bad.  I am GIS Specialist and I have the DWG files here… The DWG I have is a campgound that somebody worked on it and gave it to use and as I prepare to make a map for that campground and discovered that one of the entity I think “X” is out of  place.What I was trying to open the 2024.1 Data Inspector and bring that Dataset into the View to see it andI use the X to turn it off and use the Save As as a new Dataset without the  “X” layer . When I save it and it still  comes with it every time. I tried to use different method.here is the screen shot I have here.  The one I want to remove this X layer under the DWG Layer is “X” . The Red line I drew is that one that I want to delete it. I don’t have the latest version to 2025 yet… Can anyone tell me if there is another way around to fix this ?          

Hello, I'm currently working with FME 2022.1 on NETCDF files from https://daac.ornl.gov/cgi-bin/dsviewer.pl?ds_id=1851 The files are .nc4 and when I try to open them on FME Workbench I have this warning. (on picture) It seems that FME can't link the dimensions defined in the file with its own "lat/lon and time functions" I tried opening these files on ArcMap 10.8.1 and the dimensions are immediately recognized correctly.  How can I make FME understand that lat = lat, lon = lon and time = time ? Or how can I set it when reading the nc4 file ?  

Hi everyone,I'm working with a topologically accurate line network in FME 2023.1.1.1. I have:Two source points located at the start points of some lines (also refer to pipe-network_plus_point-features.png)→ the blue rhombusValves represented as point features, located somewhere along the lines (not necessarily at endpoints)→ the magenta colored pointsMy goal is to identify all topologically connected lines starting from each of the sources and continuing until the valves are reached. Each group of connected features should be treated as a separate subnetwork. In this case, I expect to identify two distinct subnetworks, one for each source. Also refer to desired_result.png and the detail 1 and 2.Has anyone tackled something similar? I’m looking for a solution that ideally avoids using Python and relies on standard FME transformers (e.g., using loops or topology-based logic).Any suggestions or best practices would be greatly appreciated!Thanks in advance

We've set up a process for a client that takes data and writes it to CSV. That CSV is then loaded into a data warehouse.That CSV conforms to the official CSV standards and thus the last line ends with a CR/LF:Shown here in Notepad++. This means there's a last, empty, line in the file. The data warehouse system apparently cannot handle this. Is there a way to remove this last CR/LF from the file? (post-processing python, probably).I must admit I am not convinced this should be fixed on the FME side, but trying to get the data warehouse developers to move on this is not going to happen.

The scenario is   The ask how can i eliminate to read from row 1. The attributes that I intend to process is No, Name and ID

I would like to publish the app so that the end user can optionally select a variety of filters including:date ranges static attribute fields (A or T) dynamic input fields (for example if a new business code is added to the source data)I have been able to publish the user parameters in the app but the data does not filter from the results set.  

Hi All, I’m having an issue writing out to GDB with a schema dataset. The workflow extracts multiple GeoJSONs from some GSI open Datasets (example path below), clips them to an AOI and extracts them to a GDB. There are around 50 datasets in total .The actual reading of the data seems fine:data features = Geojson format read through a feature reader schema reader = Schema Feature (Any Dataset) format reading the Geojson (n.b. when reading using the schema port of the feature reader, I can’t get it to read schema from multiple datasets, hence why have this separate)I am writing through a FeatureWriter - see settings in screenshot below.The annoying thing is that sometime it works, then I select a new set of features and then it doesn’t, and I can’t seem to find a pattern. However checking the input table before the Writer, everything (I think) looks ok. It feels like there must be something that is not right, but just can’t seem to pinpoint it. Any ideas would be greatly appreciated 🙂?