Data

Learn From My Mistake:We have a line of business system that is difficult to “pull” data from. I did, however, discover that it has the ability to generate and email data extracts on a schedule. Combine this with the ability to email files to our FME Flow Server, and the job became doable. The only minor hang-up was that the system could only generate these extracts in XLSX format. “No problem,” a more naive me thought, “I can use an Excel reader to pull this tabular data out easily!”The process worked great for our smaller datasets (< 10k rows) and ran most jobs in less than a minute, so I began exporting more data this way. Fast forward a little bit, and I discover that some of my newest extracts are taking up to 4 HOURS to process. Slightly panicked, I disable the extracts and dig-in. Looking at the logs, the workspace first seems to be lagging on a PythonCaller I was using to massage the data after extraction, so I re-tool it into using vanilla transformers. Test locally - works

Hi :)I’m trying to add the vector map from basemap.de as my background map for exports in FME 2026.2. However, I cannot make it work. I used the following link and MVT as my feature reader.I get an error regarding a missing API key. Has anyone ever used basemap.de as their background map and can tell me if there’s a simpler way to add it (and also be able to crop the data to my AOI before reading all of it, which covers the entire country), or if I need to somehow request an API code to use this map?Here’s the link (which I am also not sure if it’s the correct one):https://sgx.geodatenzentrum.de/gdz_basemapde_vektor/tiles/v2/bm_web_de_3857/bm_web_de_3857.jsonThanks!

Hi community.The managed web services are fantastic, especially for sharing connections and data sources through FME Flow.I have a question about how we can recreate a URL call from a token service from an Oauth enabled end point.The web connection I have works as intended in Form and occasionally falls over in Flow (maybe 1 in 10) and I am attempting to troubleshoot.To do so I am trying to connect to the web service endpoint by building the URL that the token service creates through the Web services in FME.Does anyone have a template that can show me where each of the fields are built into a URL call so I can substitute in the values I have in the request URL, request Data, Token Object Key and Header fields?I am assuming I’ll have to strip out some fields that aren’t needed and maybe use some additional fields that form populates automatically but I just need somewhere to start from.This is how I have it set-up but not all of the details are in the request data field.Thank you.Michae

Hi, I read gdb data, simply changed the data attribute type, and when outputting the gdb data, I selected Dynamic Schema Definition, Schema Sources* chose "Schema From Schema Feature", cleared the attributes, why is the output gdb empty?  

We’ve been working through Data Reviewer errors while transitioning our water data to the Utility Network, and FME has been really useful for tackling some of the issues in bulk.I’ve used transformers like the GeometryValidator and SpatialRelator to identify/fix geometry issues and relationships between features, but I’m curious what others have found useful. The ones I’ve used have only helped to an extent and sometimes actually don’t end up getting rid of the errors when I run data reviewer reports in Arc Pro.For anyone who has gone through a UN migration, what FME transformers or workflows helped you clean up Data Reviewer errors before moving into production? Any unexpected transformers that ended up being especially useful?

Today I placed a default value for a date User Parameter as@DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-14,'day'),'%Y%m%d')essentially the date widget in FME flow would go back 2 weeks, this used to work fine…. But alas, in 2026 it is now returning something wild Where is this highlight in Change logs? I read something about ‘better support for SQL date’… but nothing about Date\Time functionsAm I supposed to use this now ?a new datatime function?Here is the help documentation https://docs.safe.com/fme/2026.1/html/FME-Form-Documentation/FME-Form/!Transformer_Parameters/Date-Time-Functions.htmWhen we upgrade transformers, will the @DateTimeNow() functions get transformed into @CurrentDateTime ?Also the @DateTImeAdd is this going to be converted to @AddDateTime I can see the syntax @AddDateTime(<datetime>,<interval>)https://en.wikipedia.org/wiki/ISO_8601#Durations So this @DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-14,'day'),'%Y%m%d')has become@DateTimeFormat(@AddDateTime(@Cu

Hi brains trust!Does anyone know how to determine how 2 x polygon geometry might change being passed into Change Detector original vs revised. I’ve set Check Geometry with the parameters to be lenient and using 1.5m tolerance for exampleI know how to explain the change list, exploding and keeping these attributegeometryObject has changed, but how muchI had considered extracting the geometry of orig and revised to an attribute, then passing it into AreaOnAreaOverlayer? GeometryExtractor / Clipper arrangement Calculating the area to attribute and comparing differences in attribute values I’m trying to see if Geometry Concepts traits can be used here?Any thoughts?

Hi there,I'm currently trying to find a way to unlock the geometry off all scope box options that are part of a Revit file. The main idea is to write the Revit file into a GIS format and be able to filter the overall geometry by the different scope box options. However, I can’t seem to find/get the scope box geometry (or any coördinates related to a scope box) from a Revit file. I can only find some references to the scope box names. For testing I used the first option of Snowdon Towers - Architectural file on this page: https://help.autodesk.com/view/RVT/2024/ENU/?guid=GUID-61EF2F22-3A1F-4317-B925-1E85F138BE88In the example file there are 4 options for Scope Box settings: Views Overall, Grids, Levels or None. In Revit we can see the whole project using Views Overall, but for example with Grids the outside garage entrance is filtered out. Also we can see the geometrie of those scope boxes within Revit and the filter area it uses.Here the two different views:View Overall Scope Box Grids

When we’re using FME Flow as our Connection Store. We’ve been noticing that some parameters of webservices start to disappear or change. Examples: Redirect URLs go blank, configuration of headers change, etc. We’ve been seeing this phenomenon in our AGOL web services and SharePoint List web services. Has anyone else seen this type of behavior?Here is our setup:FME Form/Flow: 2025.1.2 (Build 25630) FME Flow is a distributed deployment (1 core + 5 engine machines) Accessing FME Form (and the Connection Store) via Citrix/Azure Virtual DesktopTo resolve the issue: We either have to fill the in blanks/fix the issues or drop the web connection and web service completely and start from scratch.We’re just trying to understand what might be causing this.Thanks in advance!(I am sure this isn’t the correct Category, but nothing else fit as an option here.)

Hi allI have a FME job that reads XX amount of excel files from a folder using a Excel reader simply set to read “folder name\*.xls”All of the excel files have different file names but with the exact same columns in the files themselves. its a whole bunch of log files. most of the files have many features but sometimes there are logs with no recorded features.My FME job reads all the excel files and imports the contents into one table in a database and then another job moves the files that have contents that have been imported into a subfolder as a backup. But if a log file doesnt have any features and only contains the column names and no futher rows it is never read into FME which means i cant get the filenames to move the files into the subfolder.I could use a directory and file pathnames reader to get the file names to move them but then i wouldnt have a way to know if they are really empty or if there is just some error in the column names or something else unforeseen.Long questio

Hello everyoneI am currently using FME Workbench 2025.0 (FME(R) 2025.0.3.0 (20250602 - Build 25241 - WIN64)) in combination with ArcGIS Pro 3.5. When attempting to add a File Geodatabase to my workspace, I encounter the following error:"Unable to perform any licensing-related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator → Workspace Parameters → Translation. This 64-bit version of FME requires ArcGIS Desktop with 64-bit Background Geoprocessing, ArcGIS Pro, or ArcGIS Enterprise. Refer to this article: http://fme.ly/qua for more details."Additionally, the following message appears:"Failed to obtain any schemas from reader 'GEODATABASE_FILE' from 1 dataset. This may be due to invalid datasets or format accessibility issues related to licensing, dependencies, or module loading. See the log file for more information."The workspace generation fails I have attached a screenshot of my current FME Options and Navigator settings for your reference. C

Hi, I am having an issue with writing out data as .txt pipe delimited in the exact same format as the original data. The original data used a CSV reader in order to work with the attributes I needed to modify. But when I try to write it out again as .txt, the format is never exactly the same. I have tried padding the fields, but it does not work. Example:Original-# gbaddr field view OutputAlso, in the output, it continues to add a pipe (|) to the end of each record; the original did not and I need it to not add it in the output.  Any ideas are welcome!

In 2026 build, the new ArcGIS Feature Services package replaces the older Portal Feature Service reader. The change is well documented in the article Working with Esri ArcGIS Feature Services in FME – FME Support CenterMy question to a Safer is, how/when are 2026 deprecated formats like PORTALFEATURESERVICE listed in the article FME Deprecations – FME Support Center.the new unified ARCGISFEATURESERVICE package replaced arcgis x feature service formatsCan these now older ArcGIS Feature Service formats be added to the article; along with Recommendation actions listing out sections/bookmarks from the support article Question about deprecations articleWhen do components get included to the article and how is it updated?  is this a manual task or can the development team inform earlier updates when components are planned to be replaced?Recently for example, randomly FME Date Time functions got added to the article, where it was listed as affecting in 2026.1…. yet we were already at 2026.2 r

Hi, I want to calculate a new attribute using the attributecreator with Text Editor:  But I my results are always the source values:What is my mistake?Thank you for your support! 

I have created a very simple workspace with a creator which creates a line and writes it to a GeoPackage using a FeatureWriter.The line is 2D, no measures, but the geometry type in the resulting GeoPackage is reported by ogrinfo as “3D Measured Multi Curve”.I would expect the result to be a 2D LineString instead - or maybe just LineString. As seen in the image I have exported the geometry to WKT and it indeed reports it as “LINESTRING (400000 6040000,900000 6400000)”.Is this the expected behaviour and is the FeatureWriter geometry type detection headed towards the broadest category for data instead of a more narrow approach?The test has been done using FME Form 2026.2 (26333) on Windows.

Hi there,I am importing connections from an older deployment of FME Flow into Form, in order to publish to a new FME Flow. When I do so their names are locked to whatever they were named before.  These names do not confirm to our new naming convention.  It would be helpful to be able to rename Web and DB connections in Form. I understand this would possibly break workspaces referencing this, but this is a risk I am willing to take.

Hi,I have a dynamic feuture writer which writes tables from my PostGreSQL/PostGIS database to a geopackage. Some of the source tables are with no geometry and some are with. This is why I have two readers, one for Posgresql and one for PostGIS. I write all the tables dynamicly to the geopackage with a FeatureWriter and have set the geometry type to read from schema definition. In the resulting geopackage I see the table which should not have a geometry with a geom attribute with all null values. The table gpkg_contents has a data_type features instead of attributes. When I try the same with a manual definition it works fine.QGIS does not seem to have any problems with the geopackage that has the wrong definition, but ArcGIS Pro has. How can i get the dynamic writer to write correct to the geopackage? Or is this a bug or a works as designed? I run FME 2023, but also tried it with FME 2025.Thank you all

I'd like to read a DGN file, which contains a terrain model. In version 2025.1.2 it is being read as igds_polygon_collection. The fme_Geometry is “fme_undifined” and the fme_type is “fme_no_geom”.When using a Civil 3D file, it can read a surface model, which is the same principle as the terrain model in a DGN. The terrain model is created in OpenRoads.Or is another option available to read the terrain model directly from a DGN file without converting it to another fileformat or element type?  

I have a non-spatial Oracle table fifteen attribute columns, two of which columns store images.One column is called “image” and the other column is called “thumbnail”Both store images in jpeg format.All of the jpegs are less than 1MB in file sizeI want to write this table to PostGISI have constructed a table in PostGIS with the columns “image” and “thumbnail” both defined as bytea How do I write the workspace that Reads from Oracle and Writes to PostGIS? I made an attempt, but now FME fails to display the data from the PostGIS table, so there is something wrong. My version of FME Desktop isFME(R) 2022.1.3.0 (20220928 - Build 22630 - WIN64) 

I have encountered an issue where using a Snowflake writer will either cause errors or corrupt data if the text field contains emoji characters. This is occurring with FME Form 2025.2.3.0 on Windows 11. If I am writing to a VARCHAR column in Snowflake, the emoji characters will be corrupted but the field will write. If I am writing JSON to a VARIANT column, the workspace will fail with an error. In the past I have just let this issue go because I have been writing to VARCHAR fields. Now that I’m writing JSON to a VARIANT, I need to find a better solution. Although I believe FME 2025 and Snowflake are both using UTF-8, it looks like it is getting converted to something else somewhere along the line. The easiest way I have to test this is to create a Snowflake table:create table mm_temp_utf8_test (text_col varchar, json_col variant);Then I can use a SQLExecutor.If the SQLExecutor just populates the VARCHAR column, it will succeed but the data will be corrupted:insert into mm_temp_utf8_te

When I try to connect the .sde file on FME, I got the this Error. 

 Hello,I would like to remove attributes (or columns?) from my data stream that have no value (missing or null)In below example that means “eindegrarantieperiode” and “integraalproject” need to be removed. Note: can we do this dynamically? I don't want to manually go through 50+ attributes to check if they contain a value or not.(FME 2025.0) 

Hi all,I am trying to write a dynamic Excel formula (=SUBTOTAL(103, A2)) to an Excel sheet using FME Form, so that it evaluates automatically when a user opens the spreadsheet. However, FME keeps writing the formula as a literal text string (showing =SUBTOTAL(103, A2) in the cell) instead of calculating the actual formula.Here is what I have configured so far based on the documentation: AttributeManager: Created an attribute named ZICHTBAAR.formula Value set to: =SUBTOTAL(103; A2) (or with a comma depending on locale) I also exposed the base attribute ZICHTBAAR without the extension. Excel Writer Feature Type (User Attributes): The column ZICHTBAAR is present. I tried setting the Data Type to both string and auto. The issue: When running the workspace and opening the output file in Excel, the cells still show the raw formula text. It only evaluates to 1 or 0 if I manually double-click the cell and press Enter, or force a hard recalculation.What am I missing to

Hello,We are currently upgrading an FME-based application for one of our customers from FME 2020 to FME 2024, and we have encountered an issue that appears to be related to coordinate system handling.The application uses FME to convert a set of DGNV8 drawings into an MS SQL Server database. For some drawings, we observe a positional shift of approximately 10 centimeters (a few decimeters at most) after processing.In the DGNV8 Reader, the Coordinate System parameter in the Navigator window is set to "".When inspecting the source datasets with FME Data Inspector in FME 2020, all drawings are reported as having an Unknown Coordinate System, regardless of which file is opened.However, in FME 2024, we see different behavior:For some drawings, Data Inspector reports the coordinate system as EPSG:28992. For other drawings, it reports NationalRD-NL.The drawings belonging to the latter group appear to be shifted relative to the other drawings.My questions are:Is this behavior related to differe

Hi there, Could I please have an update on if the I3S writer support point clouds after the release of 2023.1.1? If not then could I please have an update on the timeframe on this? Thanks, Shilpa