Using readers and writers to extract and load data.
Recently active
Hi allI have a FME job that reads XX amount of excel files from a folder using a Excel reader simply set to read “folder name\*.xls”All of the excel files have different file names but with the exact same columns in the files themselves. its a whole bunch of log files. most of the files have many features but sometimes there are logs with no recorded features.My FME job reads all the excel files and imports the contents into one table in a database and then another job moves the files that have contents that have been imported into a subfolder as a backup. But if a log file doesnt have any features and only contains the column names and no futher rows it is never read into FME which means i cant get the filenames to move the files into the subfolder.I could use a directory and file pathnames reader to get the file names to move them but then i wouldnt have a way to know if they are really empty or if there is just some error in the column names or something else unforeseen.Long questio
Hi brains trust!Does anyone know how to determine how 2 x polygon geometry might change being passed into Change Detector original vs revised. I’ve set Check Geometry with the parameters to be lenient and using 1.5m tolerance for exampleI know how to explain the change list, exploding and keeping these attributegeometryObject has changed, but how muchI had considered extracting the geometry of orig and revised to an attribute, then passing it into AreaOnAreaOverlayer? GeometryExtractor / Clipper arrangement Calculating the area to attribute and comparing differences in attribute values I’m trying to see if Geometry Concepts traits can be used here?Any thoughts?
Hello everyoneI am currently using FME Workbench 2025.0 (FME(R) 2025.0.3.0 (20250602 - Build 25241 - WIN64)) in combination with ArcGIS Pro 3.5. When attempting to add a File Geodatabase to my workspace, I encounter the following error:"Unable to perform any licensing-related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator → Workspace Parameters → Translation. This 64-bit version of FME requires ArcGIS Desktop with 64-bit Background Geoprocessing, ArcGIS Pro, or ArcGIS Enterprise. Refer to this article: http://fme.ly/qua for more details."Additionally, the following message appears:"Failed to obtain any schemas from reader 'GEODATABASE_FILE' from 1 dataset. This may be due to invalid datasets or format accessibility issues related to licensing, dependencies, or module loading. See the log file for more information."The workspace generation fails I have attached a screenshot of my current FME Options and Navigator settings for your reference. C
Hi, I am having an issue with writing out data as .txt pipe delimited in the exact same format as the original data. The original data used a CSV reader in order to work with the attributes I needed to modify. But when I try to write it out again as .txt, the format is never exactly the same. I have tried padding the fields, but it does not work. Example:Original-# gbaddr field view OutputAlso, in the output, it continues to add a pipe (|) to the end of each record; the original did not and I need it to not add it in the output. Any ideas are welcome!
In 2026 build, the new ArcGIS Feature Services package replaces the older Portal Feature Service reader. The change is well documented in the article Working with Esri ArcGIS Feature Services in FME – FME Support CenterMy question to a Safer is, how/when are 2026 deprecated formats like PORTALFEATURESERVICE listed in the article FME Deprecations – FME Support Center.the new unified ARCGISFEATURESERVICE package replaced arcgis x feature service formatsCan these now older ArcGIS Feature Service formats be added to the article; along with Recommendation actions listing out sections/bookmarks from the support article Question about deprecations articleWhen do components get included to the article and how is it updated? is this a manual task or can the development team inform earlier updates when components are planned to be replaced?Recently for example, randomly FME Date Time functions got added to the article, where it was listed as affecting in 2026.1…. yet we were already at 2026.2 r
Hi, I want to calculate a new attribute using the attributecreator with Text Editor: But I my results are always the source values:What is my mistake?Thank you for your support!
I have created a very simple workspace with a creator which creates a line and writes it to a GeoPackage using a FeatureWriter.The line is 2D, no measures, but the geometry type in the resulting GeoPackage is reported by ogrinfo as “3D Measured Multi Curve”.I would expect the result to be a 2D LineString instead - or maybe just LineString. As seen in the image I have exported the geometry to WKT and it indeed reports it as “LINESTRING (400000 6040000,900000 6400000)”.Is this the expected behaviour and is the FeatureWriter geometry type detection headed towards the broadest category for data instead of a more narrow approach?The test has been done using FME Form 2026.2 (26333) on Windows.
Hi there,I am importing connections from an older deployment of FME Flow into Form, in order to publish to a new FME Flow. When I do so their names are locked to whatever they were named before. These names do not confirm to our new naming convention. It would be helpful to be able to rename Web and DB connections in Form. I understand this would possibly break workspaces referencing this, but this is a risk I am willing to take.
Today I placed a default value for a date User Parameter as@DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-14,'day'),'%Y%m%d')essentially the date widget in FME flow would go back 2 weeks, this used to work fine…. But alas, in 2026 it is now returning something wild Where is this highlight in Change logs? I read something about ‘better support for SQL date’… but nothing about Date\Time functionsAm I supposed to use this now ?a new datatime function?Here is the help documentation https://docs.safe.com/fme/2026.1/html/FME-Form-Documentation/FME-Form/!Transformer_Parameters/Date-Time-Functions.htmWhen we upgrade transformers, will the @DateTimeNow() functions get transformed into @CurrentDateTime ?Also the @DateTImeAdd is this going to be converted to @AddDateTime I can see the syntax @AddDateTime(<datetime>,<interval>)https://en.wikipedia.org/wiki/ISO_8601#Durations So this @DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-14,'day'),'%Y%m%d')has become@DateTimeFormat(@AddDateTime(@Cu
Hi,I have a dynamic feuture writer which writes tables from my PostGreSQL/PostGIS database to a geopackage. Some of the source tables are with no geometry and some are with. This is why I have two readers, one for Posgresql and one for PostGIS. I write all the tables dynamicly to the geopackage with a FeatureWriter and have set the geometry type to read from schema definition. In the resulting geopackage I see the table which should not have a geometry with a geom attribute with all null values. The table gpkg_contents has a data_type features instead of attributes. When I try the same with a manual definition it works fine.QGIS does not seem to have any problems with the geopackage that has the wrong definition, but ArcGIS Pro has. How can i get the dynamic writer to write correct to the geopackage? Or is this a bug or a works as designed? I run FME 2023, but also tried it with FME 2025.Thank you all
I'd like to read a DGN file, which contains a terrain model. In version 2025.1.2 it is being read as igds_polygon_collection. The fme_Geometry is “fme_undifined” and the fme_type is “fme_no_geom”.When using a Civil 3D file, it can read a surface model, which is the same principle as the terrain model in a DGN. The terrain model is created in OpenRoads.Or is another option available to read the terrain model directly from a DGN file without converting it to another fileformat or element type?
I have a non-spatial Oracle table fifteen attribute columns, two of which columns store images.One column is called “image” and the other column is called “thumbnail”Both store images in jpeg format.All of the jpegs are less than 1MB in file sizeI want to write this table to PostGISI have constructed a table in PostGIS with the columns “image” and “thumbnail” both defined as bytea How do I write the workspace that Reads from Oracle and Writes to PostGIS? I made an attempt, but now FME fails to display the data from the PostGIS table, so there is something wrong. My version of FME Desktop isFME(R) 2022.1.3.0 (20220928 - Build 22630 - WIN64)
I have encountered an issue where using a Snowflake writer will either cause errors or corrupt data if the text field contains emoji characters. This is occurring with FME Form 2025.2.3.0 on Windows 11. If I am writing to a VARCHAR column in Snowflake, the emoji characters will be corrupted but the field will write. If I am writing JSON to a VARIANT column, the workspace will fail with an error. In the past I have just let this issue go because I have been writing to VARCHAR fields. Now that I’m writing JSON to a VARIANT, I need to find a better solution. Although I believe FME 2025 and Snowflake are both using UTF-8, it looks like it is getting converted to something else somewhere along the line. The easiest way I have to test this is to create a Snowflake table:create table mm_temp_utf8_test (text_col varchar, json_col variant);Then I can use a SQLExecutor.If the SQLExecutor just populates the VARCHAR column, it will succeed but the data will be corrupted:insert into mm_temp_utf8_te
When I try to connect the .sde file on FME, I got the this Error.
Hello,I would like to remove attributes (or columns?) from my data stream that have no value (missing or null)In below example that means “eindegrarantieperiode” and “integraalproject” need to be removed. Note: can we do this dynamically? I don't want to manually go through 50+ attributes to check if they contain a value or not.(FME 2025.0)
Hi all,I am trying to write a dynamic Excel formula (=SUBTOTAL(103, A2)) to an Excel sheet using FME Form, so that it evaluates automatically when a user opens the spreadsheet. However, FME keeps writing the formula as a literal text string (showing =SUBTOTAL(103, A2) in the cell) instead of calculating the actual formula.Here is what I have configured so far based on the documentation: AttributeManager: Created an attribute named ZICHTBAAR.formula Value set to: =SUBTOTAL(103; A2) (or with a comma depending on locale) I also exposed the base attribute ZICHTBAAR without the extension. Excel Writer Feature Type (User Attributes): The column ZICHTBAAR is present. I tried setting the Data Type to both string and auto. The issue: When running the workspace and opening the output file in Excel, the cells still show the raw formula text. It only evaluates to 1 or 0 if I manually double-click the cell and press Enter, or force a hard recalculation.What am I missing to
Hello,We are currently upgrading an FME-based application for one of our customers from FME 2020 to FME 2024, and we have encountered an issue that appears to be related to coordinate system handling.The application uses FME to convert a set of DGNV8 drawings into an MS SQL Server database. For some drawings, we observe a positional shift of approximately 10 centimeters (a few decimeters at most) after processing.In the DGNV8 Reader, the Coordinate System parameter in the Navigator window is set to "".When inspecting the source datasets with FME Data Inspector in FME 2020, all drawings are reported as having an Unknown Coordinate System, regardless of which file is opened.However, in FME 2024, we see different behavior:For some drawings, Data Inspector reports the coordinate system as EPSG:28992. For other drawings, it reports NationalRD-NL.The drawings belonging to the latter group appear to be shifted relative to the other drawings.My questions are:Is this behavior related to differe
Hi there, Could I please have an update on if the I3S writer support point clouds after the release of 2023.1.1? If not then could I please have an update on the timeframe on this? Thanks, Shilpa
I'm seeing the following lines in the Translation Log:AutoCAD Reader: Entity type of 'AeccDbAlignmentStationLabeling' found, but not supported. Skipping entityAutoCAD Reader: Entity type of 'AeccDbAlignmentMinorStationLabeling' found, but not supported. Skipping entityI'm reading a .DWG in as an AutoCAD Civil 3D format file. Am I interpreting this correctly that station labels are not supported by FME?
I am writing AutoCAD DWG with changing areas/extents. My template file defines the styling. When opening the file in CAD it zooms to a blank area (possibly from the extents of the template file) and I need to zoom to extents to find my current area. Is it possible to either remove any extent information from the template file, or force the output DWG file to zoom in on the current area extents?
I am using FME to write to microstation DGN. The FME workbench file is using the fanout option to write different areas to the microstation DGN file, based on the same seed file. At the moment I have to use a microstation macro to "fitview" of each produced file in order to have the microstation file centered at each specific area. I rather use only FME to avoid this additonal step.Is there a way / transformer in FME to save the microstation file centered in the written data?
Has anyone successfully connected to Snowflake using OAuth? We have been using a local account to connect to Snowflake but have recently been requested to use an Azure based OAuth connection. We have an assigned client ID, key and refresh url available but need to understand how to make the calls. Thanks!
Has anyone been able to mine Oracle redo logs using logminer? I’m beginner to Oracle but it seems to me that it should be possible. I’m trying to create cdc process from Oracle to postgres and I’m able to query insert and update operations sufficiently enough from date fields that tell me when rows are updated or inserted. However, I can’t catch delete operations that way and it would be beneficial to be able to read the redo logs for the actual operations. I know I can query and compare id’s from source and target to detect deleted rows. However, this is time consuming because that would mean querying hundreds of millions of rows for the workflow.If I understood correctly, I need to setup DBMS_LOGMNR package and session for the logminer to be able to query V$LOGMNR_CONTENTS that would hold the transaction information. I guess DBMS_LOGMNR is part of Oracle database? Would that mean that I need Oracle database installed with license to be able to use logminer? The source Oracle database
Has anyone already added the following coordinate systems to FME:For Bonaire: EPSG:10759 (2D) or EPSG:10764 (3D)For Saba: EPSG:10641 (2D) or EPSG:10645 (3D)For St. Eustatius: EPSG:10745 (2D) or EPSG:10747 (3D)
Hi,I’m currently struggling to figure out how to convert a LOD2 3D-Multipatch from a FileGDB into CityGML. I do currently not have a program available to open or edit CityGML files, but it might be important at a later stage to be able to convert the data back into CityGML. Is it generally possible to convert any multipatch into a CityGML file at a later stage, or is important information lost in the process?How do I ensure that a distinction is made between Wall, Roof, Ground, and Closure Surface? Or is it all simply classified as Building?I've already looked at the website Writing CityGML from FME, but unfortunately, I still don't know how to proceed. How do I know which ‘citygml_lod_name’ value to use? If multiple values yield a result, should I use all of them parallel?I would be grateful for any tips to help me understand this better…Thank you! My first attempt of a workbench...