Using readers and writers to extract and load data.
Recently active
Hello,I would like to remove attributes (or columns?) from my data stream that have no value (missing or null)In below example that means “eindegrarantieperiode” and “integraalproject” need to be removed. Note: can we do this dynamically? I don't want to manually go through 50+ attributes to check if they contain a value or not.(FME 2025.0)
Hi all,I am trying to write a dynamic Excel formula (=SUBTOTAL(103, A2)) to an Excel sheet using FME Form, so that it evaluates automatically when a user opens the spreadsheet. However, FME keeps writing the formula as a literal text string (showing =SUBTOTAL(103, A2) in the cell) instead of calculating the actual formula.Here is what I have configured so far based on the documentation: AttributeManager: Created an attribute named ZICHTBAAR.formula Value set to: =SUBTOTAL(103; A2) (or with a comma depending on locale) I also exposed the base attribute ZICHTBAAR without the extension. Excel Writer Feature Type (User Attributes): The column ZICHTBAAR is present. I tried setting the Data Type to both string and auto. The issue: When running the workspace and opening the output file in Excel, the cells still show the raw formula text. It only evaluates to 1 or 0 if I manually double-click the cell and press Enter, or force a hard recalculation.What am I missing to
Hello,We are currently upgrading an FME-based application for one of our customers from FME 2020 to FME 2024, and we have encountered an issue that appears to be related to coordinate system handling.The application uses FME to convert a set of DGNV8 drawings into an MS SQL Server database. For some drawings, we observe a positional shift of approximately 10 centimeters (a few decimeters at most) after processing.In the DGNV8 Reader, the Coordinate System parameter in the Navigator window is set to "".When inspecting the source datasets with FME Data Inspector in FME 2020, all drawings are reported as having an Unknown Coordinate System, regardless of which file is opened.However, in FME 2024, we see different behavior:For some drawings, Data Inspector reports the coordinate system as EPSG:28992. For other drawings, it reports NationalRD-NL.The drawings belonging to the latter group appear to be shifted relative to the other drawings.My questions are:Is this behavior related to differe
Hi there, Could I please have an update on if the I3S writer support point clouds after the release of 2023.1.1? If not then could I please have an update on the timeframe on this? Thanks, Shilpa
I'm seeing the following lines in the Translation Log:AutoCAD Reader: Entity type of 'AeccDbAlignmentStationLabeling' found, but not supported. Skipping entityAutoCAD Reader: Entity type of 'AeccDbAlignmentMinorStationLabeling' found, but not supported. Skipping entityI'm reading a .DWG in as an AutoCAD Civil 3D format file. Am I interpreting this correctly that station labels are not supported by FME?
I am writing AutoCAD DWG with changing areas/extents. My template file defines the styling. When opening the file in CAD it zooms to a blank area (possibly from the extents of the template file) and I need to zoom to extents to find my current area. Is it possible to either remove any extent information from the template file, or force the output DWG file to zoom in on the current area extents?
I am using FME to write to microstation DGN. The FME workbench file is using the fanout option to write different areas to the microstation DGN file, based on the same seed file. At the moment I have to use a microstation macro to "fitview" of each produced file in order to have the microstation file centered at each specific area. I rather use only FME to avoid this additonal step.Is there a way / transformer in FME to save the microstation file centered in the written data?
Has anyone successfully connected to Snowflake using OAuth? We have been using a local account to connect to Snowflake but have recently been requested to use an Azure based OAuth connection. We have an assigned client ID, key and refresh url available but need to understand how to make the calls. Thanks!
Has anyone been able to mine Oracle redo logs using logminer? I’m beginner to Oracle but it seems to me that it should be possible. I’m trying to create cdc process from Oracle to postgres and I’m able to query insert and update operations sufficiently enough from date fields that tell me when rows are updated or inserted. However, I can’t catch delete operations that way and it would be beneficial to be able to read the redo logs for the actual operations. I know I can query and compare id’s from source and target to detect deleted rows. However, this is time consuming because that would mean querying hundreds of millions of rows for the workflow.If I understood correctly, I need to setup DBMS_LOGMNR package and session for the logminer to be able to query V$LOGMNR_CONTENTS that would hold the transaction information. I guess DBMS_LOGMNR is part of Oracle database? Would that mean that I need Oracle database installed with license to be able to use logminer? The source Oracle database
Has anyone already added the following coordinate systems to FME:For Bonaire: EPSG:10759 (2D) or EPSG:10764 (3D)For Saba: EPSG:10641 (2D) or EPSG:10645 (3D)For St. Eustatius: EPSG:10745 (2D) or EPSG:10747 (3D)
Hi,I’m currently struggling to figure out how to convert a LOD2 3D-Multipatch from a FileGDB into CityGML. I do currently not have a program available to open or edit CityGML files, but it might be important at a later stage to be able to convert the data back into CityGML. Is it generally possible to convert any multipatch into a CityGML file at a later stage, or is important information lost in the process?How do I ensure that a distinction is made between Wall, Roof, Ground, and Closure Surface? Or is it all simply classified as Building?I've already looked at the website Writing CityGML from FME, but unfortunately, I still don't know how to proceed. How do I know which ‘citygml_lod_name’ value to use? If multiple values yield a result, should I use all of them parallel?I would be grateful for any tips to help me understand this better…Thank you! My first attempt of a workbench...
I am updating an existing table with a feature writer.All data is well updated on all columns of my destination table. However, I have a lot of warning telling me that the column xxxxxx does not exist in table XXXXXXX.In the database, the columns exist, of course.Connecting to ORACLE database `GRISS-RAC-SCAN.smartwork.br.it:1521/ORCLSW_SVIL' with user name of `DAFIF' and password of `***'Connected to ORACLE database `GRISS-RAC-SCAN.smartwork.br.it:1521/ORCLSW_SVIL'Oracle Writer: Going to Oracle Workspace `LIVE'...Using existing column `GEOM' to store geometry in table `WPT'Oracle table 'WPT' already exists. Using existing tableColumn 'DISTANCE' does not exist in table 'WPT'Column 'NAV_CTRY' does not exist in table 'WPT'Column 'NAV_FLAG' does not exist in table 'WPT'Column 'NAV_IDENT' does not exist in table 'WPT'The same error is in different version of FME 2025.1 2026.2I’ve read that another user had had the same error, and he resolved creating different features.
Hello everyone,I am dealing now with something weird in FME after importing a DGN file (see image below). Some text get really huge and some stay the same as in the original DGN file. I have no clue why this happens. I included a small portion of the dgn file as attachment to this post. In the DGNStyler I can change the size, however I would prefer the the text is already shown with the correct text size and I wouldn't like to determine the text sizes depended on the levelname
I am trying to load Dimensions in the ArcGIS Pro Dimensioning Feature Class as described in https://docs.safe.com/fme/html/FME-Form-Documentation/FME-ReadersWriters/geodatabase/Feature_Representation.htm#Dimensions, but FME simply stops running without any error message. Target is File Geodatabase.Before investing time in resolving a problem, can someone please tell me if writing to a ArcGIS Pro Dimensioning Feature Class is supported by FME?I am using FME Workbench 2025.1 and ArcGIS Pro 3.5.6.
I have a excel file with photo link to Fulcrum (a different app). I have to create a template with photo link from my shared resources and id from the excel. I have created the FME process successful. But there are some extra photos that are not mapped to the ID which I need to delete. Which transformer shall i apply.Image above shows my FME process, I want to delete the 6 photos from unused supplier from my original folder. Which transformer shall i apply. and can it access my folder and Delete the photos.
Hello there,The coordinate system Irish National Grid TM65 (EPSG 29902 previously 29900) is not depreciated. It is also not the same CRS as TM75, there are mathematical differences which can effect the coordinate locations. They are both Irish National Grid. The southern Irish Ordnance Survey has moved to using Irish Traverse Mercator (EPSG 2157) but the Northern Ireland state mapping agency is still serving basemapping in TM65. There has been previous posts on this issue but the suggested fix has not worked. I followed the instructions in this post but I could not select EPSG 29902/29903.The only way we can get the translations to work in a workbench is by not setting the CRS on the Reader or the Writer. If we set try to set the CRS in the Reader or try to apply a projection using the ESRIReprojector it won't work.
Is this a bug? I am trying to list and download several files (some have dependencies-- references-- and some don't) and noticed that I cant download files that have an associated reference file.Any thoughts or suggestions?Thanks
I would like to copy an existing file geodatabase and rename it to a different location. I have been reading up on the FILECOPY but can’t make sense of what I’ve seen. Any help is greatly appreciated.
Hello everyone,I have an FME script that processes various data. Upon output, everything goes to a feature service. So far, so good; I have no problems during processing.My issue is very simple to solve, I think, but I can't find the solution.I'm working with agricultural data. For example, when using my script, I might request to use data labeled "18/19/11". Everything works fine, and everything displays perfectly.The problem arises when I only want to work with data labeled "18". The script works perfectly again, and the data is correct up to the last transformer before the writer. However, the data in the writer isn't replaced by the new dataset, and I still get the "18/19/11" data when I only want "11"!What type should I choose in "Feature operation" (insert/update/upsert/etc.) and in "feature type handling"?Do I need to integrate a transformerbefore the writer that will update the datar, or is this problem solved solely within the writer? I'm a bit lost and frustrated...Thank you
I notice that when writing GIS to CAD, in this case a KMZ to DGN using FME, that the output often tends to have mismatched units and the scaling is often much smaller in the output. I know that a seed file is ideal but I often find that this doesn’t always solve the problem in FME. Is there any way to make sure that the units are not mismatched when going from GIS to CAD?
Hello, I’m updating a number of workspaces from FME 2021 to FME 2026, and some of them have a dynamic writer outputting to a file geodatabase. As part of the update, we had to change the format of the writers away from File Geodb Open API due to it becoming deprecated. We’re trying to use the OpenFile Geodb format, but we’re running into a problem regarding the geometry of the resulting features. Before, our dynamic writers would output features with 2D geometry such as Polygon. However, with the new format, it’s only outputting features with 3D geometry such as Polygon ZM. This doesn’t occur with our static writers, those output 2D geometry just fine, and it doesn’t occur if we use a different format such as File Geodb. It’s only with a dynamic writer with the OpenFile Geodb format that this issue occurs. I’ve tried adding a 2DForcer and MeasureRemover transformer to the workspace just before the writer, but the features are still being written as Polygon ZM. I can’t manually set the
Good day,I am reading several datasets of different files which I transform. After the transformation I want to insert the data into two different arcgis db. I have approx 200 000 records to insert. I would like to insert in batches of 10 000 then pause for 5-10min and then insert the next 10 000 records. I haven’t found yet an approach that is working. What could be working ?
Hi,I have classified LiDAR data containing low, medium, and high vegetation points, and I need to convert the vegetation point clouds into canopy polygons.What is the recommended FME workflow for this?I have tested the HullAccumulator transformer, and the results look reasonably good and follow the vegetation points quite well. However, I’m not sure whether this is the most appropriate or reliable method for producing canopy polygons, especially for canopy coverage calculations.Would a raster-based workflow be more suitable, or is HullAccumulator commonly used for this purpose? Thanks.
Hi i have 3d buildings LOD 2.3 (roofs and stufff) stored as open data multipatch shapefile real 3d geometry.I think this “Feature type 'd_y_n_point' has unrecognized geometry type 'fme_no_map', defaulting to cesium_3d_object“And then in map “deck: initialization of ScenegraphLayer({id: '3d-buildings-tiles1-scenegraph-https://gis.pcr.cz/vector/tileset2/data/data298.b3dm'}): size: 1 Error: size: 1 at kA.makeVertexFormat (deck-gl.js:7:21331) at kA.getVertexFormatFromAttribute (deck-gl.js:7:21889) at O7 (deck-gl.js:4938:33481) at K2 (deck-gl.js:4938:32798) at uT.setGeometry (deck-gl.js:4938:55130) at new uT (deck-gl.js:4938:52407) at CD (deck-gl.js:7369:840) at boe (deck-gl.js:7369:3191) at deck-gl.js:7369:2753 at Array.map (<anonymous>)onError @ deck-gl.js:4996raiseError @ deck-gl.js:5076_handleError @ deck-gl.js:4996_initializeLayer @ deck-gl.js:4996_updateSublayersRecursively @ deck-gl.js:4996_updateSublayersRecursively @ deck-gl.js:4996_updateLayers
I’m able to update metadata elements in multiple feature classes within esri file geodatabases using the very helpful article at Working with Geodatabase Metadata: Writing/Updating Metadata – FME Support Center. This gets me most of the way to where I need to be.After reading through the article and numerous posts on the Community, I’m stuck on how to use this or another workflow to update the metadata for the file geodatabase itself. There is metadata associated with each feature class, but there is also geodatabase-level metadata.The FeatureReader using the Metadata Feature Read Mode was new to me - very useful, along with the XMLUpdater and the methods outlined in the article. But it seems to only work for the contents of a geodatabase. Any thoughts on how to work with the metadata on the container, as well?Thanks in advance.