Using readers and writers to extract and load data.
Recently active
Hi, I'm having an issue with a Microsoft Access Reader. I have a script that reads a query from Access. This query is a subquery of two other queries. Until now, the script has always worked, but now the query reader doesn't show anything.
Hi, taking my first steps in the FME REST API and webhooks, and struggling on passing coordinates. I published a simple workspace to FME server using the Geometry Pïcker as only parameter, the drawn polygon is noted in GeoJson, like:{"type":"Polygon","coordinates":[[[3.732869,51.016178],[3.733537,51.016688],[3.734896,51.015998],[3.734086,51.015473],[3.732869,51.016178]]]} I created a webhook from this workspace, the URL preview shows the special characters should be encoded, like:https://FMEserver/workspace.fmw?DrawnPolygon=%7B%22type%22%3A%22Polygon%22%2C%22coordinates%22%3A%5B%5B%5B3.732869%2C51.016178%5D%2C%5B3.733537%2C51.016688%5D%2C%5B3.734896%2C51.015998%5D%2C%5B3.734086%2C51.015473%5D%2C%5B3.732869%2C51.016178%5D%5D%5D%7D&opt_showresult=false&opt_servicemode=sync but, when I GET-request through this URL, the workspace fails:55 2021-12-7 17:05:35 | A JSON syntax error was found at line 1, column 256 2021-12-7 17:05:35 | Unexpected character: 't'. One of the following ch
Hello FME Community,I need to divide a line FC into 100 m segments. I can reach that with the IterativeSnippet transformer, but I have an issue with the leftovers; I don't want to divide the leftovers. In another way, I need to keep the leftover to be joined or merged with the last segment to avoid generating segments with 0. X values or other small values like 1 or 2 meters.Is there any possible way to reach this in FME?
Hi, I’m struggling to tag a set of features with an ID, input data looks like the left case in this image:What I want is shown on the right. My input has a line of data with the ID, and it’s implied each record after that has that ID, until a record resets the ID for the subsequent features. Here’s a very similar example but differs from mine in that my ID is on a separate line: It seems like a Python caller might work, but I’m not very handy with Python & FME. Any suggestions welcome. Thanks in advance!
I am trying to do a very basic read/write of an annotation feature class from one file geodatabase to another. In my case, I’m first running a PythonCaller transformer to remove any and all annotation feature classes in the target file geodatabase, then I use a FeatureReader to read the annotation feature class from the source file GDB, and then run a FeatureWriter to write the annotation FC to the target geodatabase with “Insert” and “Create if Needed” options selected for the table, which I assume is creating a new annotation feature class in the target FGDB.Regardless of minor tweaks I make to both the FeatureReader and FeatureWriter transformers, FME Flow keeps writing these as individual features instead of bulk features. There are ~450k annotation features in the feature class, so running this by writing individual features takes over an hour, which will not work for our scenario.Interestingly, the first time I ran this in an earlier workspace, FME Flow used the bulk feature sett
Hi all,Trying to set up workspaces in Form that read files directly from my ACC project using a web connection. However, my project isn’t appearing under my Hub? Appreciate this is vague but any suggestions would be great! Update - there seems to be two environments - one linked to autodesk EU and one linked to autodesk UK - not sure if this is impactful! 2nd update - one (UK) environment i can install the FME app on Autodesk but on the EU one i dont have this option - will the project not appear if the Autodesk FME app is not installed? Thanks
Hello...I've created a HTML report using HTMLReportGenerator/HTML Writer and am trying to write this report to a pdf but have not been successful. I've tried connecting both a pdf FeatureWriter and a PDF Writer to the HTMLReportGenerator output and do get a pdf file created but it's blank. Thanks.
I've run into this issue multiple times now, and it's quite serious. My SQL table writer was set to automatic and selected TINYINT as the datatype. However, one of the values I attempted to write was 5000, which exceeds the valid range for TINYINT. As a result, I expected 57 rows to be written, but only 51 actually made it into the database. Because the system only throws a warning (and buries it in a long list of logs), this kind of data loss can easily go unnoticed unless you're scanning through potentially hundreds of warnings. The warning I wish to flag or somehow cause the workbench to fail if it occurs:2025-07-17 14:15:40| 0.5| 0.0|WARN |Microsoft SQL Server Non-Spatial Writer: Failed to parse Unsigned TinyInt' from attribute value 5000' for column `How many kilolitres (kL) of liquid waste was generated?' Silent data loss is extremely dangerous in data pipelines. How can I flag this better. I am quite surprised FME doesn’t do this by default. I am sure this has impacted many peop
I’m working on a flood-affected buildings project in St. Pauli, Hamburg, using FME’s SpatialFilter transformer. I uploaded an image of my setup (see attached). Almost all buildings are being rejected, and I’m not sure why. My buildings are the "generic object," and the flooding areas are the clipped ones.
I want to re-project an image file into CRS EPSG 20047 BCSG2020But that CRS is missing from my drop-down list.I am running FME Desktop FME(R) 2022.1.3.0 (20220928 - Build 22630 - WIN64) Is CRS EPSG 20047 BCSG2020 available in a more current version?
I know I that you cannot delete feature under DWG, but what if you want seleteed a few because one of them is bad. I am GIS Specialist and I have the DWG files here… The DWG I have is a campgound that somebody worked on it and gave it to use and as I prepare to make a map for that campground and discovered that one of the entity I think “X” is out of place.What I was trying to open the 2024.1 Data Inspector and bring that Dataset into the View to see it andI use the X to turn it off and use the Save As as a new Dataset without the “X” layer . When I save it and it still comes with it every time. I tried to use different method.here is the screen shot I have here. The one I want to remove this X layer under the DWG Layer is “X” . The Red line I drew is that one that I want to delete it. I don’t have the latest version to 2025 yet… Can anyone tell me if there is another way around to fix this ?
Hello, I'm currently working with FME 2022.1 on NETCDF files from https://daac.ornl.gov/cgi-bin/dsviewer.pl?ds_id=1851 The files are .nc4 and when I try to open them on FME Workbench I have this warning. (on picture) It seems that FME can't link the dimensions defined in the file with its own "lat/lon and time functions" I tried opening these files on ArcMap 10.8.1 and the dimensions are immediately recognized correctly. How can I make FME understand that lat = lat, lon = lon and time = time ? Or how can I set it when reading the nc4 file ?
Hi everyone,I'm working with a topologically accurate line network in FME 2023.1.1.1. I have:Two source points located at the start points of some lines (also refer to pipe-network_plus_point-features.png)→ the blue rhombusValves represented as point features, located somewhere along the lines (not necessarily at endpoints)→ the magenta colored pointsMy goal is to identify all topologically connected lines starting from each of the sources and continuing until the valves are reached. Each group of connected features should be treated as a separate subnetwork. In this case, I expect to identify two distinct subnetworks, one for each source. Also refer to desired_result.png and the detail 1 and 2.Has anyone tackled something similar? I’m looking for a solution that ideally avoids using Python and relies on standard FME transformers (e.g., using loops or topology-based logic).Any suggestions or best practices would be greatly appreciated!Thanks in advance
We've set up a process for a client that takes data and writes it to CSV. That CSV is then loaded into a data warehouse.That CSV conforms to the official CSV standards and thus the last line ends with a CR/LF:Shown here in Notepad++. This means there's a last, empty, line in the file. The data warehouse system apparently cannot handle this. Is there a way to remove this last CR/LF from the file? (post-processing python, probably).I must admit I am not convinced this should be fixed on the FME side, but trying to get the data warehouse developers to move on this is not going to happen.
The scenario is The ask how can i eliminate to read from row 1. The attributes that I intend to process is No, Name and ID
I would like to publish the app so that the end user can optionally select a variety of filters including:date ranges static attribute fields (A or T) dynamic input fields (for example if a new business code is added to the source data)I have been able to publish the user parameters in the app but the data does not filter from the results set.
Hi All, I’m having an issue writing out to GDB with a schema dataset. The workflow extracts multiple GeoJSONs from some GSI open Datasets (example path below), clips them to an AOI and extracts them to a GDB. There are around 50 datasets in total .The actual reading of the data seems fine:data features = Geojson format read through a feature reader schema reader = Schema Feature (Any Dataset) format reading the Geojson (n.b. when reading using the schema port of the feature reader, I can’t get it to read schema from multiple datasets, hence why have this separate)I am writing through a FeatureWriter - see settings in screenshot below.The annoying thing is that sometime it works, then I select a new set of features and then it doesn’t, and I can’t seem to find a pattern. However checking the input table before the Writer, everything (I think) looks ok. It feels like there must be something that is not right, but just can’t seem to pinpoint it. Any ideas would be greatly appreciated 🙂?
Hi All,I am trying to reproject a .tif file with the xy coordinate system NAD_1983_UTM_Zone_16Nto WGS84 and vertical coordinate sytem EGM08.I downloaded the aditional .grd files from FME and saved them under C:\Program Files\FME_2022_1\Reproject\EsriPEGridData\vertical\egm\egm2008-1.grdI created a .gcs file which is located under C:\Program Files\FME_2022_1\Reproject\GeoidHeightGrids\World\egm2008_1.gdc and looks like this: ..\..\EsriPEGridData\vertical\egm\egm2008_1.grdI always get the following error message: CsmapReprojector (TeeFactory): CsmapReprojector: Reproject: Could not reproject the geometry of the preceding feature: CS-MAP Reprojector: Unable to load geoid height grid 'C:\Program Files\FME_2022_1\Reproject\GeoidHeightGrids\World\egm2008_1.gdc'What am I doing wrong?Any help very much appreciated.
Hi,I would like to save a copy of Map Image Layer from Esri Portal into gdb. Esri ArcGIS Portal Feature Service does not recognise raster layers and ArcGISOnlineConnector does not recognise geomety. What is the way around?
Hi all,I'm working on a workflow using FME where I want to use the SQLExecutor transformer to query data from a File Geodatabase I've set the input to point directly to the FGDB file, and tried several SQL queries — even very simple ones like:
We have several Database Connections for our workflows, and most of them are for our county ArcSDE geodatabases. Each one has a Default version and a Sync version for editing, and we have all of the connection strings saved with the Sync version.We use FME through a Data Interoperability license, and after FME updated to 2025.0.0.0 (with the ArcGIS Pro update to 3.5 from 3.3) the Version Type is now set to ‘NONE’ for all of them instead of ‘Version from SDE Connection’ like it was before, and the Transactional Version is set to Default automatically. Plus, it seems to us that our connections strings have changed too. We found this the hard way, after changes were written straight to Default.So I guess I’m writing to see if anyone else had this problem, or to see if we’re missing something - I haven’t found any posts or fixes in the changelog about it yet. And, are there tips for how we should be storing these database connections? (I am aware it could just be a Data Interop issue - we’
Hello to all,3 months ago, kailin told me that the 2024 version did not allow writing zones. I would like to know if it is the case now. If not, what is the planned schedule because for the moment we are blocked for the enrichment of our modelsBest regardsBruno
i have an excel sheet and want to make some sums and write them in another new attributei want to sum row O from start to line above an attribute in row M wich is VU or VD...so e.gsum 1 = light bluesum 2 = light blue + dark blue and so on till the next line which is one above a line with VD or VU…...i hope i have explained it not to difficult…...i think the hard part for me is that i need always a sum from the beginning again Thank you and greetzfranco
I have a point location and I would to find the 20 mile extent from that point across a road network. Effectively, I want to create a 20 mile buffer around my point but it must use the road network to determine the distance in all directions. I have tried creating distance isolines using the NetworkCostCalculator and ContourGenerator but this didn’t seem to work very well with a large distance specified (contour interval of 20 miles equivalent). Does anyone know how I might be able to do this?
Hereby a short description of my workflow with the questions at the end. I have created a TIN from points. (TINGenerator)Then clipped it with polygons (water area). (Clipper)The water polygons have been lowered to -1 meter with the 3DForcer.With a Junction I collect both the water (3D Polygon) and the TIN (surfaces). Here are my questions:how do I properly merge those geometrytypes together? how do I fill up the (vertical) gaps between the lower water and the surface.I tried many transformers and different steps, but as you can guess, with no results. Using: FME2024.1