Using readers and writers to extract and load data.
Recently active
Hi there,I have 2 parcel datasets, a master copy and a weekly update copy that I need to process into the master copy. Each parcel only appears once in each dataset and has a unique parcel ID so matching is fairly easy. I’ve used a change detector to flag any parcels with geometry updates, but now I need to identify the type of change that has taken place. This could involve parcels being split, merged or just the boundary being updated. What is the best way to do this? The logic in my head is this so far:Split parcels - Either, mutliple new parcels being inserted within the boundary of one that has been deleted OR Parcel boundaries shrinking and new parcels being added within boundary of originalMerged parcels - New parcel being inserted that takes the place of multiple deleted parcels OR Parcel boundaries growing to cover extent of deleted parcels
I’m able to write dynamically to a file geodabase using the GEODATABASE_FILE writer with the following setupHowever, trying to do the same in a FeatureWriter fails with a cannot define schema errorSame behaviour seen in both FME 2024.1 and FME 2025.1Is this a known issue?If i try to set schema definition name to fme_feature_type_name in the Feature Writer it’s not possible, only fme feature_type is available for selectionThe only way i can seem to get the FeatureWriter writing dynamically to a File geodatabase is by adding the schema attribute to all features
Hi FME folks,I'm trying to reproject these coordinates: SRID=3857;POINT(530385.593659309 6910697.223221438) into a EPSG:28992 point.I notice the result FME gives me differs a lot from other tools / methods - the difference is about 12 cm.My method:1: Scraping JSON: "geometrie": "SRID=3857;POINT(530385.593659309 6910697.223221438)"2: CoordinateSystemSetter: EPSG:38572: Use regex to extract Lat / Lon.3: Create point using VertexCreator4: Reprojector: Source: EPSG:3857 | Destination: EPSG:28992Results FME:POINT (112820.96207905837 513493.7654737713) Other tools used:Internal geocoding tool: POINT (112820.87254041698 513493.83730794006) ChatGPT conversion: POINT (112820.87254041698 513493.83730794006) Google Gemini conversion: POINT (112820.87254042 513493.83730794) Grok conversion: POINT (112820.87254042 513493.83730794) Python conversion: POINT(112820.873 513493.837) SQL conversion: POINT (112820.87254041698 513493.83730794006) So now I wonder, why is FME saying A and all the other tools
Hello,I’m using a Python Caller in an FME workspace. In the python script I’m trying to read in a gpkg file using the code below: #import geopandas as gpdimport pandas as pdimport osdef FeatureProcessor(feature): path_gpkg = feature.getAttribute('path_gpkg') print(path_gpkg) print("file exists - ", os.path.exists(path_gpkg)) gdf = gpd.read_file(path_gpkg)However, I get an error saying:Python Exception <DataSourceError>: '/xxx/abc.gpkg' does not exist in the file system, and is not recognized as a supported dataset name.It is strange because the line ‘print("file exists - ", os.path.exists(path_gpkg))’ returns True.Has anyone come across anything similar?Thanks :)
We are upgrading from 2019.2.1.0 to 2023.1 I have many AGOL feature services with attachments that we read and then write to a local database for archiving.For example, I have a feature service that has about 50,000 point features. Only 4 of them have attachments (500K jpegs). I have it set to read in batches of 1,000.In 2019, if I read this feature service with Attachments = Yes, it takes about 1 minute to read everything. If I open the same workspace in 2023 and run it without updating the reader, it times out every time. Sometimes it doesn't even log that it reads the first 1000 before timing out in about 7-10 minutes. Other times it has read for over an hour but still times out. If I disable attachment reading, it reads quickly in 2023. If I upgrade the reader to 2023, the reading still times out when attachment reading is enabled. The same is true for FME server. On our old 2019 server this workspace runs in about 2 minutes, but it times out every time on 2023. Help, pleas
I feel like I must be missing something obvious but so far have not been able to resolve. I have published a Web Layer from Arc Pro to our organizational AGOL account. This Web Layer feature service contains three sub-layers. I’d like to update only one of the sub layers using FME. This works fine if I publish each layer as its own service, but if published as a single service with multiple sub-layers, I can’t figure out how to target only a single sub-layer. Publishing these as a single multi-layer service has the advantage of keeping them ordered together on AGOL.When I open FeatureWriter to set parameters, I can select the overall feature service, but not an individual sub-layer. I suppose I can run it without specifically identifying which of the sub layers I am targeting but am a little hesitant as I’m not sure how it would know which of the sub-layers I’m attempting to update. Here is screen shot of my FeatureWriter interface below. Road Rock is the feature service contain
Dear FME Community,I’m trying to cut lines with segment delimited by start and end point and all works with my method and with the transformer Snipper, but it doesn’t works with line who have auto intersection like a loop.With a “normal” line I’ve this result :But with a line who have a loop I’ve this result :The result should be this :I know how to isolate lines with loop but I don’t know how can I treat them.Can you help me ?
Hi,So I have a DGN. I am reading it in (not exploding cells so its just one point) and then changing its coordinate systems. I want to then reexport a dgn. The problem is if I want the cells to show up in the output DGN I need a cell library. Is there a way that I can just use the definitions of the cells in the original file (without having to make a cell library every time out of it) when I write it? Like you can with the DWG writer. They are exactly what I want.I know this question has been asked before, but that was 10 years ago and there was a few changes to the writer a few years ago.At the moment I am limited to what is in version 2023.1Thanks
Hi,I have a point cloud with colour values. Eg the first image. I would like to make an RGB raster of this at a specified ground size (0.5m2).However, whenever I try to do this with the image rasteriser I get nodata pixels everywhere. This is because only about half of my data has a higher density than 0.5m2. Eg the second image.So what I would like to do is either replace nodata values with an interpolated value (say the nearest colour, or bilinear) or make it correctly in the first place, at my desired size, so that there are no nodata values at all. As in its one continuous rasterDoes anyone know how to do this? I haven’t successfully been able to work it out.I should note that I want the input to be the point cloud as I don’t want to coerce it into points for efficiency. I can definitely do it that way, its just computationally expensive.I will also say I only have 10 distinct colours (Each representing the height difference between the pointcloud and a DEM). If I could turn spatia
Hi,I need help how to use Fanout and not sure if this is a bug or not. Using Workbench 2024.1.1 Using DWG as a reader and then change the parameter to Geometry and selected lines. Add the AttributeFilter to import the feature cache type Add the data as a writer to write new feature name. Am I doing something wrong or need some tweak work ?
Hello.So we have a FME Flow set up on a Microsoft Azure machine that is causing some problems for our Spanish and German colleagues. More specifically that when their data (mainly KML’s) that contains one of their local language characters is being sent through our Flow tools then the process fails due to “invalid byte ‘local character’ at position 1 of a 6-byte sequence’.Due to the fact that our users are using diverse data formats then most of our Flow apps use generic readers where they select the format of their input data in a published parameter dropdown that is then feed into the “Input format” of the reader. We are not allowing the feature reader to figure it out itself due to limitations of GeoJson’s and GML’s.So far I cant see that you can change the character encoding parameters in the Generic reader like you can in specific readers, such as the shapefile one (correct me if I am wrong). So I have instead tried to change the Regional settings of the server machine to Latin (b
Hi , Is there a way can I put a new longtitude and latitude in these fields in The reason I am asking is because this is in the wrong place . This is in near and off the Nicaragua and I need this number to be in Leadville, Colorado .Is that possible ?
Hi all,The data in my geodatabase file has an attached layer for each data layerI want to perform some transformer in FME and got the error:“An error occurred while attempting to open an insert cursor on the table 'XXX'. The error number from ArcObjects is: '-2147216556'. The error message from ArcObjects is: {Objects in this class cannot be updated outside an edit session [DMA]}GEODATABASE_FILE writer: An error has occurred. Check the logfile above for details”I found the solution is to change the setting in Transactions Type to Edit SessionBut after setting, some layers can perform the conversion but some layers get the error:“An error occurred while attempting to stop an edit operation. The error number from ArcObjects is: '-2147220975'. The error message from ArcObjects is: {File read/write error occurred. [XXXXXX]}GEODATABASE_FILE writer: An error has occurred. Check the logfile above for details”Can anyone please advise me what I need to do now to fix these errors
Hi,I’am using FME Workbench 2022 with ArcGIS desktop 10.8.1 and ArcGIS Pro 3 on the same machine. When I try to load a feature class only compatible with ArcGIS Pro (containing arcade expression), FME continues to use ArcGIS Desktop 10.8.1 librairies despite the transation / Esri ArcGIS Compatibility set to Auto or ArcGIS Pro.
I have a workbench that converts CAD drawings to GIS, writing to both a FGDB and SDE. SDE was recently upgraded to 11.4. This workbench has run just fine for the past 8-9 years, with enterprise and FME updates and upgrades happening over the years. Recently however, it continues to fail if I run it on all DWGs I need. Either to the FGDB or SDE, or isolated to either one. It processes all the drawings, and then I get this error at the end.An error occurred while attempting to stop an edit operation. The error number from ArcObjects is: '-2147215975'. The error message from ArcObjects is: {The number of points is less than required for feature}Trouble is, I can run it on the drawings in chunks. So I ran it on the drawings modified in the last 6 months. Ran and wrote just fine. I ran it on the drawings modified 6 months prior to that, ran and wrote just fine. Going back until I ran it eventually on all the drawings. It fails on all drawings whether I choose the DWGs individually or use a
In my FME Form, I am trying to view my output against the default Stadia background maps. It says the servers may be unavailable. Does anyone else have this problem?
Hi everyone, I’ve got many excel files and I need to extract some values in specific cells from them, then write these values into a new excel file. These excel file come with same schema, but may with different sheet names.For example, I got resume A, B and C, I want to extract NAME from cell B2, AGE frome cell C4, E-MAIL from D3 and PHONE from D6. And sheets name for resume A is ‘Jack’, for resume B is ‘sheet1’ and for resume C is ‘resume’. And now I want to write these information into a new excel, column A is NAME, column B is AGE, column C is E-MAIL and column D is PHONE.I know this must be a very basic function for FME, but how can I make this possible, I tried to search from the community without any result, maybe I input wrong keywords due to I’m a non-English speaker, please help me out, if would be better for me to understanding if you can attach a screenshot or a workbench file.Thank you very much.
I am trying to load data from a previously created ArcGIS geodatabase into another previously created one.Utilizing FME Workbench, I designed the workflow successfully which takes data from the original gdb as a reader, adding some transformers for manipulation and then finally loading the results into the target gdb as a writer.While the loading and translations were successful, but I have noticed that field aliases that were created through ArcGIS pro previously in the destination geodatabase were dropped out.What is the reason behind this ????
Hi! I have encountered the following error when using Feature Writer transformer (dynamic workspace) writing a Microsoft SQL Server Spatial table. 2025-08-06 16:11:20| 148.0| 0.0|ERROR |Microsoft SQL Server Spatial Writer: Query failed, possibly due to a malformed statement. Query Text `CREATE TABLE [Infrastructure].[Fire_Hydrants_Audit] ([FH_ID] bigint, [Work_Required] bit, [Paint_Post] bit, [New_Post] bit, [Paint_Surround] bit, [Clear_Vegetation] bit, [Post_Reflector] bit, [Inspection_Date] datetime2, [Inspected_By] varchar_max, [Works_Completed] bit, [MI_PRINX] integer, [SP_GEOMETRY] geometry)'. Provider error `(2715) Column, parameter, or variable #9: Cannot find data type varchar_max.'Any thoughts how to resolve this? Thanks!
I am working on a lot of the DWG we got from a contractor and I have to deal with it because our forest is using a different projection and the units are different. However, I have no troube with write to a new DWG with the correct projection and units.The only one probem I have here is the Annotation which is different between the FME Data Inspector and ArcGIS Pro I have here. The Annotation scale is way big and all over that I cannot read in ArcGIS Pro.Is there a work around to fix the problem ?I am in Colorado and work for a forest service. I have two screenshot that will be helpful This picture is in FME : and this is in ArcGIS Pro Can anyone out there that have had similiar issues or a problem solved in the past ? Thanks !
What controls the order in which tags are written in the OSM XML writer? I have a set of attributes that are ordered alphabetically in the writer. The attributes are even ‘ordered’ on the features (which shouldn’t matter?). As you can see 'smoothness’ was assigned as the second tag, when I would have expected ‘highway’ to be the second tag.Inspecting the written dataViewing the XML file in Notepad++Attributes are listed alphabetically on the OSM XML writer.
Hello ! I have a DWG that has a different type of feature that I cannot convert to ArcGIS Pro because it does not recongize it or unable to keep it preserve the line..This is an oiginial DWG I have here : After I save them to a new DWG with set to ESPG 26913. I got this It looks like a feature change for line from an oroginal to a new one above the picures here… Is there a way for me to preserve the lines from change it ? Thanks
Hi,I am trying to read from a publicly available WMS service (https://environment.data.gov.uk/spatialdata/nafra2-risk-of-flooding-from-surface-water/wms), layerrofsw_4band.I have connected to the service in FME Form using a reader and bounding box for my area of interest. The reader runs, reporting success, but returns only a single line entry and a white dotted square in the preview.Adding the layer to ArcPro works fine and data can be viewed as expected.I believe the issue is due to scale thresholding applied to the service by the provider. No features are returned unless the map scale is less than 1:50k. My bounding box is much bigger.This forum post is the closest to my problem, Problems reading WMS layers? | Community, but doesn't suggest a solution.In the reader it does not seem possible to set the scale to operate at.Would the workflow required to access the features be something like:Split my area of interest into a grid, where each square is <1:50k. Somehow call the WMS ser
Hello,I'm scraping data using an HTTPCaller.One of the attributes contains GeoJSON data:{"type":"FeatureCollection","features":[{"type":"Feature","properties":{},"geometry":{"coordinates":[[[5.96266096723135, 51.9996241913007],[5.96267141231219, 51.9996290142943],[5.96315710713663, 51.999175649922],[5.96290120337337, 51.9991708268575],[5.96266096723135, 51.9996241913007]]],"type":"Polygon"}}]}I'd like to visualize these polygons in the Data Inspector but I don't know how to convert this data into an actual polygon.What transformers do I need?Thanks
Which Fme Transformer will enable me write an Excel Output Data to accept Large Numbers (e.g. No1 below) No1 4111101101005601100102002 No2 Instead of this Scientific Notation of Enconded Number (e.g. No 2 below) 4.1111011010056E+24