- - Community Resources
Ideas
Product Updates
Events
Groups
Support
Knowledge

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

7,092 Posts
26,105 Replies

When you subscribe we will email you when there is a new topic in this category

7092 Posts

koenContributor

Access parameter from PythonCaller in Custom Transformer

I'm trying to create a custom transformer 'FeatureCountLogger' which logs the number of features inputted into this transformer. The custom transformer contains a PythonCaller with the following code: import fmeobjects class FeatureProcessor(object): def __init__(self): self.featureList = [] def input(self,feature): self.featureList.append(feature) def close(self): logger = open(FME_MacroValues['Summarylog'], "a") message = FME_MacroValues['Message'] + str(len(self.featureList)) + '\\n' logger.write (message) logger.close() I want to use the logger multiple times, so I created a published parameter 'Message' in the custom transformer, so I can submit the text logged to each instance of the transformer. When I'm running this I get the following error: Python Exception <KeyError>: 'Message' It seems like the PythonCaller can't a

619

14 days ago

marta.podsiadSupporter

asked in Data

AttributeFileWriter does now work on FME Flow

Hi,I am looking for a writter that will allow me to save blob data in FME Flow. On FME Form I am using AttributeFileWriter that is working completely fine

7811

16 days ago

vimalvaghaniContributor

asked in Data

How to combine Geometry of objects ?

Hello Am struggling to combine geometry of an object . I should have 19 objects there is only 1 object which just doesn’t want to combine any unknown reason…..don’t know why ? Any suggestion / idea would be much appreciated. The reason i am combing objects is to extract the face of each object and then obtain FACE centre point for further analysis. thank in advance

290

16 days ago

mazenaldaasContributor

asked in Data

Clip and move

Greets,I have two question: First one: how can I clip the green polygons based on the reds one with the same ratio?Second one: is there any way to move the red polygons to match the border of the green polygons. The Red and green polygons not in the same layer

1706

16 days ago

sparksContributor

asked in Data

Esri Geodatabase Writer: Feature Type Definition ... was requested, but not defined

In the stand-alone FME Form my FME script works well. However, using the same script in ArcGIS Pro faced error saying Esri Geodatabase Writer: Feature Type Definition … was requested, but not defined. A possible reason is that you may not have permission to create the Geodatabase. The error number from ArcObjects is: '-2147467259'. The error message from ArcObjects is: {}FeatureWriter or classical Writer, there is no difference. With other FME scripts (created by others) a fgdb can be created. Why not the mine?

1176

16 days ago

ryanwillshearContributor

asked in Data

How to categorise geometry changes between parcel layers

Hi there,I have 2 parcel datasets, a master copy and a weekly update copy that I need to process into the master copy. Each parcel only appears once in each dataset and has a unique parcel ID so matching is fairly easy. I’ve used a change detector to flag any parcels with geometry updates, but now I need to identify the type of change that has taken place. This could involve parcels being split, merged or just the boundary being updated. What is the best way to do this? The logic in my head is this so far:Split parcels - Either, mutliple new parcels being inserted within the boundary of one that has been deleted OR Parcel boundaries shrinking and new parcels being added within boundary of originalMerged parcels - New parcel being inserted that takes the place of multiple deleted parcels OR Parcel boundaries growing to cover extent of deleted parcels

372

16 days ago

ebygommInfluencer

asked in Data

Dynamic writing to FileGDB with a FeatureWriter

I’m able to write dynamically to a file geodabase using the GEODATABASE_FILE writer with the following setupHowever, trying to do the same in a FeatureWriter fails with a cannot define schema errorSame behaviour seen in both FME 2024.1 and FME 2025.1Is this a known issue?If i try to set schema definition name to fme_feature_type_name in the Feature Writer it’s not possible, only fme feature_type is available for selectionThe only way i can seem to get the FeatureWriter writing dynamically to a File geodatabase is by adding the schema attribute to all features

817

17 days ago

ed-progresContributor

asked in Data

Reprojector - 12 cm difference from EPSG:38573857 to EPSG:28992

Hi FME folks,I'm trying to reproject these coordinates: SRID=3857;POINT(530385.593659309 6910697.223221438) into a EPSG:28992 point.I notice the result FME gives me differs a lot from other tools / methods - the difference is about 12 cm.My method:1: Scraping JSON: "geometrie": "SRID=3857;POINT(530385.593659309 6910697.223221438)"2: CoordinateSystemSetter: EPSG:38572: Use regex to extract Lat / Lon.3: Create point using VertexCreator4: Reprojector: Source: EPSG:3857 | Destination: EPSG:28992Results FME:POINT (112820.96207905837 513493.7654737713) Other tools used:Internal geocoding tool: POINT (112820.87254041698 513493.83730794006) ChatGPT conversion: POINT (112820.87254041698 513493.83730794006) Google Gemini conversion: POINT (112820.87254042 513493.83730794) Grok conversion: POINT (112820.87254042 513493.83730794) Python conversion: POINT(112820.873 513493.837) SQL conversion: POINT (112820.87254041698 513493.83730794006) So now I wonder, why is FME saying A and all the other tools

172

17 days ago

hannah-jkContributor

asked in Data

Python Caller - reading in gpkg file

Hello,I’m using a Python Caller in an FME workspace. In the python script I’m trying to read in a gpkg file using the code below: #import geopandas as gpdimport pandas as pdimport osdef FeatureProcessor(feature): path_gpkg = feature.getAttribute('path_gpkg') print(path_gpkg) print("file exists - ", os.path.exists(path_gpkg)) gdf = gpd.read_file(path_gpkg)However, I get an error saying:Python Exception <DataSourceError>: '/xxx/abc.gpkg' does not exist in the file system, and is not recognized as a supported dataset name.It is strange because the line ‘print("file exists - ", os.path.exists(path_gpkg))’ returns True.Has anyone come across anything similar?Thanks :)

545

20 days ago

jakethepainterContributor

asked in Data

Why is reading ArcGIS Online attachment failing in 2023 when it works great in 2019?

We are upgrading from 2019.2.1.0 to 2023.1 I have many AGOL feature services with attachments that we read and then write to a local database for archiving.For example, I have a feature service that has about 50,000 point features. Only 4 of them have attachments (500K jpegs). I have it set to read in batches of 1,000.In 2019, if I read this feature service with Attachments = Yes, it takes about 1 minute to read everything. If I open the same workspace in 2023 and run it without updating the reader, it times out every time. Sometimes it doesn't even log that it reads the first 1000 before timing out in about 7-10 minutes. Other times it has read for over an hour but still times out. If I disable attachment reading, it reads quickly in 2023. If I upgrade the reader to 2023, the reading still times out when attachment reading is enabled. The same is true for FME server. On our old 2019 server this workspace runs in about 2 minutes, but it times out every time on 2023. Help, pleas

1353

21 days ago

rweiserContributor

asked in Data

Overwrite AGOL one layer within a multi-layer web service

I feel like I must be missing something obvious but so far have not been able to resolve. I have published a Web Layer from Arc Pro to our organizational AGOL account. This Web Layer feature service contains three sub-layers. I’d like to update only one of the sub layers using FME. This works fine if I publish each layer as its own service, but if published as a single service with multiple sub-layers, I can’t figure out how to target only a single sub-layer. Publishing these as a single multi-layer service has the advantage of keeping them ordered together on AGOL.When I open FeatureWriter to set parameters, I can select the overall feature service, but not an individual sub-layer. I suppose I can run it without specifically identifying which of the sub layers I am targeting but am a little hesitant as I’m not sure how it would know which of the sub-layers I’m attempting to update. Here is screen shot of my FeatureWriter interface below. Road Rock is the feature service contain

744

22 days ago

geo-xSupporter

asked in Data

Cut line with loop with Snipper

Dear FME Community,I’m trying to cut lines with segment delimited by start and end point and all works with my method and with the transformer Snipper, but it doesn’t works with line who have auto intersection like a loop.With a “normal” line I’ve this result :But with a line who have a loop I’ve this result :The result should be this :I know how to isolate lines with loop but I don’t know how can I treat them.Can you help me ?

432

22 days ago

james_c_452Enthusiast

asked in Data

Write DGN with the same cells as the source DGN

Hi,So I have a DGN. I am reading it in (not exploding cells so its just one point) and then changing its coordinate systems. I want to then reexport a dgn. The problem is if I want the cells to show up in the output DGN I need a cell library. Is there a way that I can just use the definitions of the cells in the original file (without having to make a cell library every time out of it) when I write it? Like you can with the DWG writer. They are exactly what I want.I know this question has been asked before, but that was 10 years ago and there was a few changes to the writer a few years ago.At the moment I am limited to what is in version 2023.1Thanks

356

22 days ago

james_c_452Enthusiast

asked in Data

Coloured point cloud to coloured raster without nodata

Hi,I have a point cloud with colour values. Eg the first image. I would like to make an RGB raster of this at a specified ground size (0.5m2).However, whenever I try to do this with the image rasteriser I get nodata pixels everywhere. This is because only about half of my data has a higher density than 0.5m2. Eg the second image.So what I would like to do is either replace nodata values with an interpolated value (say the nearest colour, or bilinear) or make it correctly in the first place, at my desired size, so that there are no nodata values at all. As in its one continuous rasterDoes anyone know how to do this? I haven’t successfully been able to work it out.I should note that I want the input to be the point cloud as I don’t want to coerce it into points for efficiency. I can definitely do it that way, its just computationally expensive.I will also say I only have 10 distinct colours (Each representing the height difference between the pointcloud and a DEM). If I could turn spatia

505

23 days ago

probert1968Contributor

asked in Data

Fanout Question

Hi,I need help how to use Fanout and not sure if this is a bug or not. Using Workbench 2024.1.1 Using DWG as a reader and then change the parameter to Geometry and selected lines. Add the AttributeFilter to import the feature cache type Add the data as a writer to write new feature name. Am I doing something wrong or need some tweak work ?

223

23 days ago

hlynurSupporter

asked in Data

FLOW: Latin 1 (ISO/IEC 8859-1) coding on a UTF-8 server machine

Hello.So we have a FME Flow set up on a Microsoft Azure machine that is causing some problems for our Spanish and German colleagues. More specifically that when their data (mainly KML’s) that contains one of their local language characters is being sent through our Flow tools then the process fails due to “invalid byte ‘local character’ at position 1 of a 6-byte sequence’.Due to the fact that our users are using diverse data formats then most of our Flow apps use generic readers where they select the format of their input data in a published parameter dropdown that is then feed into the “Input format” of the reader. We are not allowing the feature reader to figure it out itself due to limitations of GeoJson’s and GML’s.So far I cant see that you can change the character encoding parameters in the Generic reader like you can in specific readers, such as the shapefile one (correct me if I am wrong). So I have instead tried to change the Regional settings of the server machine to Latin (b

jdhContributor

I have a COG with a scale factor (excerpt from GDALInfo)Band 1 Block=1024x1024 Type=Int32, ColorInterp=Gray Min=-50313.000 Max=57304.000 Minimum=-50313.000, Maximum=57304.000, Mean=4745.177, StdDev=7550.452 NoData Value=-32767 Offset: 0, Scale:0.1How do I apply this scale factor in FME? If I clip the input and create a new tif, the scale factor is dropped and the values are 10 times the expected.In this particular case I can just scale the value back down, but in general, is there a way to retrieve the scale factor and apply it?

658

24 days ago

probert1968Contributor

asked in Data

Replace the Longtitude and Latatude for the wrong place to a new place ?

Hi , Is there a way can I put a new longtitude and latitude in these fields in The reason I am asking is because this is in the wrong place . This is in near and off the Nicaragua and I need this number to be in Leadville, Colorado .Is that possible ?

351

27 days ago

hieutranContributor

asked in Data

Error when converting data have relationship

Hi all,The data in my geodatabase file has an attached layer for each data layerI want to perform some transformer in FME and got the error:“An error occurred while attempting to open an insert cursor on the table 'XXX'. The error number from ArcObjects is: '-2147216556'. The error message from ArcObjects is: {Objects in this class cannot be updated outside an edit session [DMA]}GEODATABASE_FILE writer: An error has occurred. Check the logfile above for details”I found the solution is to change the setting in Transactions Type to Edit SessionBut after setting, some layers can perform the conversion but some layers get the error:“An error occurred while attempting to stop an edit operation. The error number from ArcObjects is: '-2147220975'. The error message from ArcObjects is: {File read/write error occurred. [XXXXXX]}GEODATABASE_FILE writer: An error has occurred. Check the logfile above for details”Can anyone please advise me what I need to do now to fix these errors

1352

27 days ago

myadegaryiutacContributor

asked in Data

ArcGIS Compatibility Issue with ArcGIS Pro 3.5 in FME 2025.0 Workbench

Hello everyoneI am currently using FME Workbench 2025.0 (FME(R) 2025.0.3.0 (20250602 - Build 25241 - WIN64)) in combination with ArcGIS Pro 3.5. When attempting to add a File Geodatabase to my workspace, I encounter the following error:"Unable to perform any licensing-related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator → Workspace Parameters → Translation. This 64-bit version of FME requires ArcGIS Desktop with 64-bit Background Geoprocessing, ArcGIS Pro, or ArcGIS Enterprise. Refer to this article: http://fme.ly/qua for more details."Additionally, the following message appears:"Failed to obtain any schemas from reader 'GEODATABASE_FILE' from 1 dataset. This may be due to invalid datasets or format accessibility issues related to licensing, dependencies, or module loading. See the log file for more information."The workspace generation fails I have attached a screenshot of my current FME Options and Navigator settings for your reference. C

2685

28 days ago

sdubretonContributor

asked in Data

Transaction issue ArcGIS Desktop vs ArcGIS Pro

Hi,I’am using FME Workbench 2022 with ArcGIS desktop 10.8.1 and ArcGIS Pro 3 on the same machine. When I try to load a feature class only compatible with ArcGIS Pro (containing arcade expression), FME continues to use ArcGIS Desktop 10.8.1 librairies despite the transation / Esri ArcGIS Compatibility set to Auto or ArcGIS Pro.

312

28 days ago

slingemanContributor

asked in Data

DWG Conversion to FGDB & SDE

I have a workbench that converts CAD drawings to GIS, writing to both a FGDB and SDE. SDE was recently upgraded to 11.4. This workbench has run just fine for the past 8-9 years, with enterprise and FME updates and upgrades happening over the years. Recently however, it continues to fail if I run it on all DWGs I need. Either to the FGDB or SDE, or isolated to either one. It processes all the drawings, and then I get this error at the end.An error occurred while attempting to stop an edit operation. The error number from ArcObjects is: '-2147215975'. The error message from ArcObjects is: {The number of points is less than required for feature}Trouble is, I can run it on the drawings in chunks. So I ran it on the drawings modified in the last 6 months. Ran and wrote just fine. I ran it on the drawings modified 6 months prior to that, ran and wrote just fine. Going back until I ran it eventually on all the drawings. It fails on all drawings whether I choose the DWGs individually or use a

271

29 days ago

arnold_bijlsmaEnthusiast

asked in Data

Are the Stadia background maps down??

In my FME Form, I am trying to view my output against the default Stadia background maps. It says the servers may be unavailable. Does anyone else have this problem?

252

29 days ago

boboContributor

asked in Data

How can I extract values in specific cells from multiple excel files and write them into a new excel file?

Hi everyone, I’ve got many excel files and I need to extract some values in specific cells from them, then write these values into a new excel file. These excel file come with same schema, but may with different sheet names.For example, I got resume A, B and C, I want to extract NAME from cell B2, AGE frome cell C4, E-MAIL from D3 and PHONE from D6. And sheets name for resume A is ‘Jack’, for resume B is ‘sheet1’ and for resume C is ‘resume’. And now I want to write these information into a new excel, column A is NAME, column B is AGE, column C is E-MAIL and column D is PHONE.I know this must be a very basic function for FME, but how can I make this possible, I tried to search from the community without any result, maybe I input wrong keywords due to I’m a non-English speaker, please help me out, if would be better for me to understanding if you can attach a screenshot or a workbench file.Thank you very much.

371

30 days ago

ahmedisalemContributor

asked in Data

Loading some feature classes into an ArcGIS geodatabase

I am trying to load data from a previously created ArcGIS geodatabase into another previously created one.Utilizing FME Workbench, I designed the workflow successfully which takes data from the original gdb as a reader, adding some transformers for manipulation and then finally loading the results into the target gdb as a writer.While the loading and translations were successful, but I have noticed that field aliases that were created through ArcGIS pro previously in the destination geodatabase were dropped out.What is the reason behind this ????

222

30 days ago

Page 2 / 284

Badge Winners

leonietreblehas earned the badge Welcome Back
skill_72has earned the badge FME Form Basic Training
ibrucehas earned the badge Student (Grey)
satyam17has earned the badge Welcome Back
alyssauatsafehas earned the badge FME Flow Authoring Training

Show all badges

Community Stats

31,813: Posts
120,831: Replies
39,443: Members

Latest FME

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.