A space to discuss FME Form
Recently active
I would like to hear about everyone’s experience with “Observability” of “FME Flow” in understanding it’s health and operational usage (for example, including FME Flow in a “trace” or understanding/correlating logs in relation to metrics)My context, I’m working on maturing our GIS stack to a completely new level. Modern Observability is a major objective for us.Now, I’m working on a design and architecture where our observability platform will be able to tell us about an operation “end to end” with traces, give a high level view of failed jobs/automations/etc at a high level BUT allow us to view errors in jobs AND the system at a high level in order to know when users may be experiencing issues early on.Mainly, we want observability that will help us see wherever our users start having issues and make “incident” management a little easier for diagnostic stages.NOTE: I’m looking at the Grafana LGTM Stack as an option for us but I’d really like to hear about any experience/solutions with
Hello,A DWG is converted to SHP with a Schema Mapper and Schema Scanner (This is a POC for a more complex workspace.). Output FileWhat is the Q_schemam attribute that is automatically created ? (I removed it from the writer but I am curious about it). How do I remove the original attribute from my Schema Mapper ? I selected ‘Source Attribute: Remove’ in the schema mapper, but the original attribute is still outputted. My output also contains Source Bra and Source Fea, how do I avoid writing this attributes? What are they ? Thank you
The FeatureReader for Esri ArcGIS Server Feature Service seems broken in 2024.0. I try to read the following feature type : "Zones de gestion intégrée eau par bassin versant - ZGIEBV";and I get the following error message : ArcGIS Feature Service Reader: Could not find a layer/table matching feature type 'Zones'Python Exception <FeatureTypeNotFoundException>: FMEException: 928219: ArcGIS Feature Service Reader: Could not find a layer/table matching feature type 'Zones' It seems to me like the feature type cannot contain spaces. This worked fine in FME 2023.
I'm using a FeatureReader to read an ArcGIS Server Map Service. The map service has a lot of layers (AKA: Feature Types) which I can choose from to read.If I choose a feature type name which doesn't have a space then it works but if I choose one with a space then FME Desktop errors saying it can't find the feature type with the truncated feature type name at the first space. Here is an extract from the logs below for "Fish habitat areas" as an example of it incorrectly reading "fish" as the feature type name ArcGIS Feature Service Reader: Could not find a layer/table matching feature type 'Fish'A fatal error has occurred. Check the logfile above for detailsStoring feature(s) to FME feature store file `C:\\tempDir\\wb-cache-DownloadFishHabitats-C19216\\Main_map_service_-_FeatureReader -1 3 fo 633 _lt_REJECTED_gt_ 0 85bd7267ad00c49a5eda9b6f99fe095bbe050483.ffsupdating' Is there a way I can get around this? (I can't remove the spaces in the
Hi All,I am working on data with Line Geometry and would require some help to solve the below scenario,While plotting them on map, I see there is small gap between lines in some scenarios and would like to join them together if the distance between two lines is less.(Reason for this gap - There is an asset in between the lines which has Point geometry.- Not sure if this statement will help, JFYI)Below is an example of different line geometries joining with each other, and there are small gap in some scenariosI would like to join gap between Line 3 and Line 4.gap between Line 5 and Line 6I am not interested in joining parallel line, as they are far from each otherAny help regarding the above would be much appreciated. Thanks
I’m able to write dynamically to a file geodabase using the GEODATABASE_FILE writer with the following setupHowever, trying to do the same in a FeatureWriter fails with a cannot define schema errorSame behaviour seen in both FME 2024.1 and FME 2025.1Is this a known issue?If i try to set schema definition name to fme_feature_type_name in the Feature Writer it’s not possible, only fme feature_type is available for selectionThe only way i can seem to get the FeatureWriter writing dynamically to a File geodatabase is by adding the schema attribute to all features
Hi FME folks,I'm trying to reproject these coordinates: SRID=3857;POINT(530385.593659309 6910697.223221438) into a EPSG:28992 point.I notice the result FME gives me differs a lot from other tools / methods - the difference is about 12 cm.My method:1: Scraping JSON: "geometrie": "SRID=3857;POINT(530385.593659309 6910697.223221438)"2: CoordinateSystemSetter: EPSG:38572: Use regex to extract Lat / Lon.3: Create point using VertexCreator4: Reprojector: Source: EPSG:3857 | Destination: EPSG:28992Results FME:POINT (112820.96207905837 513493.7654737713) Other tools used:Internal geocoding tool: POINT (112820.87254041698 513493.83730794006) ChatGPT conversion: POINT (112820.87254041698 513493.83730794006) Google Gemini conversion: POINT (112820.87254042 513493.83730794) Grok conversion: POINT (112820.87254042 513493.83730794) Python conversion: POINT(112820.873 513493.837) SQL conversion: POINT (112820.87254041698 513493.83730794006) So now I wonder, why is FME saying A and all the other tools
I’m seeing some weird behaviour on FME Flow (2024.2.2)I’m trying to debug a process on FME Flow which isn’t working properly. I wanted to see what was going on so I threw down a logger, republished, reran.To my surprise the feature never made it to the logger...now I know what you’re thinking. “oh you must be doing something wrong”. Well maybe.But the workspace is so simple. Creator>AttributeManager>Logger>File Copy Writer Here’s a snippet of the log:2025-08-22 12:19:45| 0.0| 0.0|INFORM|Creating writer for format: 2025-08-22 12:19:45| 0.0| 0.0|INFORM|Creating reader for format: 2025-08-22 12:19:45| 0.0| 0.0|INFORM|MULTI_READER(MULTI_READER): Will fail with first member reader failure2025-08-22 12:19:45| 0.0| 0.0|INFORM|Using Multi Reader with keyword `MULTI_READER' to read multiple datasets2025-08-22 12:19:45| 0.0| 0.0|INFORM|Using MultiWriter with keyword `PRIMARY_DEST' to output data (ID_ATTRIBUTE is `multi_writer_id')2025-08-22 12:19:45| 0.0| 0.0|INFORM|Wr
I have a texture embedded in a binary file. I’m trying to extract the textures and apply them to the geometry I’m loading. I figured the easiest way to do this is to read the textures in with the FMEUniversalReader. I quickly found out that I need to pass the input file as a string (filename). Ideally I’d pass this as just a BytesIO object as the library I’m working with already loads the data as a PIL object.At this point I don’r really see a way around writing out the textures to disk and then reading them again with FME. Any other ideas?
HiI have an attribute value derived from an Excel sheet. The input attribute name is “Vægt”. FME data type is number(20,2). An example value for a feature is “2.95”. I’m trying to retrieve this value using the xml templater using <Cell><Data Type="Number">{fme:get-attribute("Vægt")}</Data></Cell> But the output value in the xml is 2.9500000000000002 Could anyone explain why this is happening and suggest a fix? I have tried attribute rounding and changing the input Data Type but nothing seems to work. Thanks
I am using a python caller to read paths for files from my Input folder. Files in the input folder are ordered in a ClassName and AssetName folders. There is a variable number of AssetName folders under each class name folder. I am transforming data and using a schema mapper to read transformed schema A series of shapefiles is written with a dynamic writer.How can I copy the input ClassName and Asset Name folder structure when writing the output ? I tried using shp dataset fanout but I can’t get the configuration right.
I'm doing a relatively simple task using a RasterCellValueReplacer, im filtering a few rasters by a defined filter parameter.However, if the filter value is typed into the transformer it works fine, if i try and pass the filter value by either user parameter or attribute the result is completely different and incorrect.What's a bit more of a concern, when i use an attribute or a parameter, the process seems to be making its own filter value out of thin air, the raster passes through as if filtered randomly
I am trying to use the ChangeDectector to compare datasets before loading. First set is AGOL data, new set is SDE data. Every features is considered “changed” because of unexposed attributes that I don’t want to compare. When I have it set to “compare all except”, I am excluding attributes like “last_edit_user” and “last_edit_date”. There are only 4 to exclude and they are the same 4 for all the datasets so I am able to duplicate the transformer. But all records are exiting the “Updated” port because of these unexposed attributes: geodb_type, multi_reader_type, geodb_oid, etc. I dont want to compare these and I also don’t want to expose them first becuse the AGO layers don’t have some of them so I would have to create them and then exclude them. Alternatively, I could use “Only compare these attributes”, but because each set of data to compare have different attributes, I would have to fix the ChangeDetector transformer for each set. Is there a way to discard attributes that are NOT ex
Hello, The goal is to convert a large amount of DWG CAD files to SHP files.Each DWG file is located in a specific folder and subfolder corresponding to it’s location and level. Each DWG name has a prefix component indicating the plan’s specific location and a basename indicating it’s feature type. The prefix component is identical in SHPs and DWGs The basemap depends on a combination of layer(s) and geometry type. There is also a conversion matrix identifying which combination of DWG basename, layer and geometry type result in which SHP basename.Schema mapper & scanner are used to convert schemas based on basename only.I can output the corresponding shapefiles as Prefix_Basename.SHP in one global output folder.However when I try to set the dataset fanout, the folders are created but the files aren’t. I created two separate shapefile writer for comparison. The general parameters are exactly the same, on the writer parameters change.For the dynamic output folderFanout Directory= \o
Guys, I need some help with my XML. In some parts of my document, characters like "&gt" and "&lt" appear. Specifically inside the <data_dictionary></data_dictionary> tag, where I perform an update using the xmlUpdater transformer. What could be causing this?
Good day, I have some line segments that I aggregate based on an attribute in common. After the aggregation I would like to extract the coordinates of the first and the last vertex of the aggregated line (in green). I am using the coordinate extractor at coordinate index -1 and 0. The coordinate values I get as the result are not the first and last vertex of the combined line. I think the problem is that the new line is a multi curve. How can I extract these coordinates (in green) ?
Hello everyone,I am using an XML template like the one below to generate fields dynamically in FME Workbench:<field> <name>cod_imovel</name> <description>{fme:get-attribute("cod_imovel")}</description> </field> <field> <name>tema</name> <description>{fme:get-attribute("tema")}</description> </field> <field> <name>dat_atuali</name> <description>{fme:get-attribute("dat_atuali")}</description> </field> My question is: if a new attribute appears in my source data (for example, atrr_1), is FME able to automatically add a corresponding field like this in the template:<field> <name>atrr_1</name> <description>{fme:get-attribute("atrr_1")}</description> </field> Or do I need to manually edit the template each time a new attribute is added?
Hello,I’m using a Python Caller in an FME workspace. In the python script I’m trying to read in a gpkg file using the code below: #import geopandas as gpdimport pandas as pdimport osdef FeatureProcessor(feature): path_gpkg = feature.getAttribute('path_gpkg') print(path_gpkg) print("file exists - ", os.path.exists(path_gpkg)) gdf = gpd.read_file(path_gpkg)However, I get an error saying:Python Exception <DataSourceError>: '/xxx/abc.gpkg' does not exist in the file system, and is not recognized as a supported dataset name.It is strange because the line ‘print("file exists - ", os.path.exists(path_gpkg))’ returns True.Has anyone come across anything similar?Thanks :)
New to FME, have a client using FME and want to read and traverse through a MicroStation DGN file on a number of client machines. What’s the best way to achieve this?Does a license allow me to distribute a DLL for use on their clients?Is there a batch interface I can use?Steve @ Hexagon
Hi all, I’m new to FME and would like to know if there is a way to generate a v5 UUID in FME 2024? From what I have read I can’t see a method for this. Thanks.
We are upgrading from 2019.2.1.0 to 2023.1 I have many AGOL feature services with attachments that we read and then write to a local database for archiving.For example, I have a feature service that has about 50,000 point features. Only 4 of them have attachments (500K jpegs). I have it set to read in batches of 1,000.In 2019, if I read this feature service with Attachments = Yes, it takes about 1 minute to read everything. If I open the same workspace in 2023 and run it without updating the reader, it times out every time. Sometimes it doesn't even log that it reads the first 1000 before timing out in about 7-10 minutes. Other times it has read for over an hour but still times out. If I disable attachment reading, it reads quickly in 2023. If I upgrade the reader to 2023, the reading still times out when attachment reading is enabled. The same is true for FME server. On our old 2019 server this workspace runs in about 2 minutes, but it times out every time on 2023. Help, pleas
Prior to Desktop Version 2022. I could read an AGOL service with attachments relatively fast. Now with 2022, it doesn't seem to work at all. I can view the source from the workbench ok, I can read the features in if I disable read attachments. But it doesn't seem to work with read attachments set to Yes any more. The log gets stuck at 'Updating Access Token for..." Updating the token doesn't help either. Has anyone else had this issue? Thanks
Hi everyone,I’m having some trouble with the XMLQueryExtractor. I need to extract from the xml_fragment field the values inside the <name> and <description> tags.Currently, the output from FeatureJoiner is in the format: Theme | ID | xml_fragment What I need is for the extraction to produce the following table: Theme | ID | xml_fragment | name | description
I feel like I must be missing something obvious but so far have not been able to resolve. I have published a Web Layer from Arc Pro to our organizational AGOL account. This Web Layer feature service contains three sub-layers. I’d like to update only one of the sub layers using FME. This works fine if I publish each layer as its own service, but if published as a single service with multiple sub-layers, I can’t figure out how to target only a single sub-layer. Publishing these as a single multi-layer service has the advantage of keeping them ordered together on AGOL.When I open FeatureWriter to set parameters, I can select the overall feature service, but not an individual sub-layer. I suppose I can run it without specifically identifying which of the sub layers I am targeting but am a little hesitant as I’m not sure how it would know which of the sub-layers I’m attempting to update. Here is screen shot of my FeatureWriter interface below. Road Rock is the feature service contain
i am trying separate stacked point data in to individual points, can suggest in FME or ArcMap