Using transformers to modify data.
Recently active
I have a spreadsheet that has 50 rows of data including Lat/Longs. Each row is considered a pipeline segment. I would like to create a segmented line. I found a post that recommended NeighborFinder, ListExploder and VertexCreator to accomplish this. My line comes out with gaps. I have tried all options I can think of for the LineBuilder, but I only get one line or it still outputs points.Output: What am I missing?
Hi there,Below illustrates a conceptual level of diagram (of a customer transformer), which ideally should be able to intake new (or old) addresses, check if the addresses are already in the “Geocoded Addresses” table; if not, go to a Geocoder, get the address geocoded and then write it back to the same “Geocoded Addresses” table. The challenging part is that the newly geocoded addresses that just got entered into the “Geocoded Addresses” table or list should be reflected on the “Geocoded Addresses” reader on the left hand side so that when next address is being checked, the “Geocoded Addresses” table should have gotten refreshed with the new values (the addresses that just got entered). Is there any better way to do this? Thanks in advance.
To put it simply, I have created a model which takes a single candidate polygon and compares with a number of potentially overlapping clipper polygons from a database. This has run on FME Flow for a few months now without issue, however a recent combination of polygons has caused an output I cannot get my head around.I have isolated the issue to a very small model, consisting of one shapefile with three Clipping polygons and another shapefile of a single candidate polygon (see data attached).Model:Candidate Polygon:Clipper polygons (note the smaller polygons overlapping the larger one, totalling three):When fed into a Clipper transformer, I would expect three results. One for each clipper where it overlaps with the candidate. Instead I get the following:Result 1:Result 2:Result 3 (a donut is formed with the middle polygon by the smallest clipper polygon):The first and second of the above outputs are expected, but the third forms a donut with the smallest polygon. I’ve tried many differ
I am creating a table for my PDF report which is sorted on months of the year, I have a sorter just before my DocumentPDFStyler table that feeds it. It sorts the months chronologically, however in the pdf output the order is not respected. I am sorting on the month number ascending, everything in my workspace and the outputs look correct, and then the output is sorted months 1-12 but June appears at the end after December.
Hi, I have a regular grid of 50 x 50 cells (polygon features). These cells cover an overall area which can vary each time the workbench is run resulting in a different number of cells generated. Within each cell I want to place points at specific locations (the same relative locations in each 50 x 50 cell but not themselves arranged in a regular grid). Currently I utilise the bounding box of the overall area to define the point locations for the grid cell in the bottom left corner (point locations based on x_min+number, y_min+number). What is the best way to insert points in the other cells? I can use an offsetter to move the points in each direction but there might be a significant number of other cells and the number of cells isn't known. Thanks
Hi,I have a file geodatabase (.gdb) containing feature classes, along with an Excel file that includes ArcGIS Pro SQL definition queries intended for specific feature classes.Example: gdb with feature classes ArcPro definition querySchema = '1' And Rodzaj NOT LIKE '%B%' I’d like to understand how I can automatically convert these ArcGIS Pro SQL queries into FME SQL syntax. The queries will vary each time and are tailored to individual feature classes. This SQL works in FeatureReader but it requires a lot of manual work
Hi, I get an error “unable to open primary document entity” if I have a XML-file with a space-character “ “ in the filename of the XMLfile I want to validate in XMLValidator. (2024.2) My questions: is there a work around to set up “Manage User Parameters”, so I can’t upload XML-files with a space in the filename? Best regards,Inka
Hi,I want to tile LiDAR data. My project contains about 550 tiles (1 km × 1 km), so processing everything at once in a standard FME workspace is not practical, as my PC would struggle with the memory requirements.At the moment, I use a shapefile that contains a "to_run" attribute. In QGIS, I select a group of tiles and update this attribute. In FME, I use a Tester together with a Feature Reader so that only the selected tiles are processed.While this works, the workspace still consumes a lot of memory, and I have to monitor the process more closely than I would like.I think a solution using WorkspaceRunner could be more efficient, as it would allow FME to process one tile at a time instead of loading a large batch at once.I have:A shapefile containing all tiles that need to be generated. The LiDAR source data.What I am struggling with is that I don’t know how to do it exactly. I feed the workspacerunner the shapefile with tiles but then in the bench that needs to run I also load in the
This enhancement will allow full automation of attachment backup workflows using ESRI ArcGIS feature services or geodatabase attachments being backed up to ArcGIS feature services.Currently, even with the ESRI ArcGIS package, you need to manually configure the feature service feature URL on a FeatureReader so that the features’ featureID can be passed to the ArcGISAttachment connector.Implementation would be sinmilar to the Publish Action item of the ArcGISOnlineConnector which exposes the _webservice_url
When I attempted to upgrade to StringPairReplacer, Show Changes displays:StringPairReplacer Version 2 replaced by StringReplacer Version 6StringReplacer Change Log, version 6Added multi-attribute string replace support.My Replacement Pairs in StringPairReplacer v2 has multiple lines and quotes. This has worked great for years, and now I can’t upgrade. My first impression is that StringPairReplacer was changed so dramatically that it might have been better to leave it alone (and not replace it with StringReplacer). Here’s what my old StringPairReplacer looked like. And here are my Replacement Pairs (using the Open Text Editor). I use multiple lines and quotes, and it works great.Apparently, the upgrader is not expecting multiple lines or quotes. It’s a mess.I tried creating a csv file but, I couldn’t figure out the proper format.Finally, I removed the quotes (replacing spaces with underscores) and put it on a single line. Now, the upgrade works. I wouldn’t call this success. It will be
I got this error when trying to add attachments to AGO: The ArcGIS REST API returned an error: HTTP Error Code: 413 : '' Message Code . Further details: 'The page was not displayed because the request entity is too large.'Esri community has a solution to edit the header, but there’s no option to edit header on transformer?
.
Hi there, I have about 230 workspaces that run daily to import data using the ArcGIS Feature Services Reader. The issue is, with every run I get warnings that don’t seem to be a problem, but make it seem like the workspaces aren’t running right.NOT changing coordinate system of reader identified by keyword `SAFE.ESRI-AGOL.ARCGISFEATURESERVICE_1' from `EPSG:7844' to `LL-GDA2020_FME' -- mapping file setting of `EPSG:7844' overrides coordinate system `LL-GDA2020_FME' read from fileThis warning just seems to be stating the coordinate system will not be overridden by FME’s LL-GDA2020_FME Coordinate System. It is logged for every reader feature type ArcGISFeatureServiceReader: Querying feature server 'https://public-services.OrganisationURL.com/public/rest/services/ServiceName/MapServer/This warning should not be a warning in my opinion, as it's just stating that the reader is querying the feature service. This occurs once for every reader feature type as well. Debugging is disabled, however
Hi,So I would like to try to work out a point source ID for point clouds based on continuous chunks of time. Basically separating out flightlines. For example, a point should has 30 points. The first 10 are collected in the first 10 seconds, then there is a gap of 1 minute before capture, and then another 10 are collected, then another minute gap, then the last points. So in this case I would like to determine a unique component value for each of the 3 time related groups.I think I can do this if I coerce the cloud to points. But that really isn’t efficient for billions of points.I also won’t know beforehand how many different continuous capture periods there are.Can anyone think of a way to do this? It’s pretty easy to do in lastools. But in this case I’d like to do it in FME. I don’t know any python which I presume could do it.I am ideally wanting this to work in version 2022, but I’m open to a newer version if that is the only chance of doing this.Thanks
Hi, I have two local authority boundary datasets that should align along a river but don’t and this is causing the Master Lookup between the two boundary datasets to be wrong. These two should be aligned and coterminous. How do I easily solve it?
Hi All,I’m trying to calculate volumes on meshes in a dgn file. The dgn file represents rail embankment / earthworks (ballast, formation, etc.). Below a screengrab of the design:My current workaround is DGN Reader → SurfaceBuilder → SolidBuilder → VolumeCalculator but am finding that some of the meshes are not closed. Before calculating any volume I need to close the meshes but can’t work it out,Any idea about how close the unclose meshes? Thanks!
I have a workbench with a RasterMosaicker that runs fine in 2021.2.6, but the same workbench throws an error in 2025.1 “Failed to mosaic the rasters”. Same error for version 2024.1.2.1.The error occurs only when setting the parameter “Overlapping Values” to “Composite Using Alpha Band”.Is there anything known causing issues regarding raster transformers in newer versions that might explain this?
When a database is updated using SpatialRelator, FeatureTypeFilter, and DatabaseUpdater Transformers from feature classes inherited from two different readers, the _relationship attribute disappears when the FeatureTypeFilter Update button is used. All DatabaseUpdater transformers are in the "incomplete transformer" status. When examining the DatabaseUpdater transformers, the _relationship values are red. Copying and pasting the same value fixes this. To avoid this issue, you must manually edit the FeatureTypeFilter, which is time-consuming.
About once or twice a year I have to dig out the SystemCaller, mostly just because I have to trigger a PowerShell command or script file. Without fail, I end up frustrated by the byzantine syntax (quotes galore) and limited way to capture output, finally succumbing to unnecessarily re-implementing the whole thing in Python.So my pick for the transformer that really needs some love and attention from the developers is the good-old SystemCaller :-)Do you also have a pet peeve Transformer that you think could be improved upon?
Below is a screenshot of my workspace that creates a new feature class (AttributeManager_6_Output). This feature class will be edited by end users in ArcGIS Pro. I need to bring that feature class back into the workspace and join it back to caputure those edits. My problem is that some of the attributes will be updated upstream as well. I need to capture those edits as well without overwriting the end user edits. How am I able to set the attribute conflict independently (some attributes from Left and some from Right) in the FeatureJoiner?
Hi all,I’m encountering an issue with the InlineQuerier transformer in FME Form 2024.2.1 (pre-production environment) that seems to differ from previous behavior.(FME Form 2024.1.3 in developement environment)🔧 Workspace Setup:The InlineQuerier has two input ports:tubes (can sometimes receive no features)parametre_generique (always receives data)I’m using this request :❗ Problem:When no data arrives at the tube input port, the transformer throws the following errors:InlineQuerier_2 (InlineQueryFactory): Generating output 'tubes_statuts_inactifs' using query 'SELECT * FROM "tubes"WHERE ( UPPER("statut_administratif") NOT IN ( SELECT TRIM(UPPER(value)) FROM "parametre_generique", json_each( '["' || REPLACE("valeur_parametre_text", '|', '","') || '"]' ) WHERE code_parametre = 'STATUT_ADMINISTRATIF_RETENU_TUBES' ) OR UPPER("statut_operationnel") NOT IN ( SELECT TRIM(UPPER(value)) FROM "parametre_generiq
Hi,I have run into behaviour in FME Form that I don't understand. I want to read an OGC API (WFS3.0) point features from any of these collections ( https://api.pdok.nl/lv/bgt/ogc/v1/ ) within a bounding box that I create based on input features.I dynamically create a bounding box (my random example: 6.7337723637079705,53.153741409492596,6.742906946412802,53.15869110582926 ) in a workflow before the FeatureReader.When I add the featurereader without any collection query parameters and save it so it generates the output port. And then I open the parameters and set bbox to the attribute value from the bbox (and also ‘limit’ to 1000). These parameters are not applied and used. Only when I regenerate the output port it applies any HARDCODED values. I cannot feed any dynamic value from a user parameter/attribute.If this is intended behaviour in FME: why? It seems so unnatural to not be able to dynamically feed the query parameters.Hopefully someone can help me out!
I have got an inital line featureclass from which I make a new one with splitted the lines, based on a measure table (MeasureGenerator, FeatureMerger, Snipper). I want to make a fme tool that can update this featureclass based on an updated measure table. I want to conditional handle the attribute values of all changes in the new feature class. Measure:0-2000;2000-4000;4000-8000 (measure in meters)Becomes Measure:0-1000;1000-2000;2000-2500;2500-5000;5000-8000Makes combined:0-1000;1000-2000;2000-2500;2500-4000;4000-5000; 5000-8000In the record of 0-1000 should be the attributes (Start, End, etc) of ‘Measure’ and ‘Becomes Measure’ so I can check from which former feature the new feature will get the attributes. This will be based on the largest overlap in length. I have tried this with the LinOnLineOverlayer. Here the line output does not give the answer and the point output gives all the answers except for when the endpoint is the same (0-2000 and 1000-2000).How should I do this? Am I
Happy May Day!This works in 2024-2025 and breaks at 2026.1.I have several autocad format attributes selected (confusing methods to select see below). I go through many transformers and can see those same format attributes (1 for example autocad_entity_handle) all the way up to and including the attributemanagers (pictured). But looking in the attribute manager (This was an issue before upgrading the attributemanager transformer and is also an issue since I have upgraded the attribute managers). Many of the format attributes are gray. 1.What is the significance of this?Why if the autocad_entity_handle format attribute is enabled does it show as “not found” (red)?
Hello,I am trying to create a workflow reading a file from one path, rename to respect Autodesk Forma naming convention and upload to the Autodesk platform with a new name.However, I can only input the existing full path (so with the not yet adapted name) in the AutodeskDocsConnector.I don’t want to create a local intermediate copy, and wish to run this on Flow later, any idea ?Thank you !