Using transformers to modify data.
Recently active
I have a workspace that is calculating the shortest path across a network for a dataset of start and end points (joined as lines). The length of time it is taking to process the data through the ShortestPathFinder transformer is a lot and it sits as follows for hours on end: Is there a way to speed this up at all? I know I’m trying to process a large amount of data which could be the primary reason but I am curious if there are ways to perfect this process to enable it to complete much faster.
In the change detector is there any way of transferring an attribute value from the original feature to the updated feature when it's not either a Key Attribute or one of the attributes listed in the matching strategye.g.
Hello,I am attempting to use the FeatureWriter to update a spreadsheet. From the screenshot you can see I have Addresses Input into which is pushed 3 updates and 95,393 from the original spreadsheet. The Output port, Addresses adds the 3 records to the original spreadsheet making for 95,396 records. Is there a way to get FeatureWriter to update the spreadsheet so the output is 95,393 with the 3 records in 95,393 updated not added to the output? The FeatureWriter is writing to the same spreadsheet in the Addresses Reader.
What modules are available in the PythonCaller transformer in FME Server?I am interested in these modules;urlliburllib2requests
I am clipping a raster and then running RasterStatisticsCalculator. The results are completely wrong to what I get in ESRI using zonal statistics and the only stat that is correct is the max value.FME Results: When I export the raster and bring it into ESRI, cell values are different and zonal stats are different Zonal stats results from ESRI: I would appreciate some help in how best to run zonal stats in FME. Thanks,K
I have a SPATIAL table with the following columns: X_coord, Y_coord and a SPATIAL column GEOMETRYThe X and Y coordinates are adjusted. With which attribute can I adjust the GEOMETRY columns?It has data_type SDO_GEOMETRY (Oracle). Contents of a record:MDSYS.SDO_GEOMETRY(2001, 28992, MDSYS.SDO_POINT_TYPE(201234.5678, 47123.4567, NULL), NULL, NULL)
I used Workbench 2022 to clip buildings (composite surfaces) onto an area with the clipper transformer. The buildings at the clipper boundary however are open geometries (refer to screenshot). How can I insert closure surfaces to each boundary building to create closed volumes?I tried to coerce the composite surfaces to a solid and coerce them back to surfaces after the clipping, but the method is not reliable, because most of the solids become faulty. Is there another solution? Best regardsAlex
Title says it all, Basically I have a workflow:Adding a prefix to the new attribute results in the new attribute not to have any values.Running with prefix:Running without prefix: Also if I add a prefix, for example _, and have a new field I wish to extract, i.e. “ID” which should result in a new column “_ID” with values, it instead replaces the original id field with the new values, totally ignoring the requested “_” prefix. Workaround is to rename the original values with a prefix before extracting second set of values from nested json.
I have a workbench where I am reading data from a SDE looking for rows updated in the last 7 days then exporting to an excel file. That is working well. I’m also using mapnikrasteriser to create a map and export a tiff image however the new records have no geometry defined so won't show up on my map. What would be the best option to calculate geometry for those new records?
I’ve successfully exposed a dozen attributes (see green check marks). Then something changes in the source JSON not allowing me to pull “records.number” and others below “records”. What’s different? Thank you!!
Hi all,I have created a custom coordinate system and placed it in the FME documents directory but I can’t access that in CSMapReprojector transformer. Has anyone dealt with this issue? Looking forward to your responses. Thanks
I am working with a table from a GeoPackage in FME, reading it and clipping based on intersections between categories. When writing the output, the unclipped parts are successfully written to Writer 1 without any issues in the output GeoPackage. However, the clipped parts are written without geometry, even though I can see the attributes correctly in the visual preview on the attribute expose just before writting. I'm confident that I’ve set the geometry type correctly in the writer. What could I be missing here?
Hi Community,I have FeatureWriters creating log text files for me depending on various conditions.If the conditions are not fulfilled the files are still generated but empty and emailer still sends those empty files as attachment.How can i stop this from happening, so that only the log files with any values are sent as attachments with email.Thank you
Hi,I use a CSV list with standard ArcGIS server queries + HTTP Caller to get geojsons. a CSV list contains also layer names etc. I use the File option when saving a response because I need a separate geojson file for every query. Everything goes great, however response files look like "http_download_153028689823_5840.json" which is hard to deal with. Actually I can create a folder with a layer name but I would like to have an option to save a response file itself with a meaningful name and keep granular file structure. Ideally I see it as follows: I run a query within my CSV then get some attributes from the same CSV and supply a response filename from HTTP Caller with these attributes on the fly.There is a way to deal with a new Workspace and rename all the files using filecopy (upd - today I have finally managed with DatabaseJoiner for this purpose), but I am interested in a more integrated solution. Thank you in advance!Evgeny
Bonjour,J’ai une table avec plusieurs colonnes (23) chaque colonne à la valeur 0, 1, 2 ou 3 dedans. J’aimerais savoir une façon de calculer le nombre de fois dans une ligne que l’on peut retrouver la valeur 1, 2 ou 3 et mettre ce résultat dans 3 colonnes distinctes (une pour le 1, le 2 et le 3) voici l’exemple du résultat :Merci pour votre aide!
I know that there is a reader parameter for file geodatabases to only read in spatial data, but is there a way to only read in attribute data? I have an FME workflow that involves working with all of the attribute data and there is no need for me to read in the spatial data/geometry. However, my tool is getting hung up/stuck when reading in features from the file geodatabase - I suspect there's a multi-part feature with geometry issues, so I want to revise the tool to simply read in attribute data & not spatial data. Is this possible? Thanks in advance for any help!
Hello,I’m using HTTPCaller to retrieve a set of data via an API that I know works, as I tested it in Postman. The problem with HTTPCaller is that the response_body is not as full as what I received in Postman (I don’t have the full result), so I cannot continue with my process.I don't know if anyone can help?Thanks!
I have over 30 000 .png files that have been georeferenced. However, some of the files have up to 3 or four bands when only 1 band is necessary. So I want to change this. I want to change the number of band from 4 or 3 to 1 for each file and then replace the old one with the new så I dont loose the accompanied georeferencing files. I also want some type of iterator for this, since i have my files in a directory tree: Directory → Subdir → folder → Files
Hello,I have a API request working in postman, but cant get it to work via FME. If I could see the request headers/body, etc I would be able to debug the issue by comparing the working request vs the fme request.Does anyone have any ideas how I can see this?Thanks
I’m not sure if there is already a Hub or Custom Transformer for this, but posting my own version up called “FeaturePrioritizer” for any comments or use. I may upload this to the Hub if some belief is useful. 😉FeaturePrioritizer is a helper when the user needs to change the order of Features coming out of an Output Port to feed into a downstream Transformer or Writer that has a dependency on the order that features come into it.This is commonly needed when needing to say: Make sure that the first feature entering a Writer/FeatureWriter is a Schema Feature, or say when using an Aggregator that the output Attribute Parameter has been set to take only a single feature in the group (Eg.. The first feature in the group to enter the Transformer) to use as the Attribute output.Not much to it, behind the scenes this just uses a temporary sorting ID and a Sorter, but puts this all into a single Custom Transformer to make it easier.As an example, here is a set of Features their original order
Hey everybody,I'm currently trying to transform LAS file into Cesium 3D Tiles with FME Workbench. Las file is provided by an Agisoft Metashape project with EPSG:3945 coordinates. I would like to transform this points cloud into Cesium 3D Tiles with EPSG:4326 coordinates.I can't use Cesium ion for my project. Unfortunately, I obtain this strange result. First screenshot is the original file and the second one transformed file.Has anyone run into the same problem ? Can someone help me to handle it ?Have a nice day !
I need to export data of an oracle database to XML, it’s data from an electricity network, so not highly structured or nested.I created a workbench using the xml-templater and got some results, so far so good.Are there any limitations using the XMLtemplater compared to the XSD-driven Writer?I don’t want to create the whole export and realize later, that I would have better chosen the XSD-driven Writer for XML.Also a little problem with XML templater:I created an Attribute Value using Attribute Manager, a simple number “0.4”.When I write this value using the XMLtemplater it gets written as “0.40000000000002” to the Textfile.What am I doing wrong?
is it possible to automate my 2D to 3D workflow in ArcGIS Pro in FME? here is the process: 2D polygon layer with a height field → extrusion in ArcGIS Pro → “Layer 3D to Feature Class” Geoprocessing. Here, I group it based on a field so multiple polygons will be merged into a 3D multipatch. → then use this multipatch layer on top of the 3D AGOL terrain layer so they appear good on a 3D scene in AGOL.Does FME have a transformer & writer to automate this workflow? Thanks!
I have two spreadsheets. One is the original data; the other is data that has changed. The schemas are the same. The spreadsheet with the changes has 3 records. I need to add these 3 records into the original data (while deleting the original 3 records in the original data), thus updating the records in the original. What is the best way to do this using ChangeDetector?Currently, when I use ChangeDetector, the records from the changes spreadsheet are output to Inserted; The records from the original spreadsheet are output to Deleted. Deleted includes the 3 unchanged records that are in changes spreadsheet. In the screenshot below the 95,392 in Deleted include the unchanged records that are in Changes. The transformer outputs the Original and Revised separately with no way for me to delete the 3 records in 95,392 and add the 3 changed records?
I built a flow where an Excel spread sheet updates a snowflake data table. The spreadsheet in located in a SharePoint documents library. To get the flow to run on an online FME server I had to put in a SharePointOnlineConnector. When I run the flow, I keep on getting “Could not decode contents of ‘jjjjj.xlsx’ as ‘utf8’. I’m running FME workbench 2022.2 at the present time. Any ideas on how to clear this error would be greatly appreciated.