Transformers

I have three separate CSVs (readers below in yellow) to which I have added several transformers. I first added a “AttributeFilter” to filter through two values. I then connected to an “AttributeValueMapper” to map the previous two values to given names. Then I added a “StatisticsCalculator” to sum the values within these two values. Then an “ExpressionEvaluator” to convert the values from feet into miles and after an “AtributeRenamer” to rename the field names. Lastly, I added an “AttributeCreator” to add a third field of data. This is seen in the picture below of my workflow. At the end of the workflow, I added an “AttributePivoter” in an attempt to merge all of these together before attaching a Writer and exporting the results as an Excel Sheet. I am not sure the AttributePivoter might be the best way to merge all of this. What would be a better approach before adding the Writer?Thanks!

I have a raster wherein the values are in epoch time (number of days since 1970-01-01)Is there a way in FME to convert these values into different date formats, such as yyyyddd?DateTimeConverter seems to only work with attributes, but translating all pixels to polygons with attributes for the pixel value is not optimal. I would guess this could be possible with RasterExpressionEvaluator, but if someone can give an example that would be really helpful. Thanks!

Hi folks, I had some urgent need at my workplace, as the GIS database administrator working in a electricity distribution company, I was required to draft out various district data to be used by another department which will require me to decode and clean the data to enable them understand the data format based on their needs. I tried using manual method of copy and past after extracting this data from the database but it was time consuming.I tried FME and I was able to create a workflow using two transformers FeatureJoiner and Matcher and I am happy how this workflow was able to query the two excel files added to the left and right part of the FeatureJoiner transformer thereby giving me the output based on joined attributes file, one is coming as a number and varchar.  Feel free to connect with me on linkedin https://www.linkedin.com/in/anthony-ezema/ 

Hello, I want to cut raster data with a shape data. There are 10 objects in the shape data and 10 raster data. Sometimes the objects in the shape data overlap. There is a column in the shape data that contains the names of the raster data. I want to cut each raster data with only the object with this name. I couldn't find the result despite trying very hard. I am using the clipper transformer. If you have any advice on this subject, I would be very happy.

Hello, I’m trying to create a custom chart (waterfall, combination, etc.) and I couldn’t find a transformer that could accomplish this other than PythonCaller. I’m having trouble integrating my code within FME (2022 version) which requires me to use a few packages to execute. Has anyone been able to accomplish this? I’ve already reviewed the existing FME material out there.

Hi AllA few learned gotchas in regards to GDA2020 transformations.- Dont use the Navigator to convert datums GDA94 > GDA2020 as it defaults to 7 param (unless thats what you want)- Reprojector Transformer is seemingly default to 7Param when it should default to gridshift (have a call logged with Safe)- CSMapReprojector - if you are using Desktop this is the best to use as you can force the transformation from the dropdownHowever if you are going to server and you want the user to select the output coordinate system which may or may not include a transformation you need to automate which method you use by setting it with either a parameter or a conditional value based on the selected coordinate system code  Lots of fun to be had but some caution as well. No transformation is the same.

A column name that I am trying to SELECT in the SQLExecutor is titled: STATEThe line in the SQLExecutor that contains it is as follows:I receive an error message that leads me to believe that it is not grabbing this column, and instead trying to grab the alias that I am trying to establish:Is there a reliable work around for this reserved word? I have tried using the following, to no avail:[STATE][“STATE”][state]“[STATE]”

I am looking to extract data from AGOL to store in a separate table and filter the data by its date field. Essentially I will schedule this every evening to collate all the data with todays date, or run this early morning and filter on ‘Yesterdays’ date. How do I configure the tester transformer to reflect what I need.  Any help is greatly appreciated,

Hello, I have a problem that I am struggling to get my head around recreating within FME. The images below are just for example.I have data from two separate sources for which I want to calculate the area of overlap, for each instance parcel data and problem area data.I want to calculate the area of overlap for every individual parcel and every individual problem area. So rather than calculating the overlap for every individual parcel against the entire other layer as would be the case in the image below:  I want to calculate the overlap for EACH SINGLE feature, and essentially create a list, so I can then also see the attributes for the problem area, and the area of overlap that particular parcels has with that particular problem area, to then go on and filter out those that fall under a certain threshold of overlap.  I have gotten up to the stage of generating a list, which has the parcel id’s and problem id’s for each instance of overlap. My issue is where to go from here and then c

Hi everybody!I wrote some weeks ago about a new solution for our education department in order to get the nearest routes between one Adress and all the schools of the city.thans your answers we could make a first version of it!Now that we get more and more users we have seen 2 problems in our solution.We have a point with the adress of the student and the lines of the streets (including the way from the door of the houses to the street). Usually you have some distance between the point and the vertex of the line. To get the point to the vertex of the line we use the AnchoredSnapper (snappint type: end point snapping; snapping distance 15, Add Additional vertex: never). And hier we get 2 problems.If the point is on the line we get the result as “Untouched” instead of “Snapped” If the point is too far away we get the same problem. Is there any posibility to standarize it? I mean we want to cover all the posibilites: point is in a range of 15, is far away than 15 and is on the line. Thank

Hi All,I have a feature class with 351 columns and need to know which columns contains ALL the records as <Null>. I have tried the AttributeValidator transformer but it doesn’t seem to do what I want as all the records go to Failed and there’s definetly columns with all records as <Null>, see below: The ‘Attributes to Validate’ have been included the 351 columns,Any ideas how to approach this issue?Thanks :)

Hi,I am struggling to read the content of a layer published to ESRI portal. I have a  _website_urlhttps://gis-eu.xxx.com/arcgis/rest/services/LayerTest_Pt_01/FeatureServer/0for ESRI portal layer. For example I need to get Item Id HTTP_Caller does not get this info in _response_body

Hi, I have a html content in _response_body. I am struggling to get only specific text from it. I would like to get only the text highlighted in red. <b>Layers: </b><ul><li><a href="/arcgis/rest/services/Imagery_Wayback_Ardstaw/MapServer/0">2014/02/20</a> (0)</li><li><a href="/arcgis/rest/services/Imagery_Wayback_Ardstaw/MapServer/1">2016/12/07</a> (1) How can I do it? I assume I should use XTMLFragmenter but I am struggling to get the result I want

Hi, Is it possible to read all content of Esri Portal not just one group or a user?I tried to use * but it does not work 

I am new to using FME and am currently facing an issue. Here's the situation: I want to use a FeatureWriter to create a new file of type Esri Geodatabase (File Geodatabase), and I want to include the value domains of certain attributes when creating the Geodatabase. Thank you!

We have two different buffer results from the same road network and I’m doing some work on identifying what is differentThese are large multipart polygons and I wanted to chop them up to give common parts (overlay > 1) and individual parts. In the picture I want to separate the red hatched bit and the solid blue bits from  the combined data. Running the area on area overlayer with no grouping but creating a list of parts results in…Where the orange hatching has created a fill in on the closed triangle  and the roundabout. This is not what I was expecting but I cannot find a setting on the transformer to avoid this.Help!!!! ThanksRob

Hi, I cannot convert Epoch time 1717500804837 to 20241210. I have change the format using @Evaluate(@Value(_created)/1000)and run DateTimeConverter but it failed Null, empty, or missing datetime was found. Enable the passthrough parameter to disable this What am I doing wrong?

After spending all morning trying to set up a Data Stream example in FME I think I’ve got it. It’s a basic geofencing setup:I have a GPX file of one of my bike commutes and use a WebSocketConnector in a sending workspace to send one location per second to a websocket.In a second, listening, workspace, that I’m running as a Stream, I’m using a WebSocketConnector to listen to that websocket and compare the locations coming out of that with a polygon. If it falls inside the polygon I then use a HTTPCaller to send me a message via Whatsapp.This is working fine:However, some of the documentation / tutorials I found, such as Websockets and FME Server, seem to imply that this should be possible with Automations too (and mention several other websocket transformers that have been deprecated). Has anybody tried that? Is this even a scenario where that would be useful? At one message per second, if I use the Websocket Received trigger and then the lisening workspace I end up with one new job bei

UPDATE 06/01/25:  It does indeed appear that once created, the index is automatically rebuilt on writing to the GDB with truncate existing.Steps to recreate:Add SQL statement to create attribute index after writeCREATE INDEX <name_INDEX> ON <table_name> (<attribute_name>)Run the writer either to create new GDB or update existing GDB Remove SQL statement Continue to run writer as normal going forwards-----------------------------Hi all,This is driving me crazy trying to figure out. I have a GDB writer that builds an attribute index after write.CREATE INDEX <name_INDEX> ON <table_name> (<attribute_name>)Unbeknownst to me, each time I updated the data, an additional index was being created instead of overwritten which led to a bloated GDB and blown out write times. Note: The GDB table handling is set to truncate before write.I first went to using the below statement, but I was unsuccessful. ALTER INDEX <name_INDEX> ON <table_name> REBUILDThe

So, our organisation has a maintenance management system for our roads, which now for some reason, no longer works with geometry which has duplicate nodes within the same polyline. I’ve been able to narrow this down to two cases where our road polylines layer violates this rule:Some roads have duplicate consecutive nodes due to mapping mistakes, which I’ve fixed with GeometryValidator. Some roads (such as roundabouts and parking area outlines) have the same start and end node. This is where I’m getting stuck.The potential solution that I’m looking for is something that can determine the polylines with the same start and end point with a small tolerance (0.1m would do the trick) as I could only get GeometryValidator to work as expected with this tolerance, then offset the end node by a small figure (perhaps 0.5m) back toward the penultimate node. This way, the polyline still keeps enough of the line to be usable, but will work with the management system. But, I’m happy to note any other

Hello,I’m having problems trying to write into a Azure Storage Table using the Azure Storage Table writer.It works for all text fields read from CSV but not possible both from Parquet file or Oracle connection where I include also floating or integer fields. The error is always the followingMicrosoft Windows Azure Table Writer: Failed 'INSERT' for rows in table 'xxxxxx'. Server response: 'HTTP Error Status Code #400: 0:One of the request inputs is not valid.'Suggestions?Thanks in advance,Roberto

I have a harddrive full of data I need to turn into a good database, essentially.I'm starting with converting any shapefiles into feature classes. I know how to convert one shapefile into a feature class, but I'm struggling with multiples that live in multiple areas/folders.I've got two workspaces setup so far.One is a read/write on ALL information in the hardrive. It writes a CSV so I can see what data exists. You can see the PATH in the photo below to see the data this reads.The second is where my reader is set to read all .shp using the following to work through all "\\**\\*.shp" however this obviously does not read the underlying datasets that work together with a ShP to create it (.dbf .prj etc)The write is a Feature dataset and the second is just a GDB set to fanout. None seem to really do the job. Some export just a table, some just two feature classes.I'm not sure if there is more I need to do within the workspace to process Shapefiles. I can't see

I want to be able to use the feature reader transformer for scene layer packages (to combine multiple files) but the format doesn't seem to be supported at the moment. Are there any plans to include this format in the future?I have come across this request but it doesn't seem to have gained much traction:https://community.safe.com/s/idea/0874Q000000Tku4QAC/detail 

HI i'm sure there is a very simple answer to the question. I have a polygon with many small holes in it that i want to remove.i'm running a DonutHoleExtractor followed by a tester to select holes <2m squared. i want to merge only these small holes to my main dataset (so only the larger "real" holes are left)i've tried running a Dissolver however this takes ages to run. can anyone think of another tool that would just merge these small holes into the larger polygons they touch?

Hi,I’m using XSD Driven XML Writer with XSD’s specified in schemaLocation. When I use absolute paths it works fine. When I try to use relative paths to the schemas I receive a error message.http://www.company.de/example file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsdEnds up in an error:XML Parser error: 'Error at file: '' line: 0 column: 0 message: unable to open primary document entity 'C:\Windows\System32/file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd''An error occurred while attempting to parse the XML Schema document 'file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd'No idea why System32 is there since my FME_MF_DIR should be c:\projects\myproject