Skip to main content

Transformers

Using transformers to modify data.

  • 12,963 Posts
  • 51,736 Replies
10000 Posts
poonam21
Contributor
poonam21Contributor
asked in Transformers
Split Data

Hello folks, I want to split data from below data as shown. I want the output format in CSV as this - where the target quantity is Quantity / No. of days in months. The problem I am getting here is I am not able to split the data of month into number of dats because as I need the date as 01-Jan-25 for all the days in the month How can iterate these values. Kindly help!

513
geomancer
Evangelist
p_c_20
Contributor
p_c_20Contributor
asked in Transformers
Spatial Filter (?) - assign full area of intersected polygon to feature that contains the most overlapping area.

I appreciate that’s a wordy question. Hopefully, this pic will clarify. A and B - green polys, low detail at edge - are a dataset I am using to run into a SpatialFilter to determine areas of intersection with the more detailed dataset in pink (amber where there is overlap). You can see that part of the upper example polygon I have coloured part of area 1 in blue, and sits mostly inside A. The smaller, black part of 1 sits inside B. I want to join the entire area of the intersected polygon fully to the feature from the green dataset that contains the largest part of it - in this case, to A. Any ideas how best to proceed? I currently foresee: Check for intersection of area 1 with areas A & B Calculate area of overlay Test for largest Join all of the area of 1 to A Feels like there may be a fair few transformers involved. It’s a national dataset. Just trying to figure out how best to do it. In Esri, I think there might be a simple option to ‘join to largest’…? (Not that I want to jump out

473
p_c_20
Contributor
svakrh
Contributor
svakrhContributor
asked in Transformers
Testfilter in FME 2024.2 not working

Hello together (and thanks for your help) I’m testing my 2022.2 workbenches in 2024.2 Every single workbench generates an error when having a testfilter in it: Cannot have multiple factories with the same name. Multiple factories were assigned the name 'BufferRuler_4_TestFilter' The testfilter itself is not filled anymore. Like that it looks in 2022.2: This is 2024.2: Any suggestion anyone? Thanks in advance, Hannes

412
svakrh
Contributor
katt
Supporter
kattSupporter
asked in Transformers
Buffer Intersection

Hello, I would like to do the following (see attachment): Select these three lines (black, green, red) from a db table (how the table is structured I have to select the three of them and not only two) Create a 2m buffer around each line Identify the two lines (black, green), as they are the lines with a smaller angle to each other, and create a point where their buffers intersect /diverge (red dot) Create a perpendicular line to the green and black line starting from that point Create a point (yellow dots) 4m away from the intersection of the perpendicular line with black/green line on the black/green line The first two steps are easy to do but I have troubles with steps 3-5. What transformers shall I use ?

362
ctredinnick
Supporter
lcecil
Contributor
lcecilContributor
asked in Transformers
Google Drive Upload Not Working

I’m trying to split an ArcGIS sde table of rooms into multiple CSVs based on floors, and then upload the resulting CSVs into a Google Drive directory. I have the first part, but when I run the Google Drive connector it says the translation is successful, but nothing gets uploaded to the GD directory. I have admin access to GD and there is nothing wrong with my connection. Has anyone else had a similar problem?

274
lcecil
Contributor
lovatoe
Contributor
lovatoeContributor
asked in Transformers
FME - CitySuite

Hello am new to FME I in the process of Automating the import of invoices and G/L transactions. Our CitySuite by Harris. Is the anyone who is or who has been involved with the integration of these. My biggest hurdle at the moment is the format of dollar amounts in XML. I have tried using the xquery formula but then the XML Templater fails. Any assistance would be appreciated.

332
donalmateer
Safer
gabrielchang
Observer
gabrielchangObserver
asked in Transformers
Joining data after using PointToPoint overlay

I used PointToPoint overlay to find out which two points are a repeat in two datasets. How can I still grab two columns of information from dataset 1 into dataset 2 if they are overlap? the two datasets do not have FKs, is there a way to join them spatially and then have the tables join instead of union? ---Thanks---

111
liamfez
Influencer
dbaldacchino1
Supporter
dbaldacchino1Supporter
asked in Transformers
Thoughts on the new UI/updated look in FME 2024

I have finally started using FME Workbench (Form) 2024 a bit more consistently now that I built a new instance of FME Server (Flow Hosted) 2024.1.1.1. I like the updated look, but am missing a few things and noticing some inconsistencies in how the transformers render on the canvas: The newer look is more modern and although it’s just “ok” for me (looks like a card and less “fussy” than the previous transformer look), I like it. I miss the cog-wheel to access settings with a single click at the top-right of each transformer. Now you have to highlight the transformer and then you can click to access the settings. Doubling the mouse clicks isn’t a great enhancement. Would love to see this make a come-back, maybe as a minimalist “dot” or something... I can double click to get to the settings, but still not thrilled about it. It is forcing me to use the Parameter Editor window more now, docked to the right of the screen. Still getting used to it in an effort to reduce the clicking but with

1406
nzmalc
Contributor
ohashkii
Contributor
ohashkiiContributor
asked in Transformers
line on area

Hi,How can get the green dot on the blue polygons.I have created the polygon centroid using center of polygon and with neighbor finder I get the green dot on red line. What I need the green dot on blue polygon and the small segment connecting the red line to blue polygons.I tried lion on area but I cat extract the segment marked in black.Any help is appreciated

804
ohashkii
Contributor
wrijs
Contributor
wrijsContributor
asked in Transformers
SpatialFilter, unstabel if filter first is turned on. bug?

Hi, It seems that the SpatialFilter does not always work as expected when the Filters First option is enabled. I have taken several steps to fix the incoming data (such as using the GeometryValidator and applying reprojections), but the SpatialFilter only works consistently when the Multiple Filters option is enabled. Below, I have included an image of my workbench, where—after multiple test attempts—only the top SpatialFilter suddenly works as expected. Is this a bug? I am comparing .dwg files with a feature class in a geodatabase (area) I work with the DataInteroperability extention by ESRI, in a workbench created outside of ArcGIS PRO, FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)

351
nielsgerrits
VIP
arnovananrooij
Contributor
arnovananrooijContributor
asked in Transformers
Use functions in SchemaMapper

Hi, I would like to use a simple function in the SchemaMapper for Attribute value for a new attribute. In an AttributeCreator I would use @Value(Lat)#@Value(Lng). This concatenates two values seperated by a #. I can't get it to work in a SchemaMapper. I tried @EvaluateExpression(@Value(Lat)#@Value(Lng)), but the SchemaMapper interprets this as a string and not a function. How can I make this work? Btw, I use FME 2023.2.5. Thank you, Arno

392
arnovananrooij
Contributor
kidega
Contributor
kidegaContributor
asked in Transformers
Option to choose line pointer between polygon and text using MapnikRasterizer

Hi, Is it possible to choose a line “connector” between a polygon and text object using MapnikRasterizer? Similar to attached image where the black text and lines are desired layouts. It would be good if an auto placement could be used for no overlapping of text, lines and polygons.

241
nielsgerrits
VIP
sami26beniaouf
Contributor
sami26beniaoufContributor
asked in Transformers
How to Apply a Color Palette to Intensity Before or During Rasterization?

Hello, I am generating an orthophoto from a point cloud using the ImageRasterizer transformer, with intensity as the input for pixel values. However, the only available option is grayscale, and I would like to apply a high-contrast color scale (e.g., green to red) instead of grayscale. Is there a way to change the intensity palette before rasterizing the point cloud, so the resulting raster already has the desired colors? Alternatively, can I modify the color palette during or after rasterizing to achieve a similar effect? Attached is an example of the desired output, where intensity is mapped to a high-contrast color scale. Thanks in advance for any suggestions! High contrast with colors Greyscale Orthophoto in greyscale

292
sami26beniaouf
Contributor
lgrie
Contributor
lgrieContributor
asked in Transformers
GML : FME caanot read coordinate system

Hello, I am currently running into issues when reading a gml file.I have two files, build exactly the same way.It reads perfectly well the coordinate system from one file, but not from the other. File 1 File 2 It seams to me that the the connection is not beeing read perfectly.cables is a table “CableElectrique” whereas “my” is the geometry I am sorry, I cannot provide more than snippets :(

211
kailinatsafe
Safer
peteratqfes
Contributor
peteratqfesContributor
asked in Transformers
Best strategy for removing self-intersections created by the LineBuilder?

Hi, I have a point dataset of vehicle locations being turned into lines using the LineBuilder and self-intersections are being created. While I can write successfully to the MSSQL SDE using the SDE writer, I’d prefer to use the SQLSpatial writer (due to speed and licencing). SQLSpatial fails due to what looks like the self-intersections. GeometryValidator can’t seem to fix the issues, with the repair failing. The source points are the last hour of locations so they’re continuous being added and removed per vehicle. I thought this would a common situation for FME users to be in. Processing tracking data. Also, would it make more sense to add the line segments on to the end of the line rather than rebuild the line? I’m not sure how to go about that in FME. Thanks

492
hkingsbury
Celebrity
mathiku
Contributor
mathikuContributor
asked in Transformers
Data to JSON with schema

I have a JSON-schema. A part of it looks like this: "dct_license_sm": { "type": "array", "items": { "type": "string" } } I feed data into a featurewriter pointed at the schema-file. The corresponding data from the input looks like this: dct_license_sm (string: UTF-8): https://creativecommons.org/licenses/by/4.0/ So - a string, but in the schema it is declared that this is to be an array with string-items. Then I would expect the output to be like: "dct_license_sm": [ "https://creativecommons.org/licenses/by/4.0/" ], Obviously declared as an array containing a single string. But my results in FME via the FeatureWriter comes out like this: "dct_license_sm" : "https://creativecommons.org/licenses/by/4.0/", In the FeatureWriter I can't change the datatype. What would be a good way around this?

1479
crystalatsafe
Safer
g.bizournet
Contributor
g.bizournetContributor
asked in Transformers
SQL exector get rows by update /insert a table

Hi , I am ussing a sqlexecutor for update or insert data in tables. But how do i get the rows updates, inserted ?? so i use this in a Emailer ??

453
saraatsafe
Safer
tb09114
Supporter
tb09114Supporter
asked in Transformers
How to check for intersecting polygons

I have a multitude of ring buffers and polygons for which I need to figure out what polygon intersects with what buffer. The task should be easy, but I am stuck here. All data come from the same feature dataset in a file geodatabase (so the spatial reference system is by default the same), however, to be absolutely sure I projected all data before they get into the SpatialFilter to the same EPSG. The settings for the SpatialFilter can be seen here and to show that there are certainly intersecting areas and buffers that contain candidates I add the graphics view of the ‘Passed’ port and from the ‘Reprojected’ port of the Tester and the Reprojector. The candidates are in red… I did try an AreaOnAreaOverlayer, and that one finds overlaps but the request of merging the attribute data is unsuccessful. Meaning all the attributes are in the attribute table, but values from the buffers are not merged to the intersecting polygons, or the other way around. The list I create to check for what buf

432
tb09114
Supporter
miguelaugusto17
Contributor
miguelaugusto17Contributor
asked in Transformers
Distance or intersection between 3D objects

I was trying to compute the distance between a TINSurface and some horizontal polygons (which have a z value, but they are horizontal). I have been trying multiple things to try and get the distance between this two objects. I am kind of surprised that there is not a given transformer to compute the distance or the intersection between 2 given 3d polygons. Maybe a TINSurface is a little complex, but the triangles that compose them should not be complicated. I am a programmer and I think I can program a solution to this problem in a PythonCaller transformer, but I am really surprised there is not a simple answer for this. So if someone knows the answer to this I would appreciate it. If not I think I’ll be forced to program it myself.

262
koulsoum
Contributor
aawad.93
Contributor
aawad.93
asked in Transformers
Issue withTruncating AGOL Feature Service via FME Flow – "413 Request Entity Too Large" Error

Hi everyone, I am working with a large dataset (over 500,000 records) stored in PostGIS, which I am reading into FME and writing to ArcGIS Online (AGOL). My goal is to automate this process by publishing the FME Workbench to FME Flow, so the AGOL feature service updates every few hours. When I overwrite the data, the Workbench runs without any issues. However, I want to truncate the existing data instead of overwriting it. When I attempt to do this, I encounter the following error: 413 Client Error: Request Entity Too Large Occasionally, I receive other request size-related errors as well. I tried adjusting the Features Per Request parameter to 500, but the issue persists. I’d like to ask if anyone has experienced this issue before and what possible solutions or workarounds exist to efficiently truncate and update the AGOL feature service without running into request size limitations. Any insights or recommendations would be greatly appreciated! Thanks in advance.

231
saraatsafe
Safer
g.bizournet
Contributor
g.bizournetContributor
asked in Transformers
curl to HTTP caller

how can i turn this in FME???? login and get cookie: curl -k -i -X POST -d j_username=xxx -d j_password=xx -c cookies.txt https://<host>/Webcontrols/xmlsql login with cookie: curl -k -i -X POST -d j_username=xxx -d j_password=xx -b cookies.txt https://<host>/Webcontrols/j_security_check echo "Get data from iprotect" query results to get data:curl -k -X POST -d @$base_dir/sql/acceskey.xml -b cookies.txt https://<host>/Webcontrols/xmlsql --output acceskey_iprotect.xml in the acceskey.xml is an xml format query select * from <table> output gives the data in xml format

703
oliver
Contributor
p_c_20
Contributor
p_c_20Contributor
asked in Transformers
Fanning out from into excel tabs from different schemas

Hi. I’ve built a data cleaning workspace that performs a number of different tests, creating or retaining different attributes for each. I’ve created an ‘error type’ attribute to fan out by, have added schema scanners and have followed the gist of this. However, I cannot seem to get the writer to respect the varying schemas for each tab. Set up like this: Pointers appreciated. Many thanks

575
p_c_20
Contributor
jangle99
Participant
jangle99Participant
asked in Transformers
band re-naming

Hello, I have seen similar threads but i cannot seem to get what i need to work. New to FME and I have a .img file with 1440 bands. Trying to rename the bands to dates as each band is a dataset a month apart. I have an excel spreadsheet with the original band names and the new names i want but after a lot of trying have not been successful. Please could I have some help with this. thank you

423
jangle99
Participant
salgardi
Contributor
salgardiContributor
asked in Transformers
Reprojection issue from LL-GDA94 to GDA2020 zone 56

Hi all, I hope to get a few hints in the following issue. Issue - Unable to reproject the dataset into GDA2020 zone 56 Dataset URL - The dataset is displayed in the form of WFS Dataset Coordinate system - LL-GDA94 Dataset EPSG - 4293 I have used different transformers to place the dataset in the right location with no success. I think the issue lies in using the right transformers so any hints would be greatly appreciated. Thank you very much in advance, Sebastian.

492
salgardi
Contributor
rlacey
Contributor
rlaceyContributor
asked in Transformers
VertexCreator odd behaviour

I have a workbench that creates output for bentley Microstation. While trying to debug an issue of cells not appearing in the output, I found the VertexCreator deleting an attribute igds_type (microstation format attribute) in the processed features. Pictured is a basic configuration for reproducing the conditions. The version used is 2022.2. I have a simple workaround, but it did take a while to figure out what was going on. I wouldn’t have expected this transformer to touch the attributes at all. Is there a reason for this and does it affect any other attributes?

191
DanAtSafe
Safer

Helpful Members This Week

Badge Winners

Show all badges

Popular Tags

Community Stats

31,141
Posts
118,067
Replies
38,761
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.