Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 12,569 Posts
  • 50,349 Replies
12569 Posts
arunkj
Contributor
arunkjContributor
asked in Transformers
AttributeManager with limited sets of attributes

I need something like the AttributeManager but it needs to work only on a limited set of attributes. What I need is a transformer that sets values (conditionally) to a handful of attributes. I need the ability to copy paste this box to various places in a workspace or to other workspaces. I’ve been using AttributeManager but the problem is it gets overwhelmed with other attributes and the transformer changes based on the input stream. I need something that’s sort of shielded from what’s in the pipe. These limited set of attributes are common to various workspaces or workflows (eg, datemodified, lastuser, datecreated etc) and are always guaranteed to exist. So naturally I need them handled in a simple, separate transformer that can be reused. Is there any way to achieve this? Thanks 

4
arunkj
Contributor
2 hours ago
alpheus
Participant
alpheusParticipant
asked in Transformers
Transformers not installed message - AttributExposer and Clipper

Why do I get the message: The following potential problems were detected in this workspace:Transformers are used that are not installed: 'AttributeExposer (version 2)', 'Clipper (version 16)' The install/machine that created this workbench, and the install/machine I’m trying to run it on are different, is it a version mismatch?  How can I fix it?

5
ivanwriter
Contributor
12 hours ago
robotix
Contributor
robotixContributor
asked in Transformers
Install Package Manually

I have seen some partial answers to this while searching but nothing definitive.Can someone explain the best way to install a transformer [package] manually on Windows? More specifically, the emailer package from FME Hub. We don’t have internet connection to FME Hub so would need to download the package and install it. Does it have to be installed for each profile or can the users share a location for the package?Thanks!

3
ivanwriter
Contributor
13 hours ago
styx_a38
Contributor
styx_a38Contributor
posted in Transformers
Revit BIM models to Esri Geodatabase

Hello,so far we are transforming IFC models to geodatabase feature class, which works fine so far. Unfortunately this IFC export step seems one step to many in the overall workflow and I was asked to change the workflow, so that revit project files can be used directly. As fme does have a revit reader I thought it would be possible, but unfortunately despite trying every imaginable parameter setting for the reader it was not possible to read more than one feature that did not contain some kind of meta data...but the “survey point” instead. The fme documentation also only focuses on how to export from revit to ifc and after wards use it in FME.Is it therefore impossible to transform from .rvt files to a multipatch geometry feature class in Esri geodatabases? Or am I missing something?

0
styx_a38
Contributor
15 hours ago
bwhitney
bwhitney
asked in Transformers
Is there a way of working with GraphQL APIs using the HTTPCaller transformation?

I am in the process of working on an integration between Cityworks and ArcGIS Urban. While I am well-versed in using the HTTPCaller transformer for REST APIs in FME Desktop, after s few hours of working with an HTTPCaller, the only way I was able to make a GraphQL API call was using a PythonCaller with some custom code using the requests library. For now, the PythonCaller route will work well enough, but I would rather lean on the HTTPCaller for when others have to take over this integration who are not Pythonistas.

4
ian_1spatial
Contributor
17 hours ago
M
mkov
asked in Transformers
Extract line segments between two points

HiI have a spreadsheet (see table below) with a start and end point coordinates for different road sections and I'm trying to extract the road segments between the start and end points from another dataset containing my road geometry. Unfortunately the start and end points do not always lie on the road so I would need to snap it to the closest road. The road directions (road ways) are stored as separate features in the dataset with a common road id.Section IdStart LatStart LongEnd LatEnd LongA-33.938..., 151.151.-33.935...151.131...B-33.949...151.138..-33.931...151.154...C------------E.g. For Section B, I want to extract the two segments in green from the underlying blue road. The eastbound (EB) and westbound (WB) road features have a common road id of 1.I tried using two vertex creators, a point on line over layer, a topology builder and feature merger, but I haven't had too much success. Any ideas on how this could be achieved?

12
geomancer
Evangelist
19 hours ago
ldreyfuss
Participant
ldreyfussParticipant
asked in Transformers
Extract all line segments between many pairs of points

Hello,I have a set of pairs of points that each have a uniqueID_start and unique_end field. I am trying to extract all of the line segments between each pair of points. The tricky thing is that the pairs can be several line segments long, and have other pairs intersecting them:There could also be several points on a single spot, but corresponding to different pair sets.It’s a mess! Any help would be wonderful!

1
DanAtSafe
Safer
1 day ago
sammy
Supporter
sammySupporter
asked in Transformers
Resolve domains option to output coded value rather than "null"

Is there an option or setting that I have missed?I have a reader pulling in data from a portal feature service. I set it to resolve domains.I have a field that, for whatever reason, the coded value is not being resolved so the “_resolved” field is being populated as <null>.Rather than having to add transformers to each of my workbenches to check each of my domain fields, I was wondering if there is a setting I am missing somewhere?In this instance, I would rather have the coded values populate the “_resolved” field rather than it show up as “<null>”. Is there an option that I can set in the reader (or somewhere else) to be able to do this? I am using Workbench 2023.1. This post indicates that there was no option 3 years ago… hoping there’s been an update made? Also, looks like no progress made on this request (from 4 years ago!) to at least add a warning in this type of situtaion. Please go upvote: 

5
geospatialize
Contributor
1 day ago
markot
Observer
markotObserver
asked in Transformers
How to buffer a line?

How to buffer a line with different distances on the left and right side?The question is about road centrelines, where buffer needs to have different distances from centre line on left and right side.

2
jkr_wrk
Influencer
1 day ago
O
osacode
asked in Transformers
How to fix bugged user parameter ?

I had a workspace with 13 user parameters. When renaming them all, I accidentally erased one's identifier, and it duplicated it and the new one is bugged. When I try to save, the workspace crashes. After publishing it on the server, trying to run it shows not a single user parameter.  I can not delete it, and it is linked to every single transformer of the workspace (copy pasting any transformer from the bugged workspace to a new one imports the bugged user parameter and therefore corrupts the workspace). 

12
kirken
Contributor
1 day ago
kidega
Contributor
kidegaContributor
asked in Transformers
Manage custom paths, Included Data from Writers in Form 2024

Hello,I have previously in Form 2023 added custom paths in the “Edit Data Download Properties → Include Data from Writers” when preparing to upload to Flow.The issue I now have in Form 2024.1 is that after I have published the workspace to Flow or if I reopen the workspace my custom paths are not saved within the workspace, or if it’s saved to Flow as it was in Form 2023. This makes the Republish option button not useful as I can see as I have to rewrite the custom paths. Or have I might missed something? To be clear I belive this only counts for custom paths and the benifit with custom paths is that I can customize how files are organised within the .zipped file from the Data download service. 

0
kidega
Contributor
1 day ago
so_much_more
Contributor
so_much_moreContributor
asked in Transformers
Date functions only available in featureWriter transformer not in a Writer, why?

I need to write datetime to a comment on a SQL table after my postgres SQL writer is complete.This can easily be done like when using a featureWriter like so:COMMENT ON SCHEMA "my schema" IS '@DateTimeFormat(@DateTimeNow(), %Y-%m-%d %H:%M)';This is not possible if i use a regular postgres writer. Only SQL functions are available. This alone is not enough to set a timestamp.Tiny but frustrating neuance between almost identical transformer/writers. What other ways can i inject a datetime into my comment on schema syntax?  

4
bwn
Influencer
2 days ago
becchr
Enthusiast
becchrEnthusiast
asked in Transformers
Seconds to h/m/s but more than 24h

Hi, this must be easy but can't seem to find it...I want to convert duration from seconds to hours, minutes, seconds. So 337759 seconds should be 93h49m19s.I thought the DateTimeConverter should help me, but can't seem to get it right:results in 21h49m19s...I could calculate it myself, but I guess I'm overlooking a setting in this transformer?

4
philippeb
Enthusiast
2 days ago
gjaguilar
Contributor
gjaguilarContributor
asked in Transformers
Translation was SUCCESSFUL but it gives these errors

After deleting some files using the os.remove instruction within a PythonCaller the translation ends successfully but it gives these errorsWorker 215652 > Failed to apply the constraints feature to the readerWorker 215652 > Failed to apply the constraints feature to the readerWorker 215652 > Failed to apply the constraints feature to the readerWorker 215652 > Failed to apply the constraints feature to the readerWorker 215652 > Failed to read features from dataset 'C:/Users/LOCA1A~1/Temp/225/wb-cache-CLMS_Download_20240607_DESKTOP_2-igKtLc/LEGACY_DuplicateFilter_2 2 194 fo 0 UNIQUE  2  7b50d2c16b579db61a32ffc86b48776319f4311b.ffs' using the 'FFS' readerI have searched the web for the origin of the error but I can't find anything that makes senseI would greatly appreciate any help

1
gjaguilar
Contributor
2 days ago
katt
Contributor
kattContributor
asked in Transformers
selfoverlapping lines

Hello,I have several lines in my data base which are self overlapping. On the the picture you see the vertices and the order when drawn. Vertices 3 and 4 have been drawn before vertex 5 which makes the line self-overlapping or self-intersecting. How can I detect lines in my database which have that kind of problem ? I tried the geometry validator but I noticed that it detects only some of them. So it is not fully reliable in my case. Is there any other transformer ? I thought maybe of calculating the bearing as the change of direction could indicate that problem as well. Thanks for your help. (btw I don’t want any transformer to automatically correct them, I only want to detect them)  

5
gmbutler2
Contributor
2 days ago
arnold_bijlsma
Contributor
arnold_bijlsmaContributor
asked in Transformers
Check the value of User Parameter

This is either going to be a very stupid question or a very silly bug.I want to check if MyUserParameter has a value, so I put a Creator and a Tester on my canvas checking whether MyUserParameter does have a value. It tells me it doesn’t, whilst it clearly does! Hmm, what’s going on?Am I being dumb? Why can I not test a User Parameter?I can get it by using a ParameterFetcher, so it’s not a big issue.We recently upgraded from v2023.1 to 2024.1, and I thought this used to work, but I could well be mistaken.EDIT: It does work if I check if MyUserParameter is of type string or when using RegEx. It sounds like the ‘has a value’ and ‘is null / missing / empty’ doesn’t work with user parameters.

2
arnold_bijlsma
Contributor
2 days ago
rzel24
Contributor
rzel24Contributor
asked in Transformers
Unable to Connect to BigQuery

Hello,I was wondering if someone here could give some guidance to a problem we are experiencing.We our trying to connect FME to BigQuery but regardless if it is the reader or writer we are unable to connect using Web Connection.For the Web Connection settings we use or own accounts which have access to BigQuery. In fact when we connect directly to BigQuery we are able to see the project, datasets and tables and we are able to run queries on them.But when trying to establish the connection from FME using Web Connection we get the following error: BigQuery Connection ErrorAny help on how to solve the issue or to even find out what exactly is wrong would be appreciated.Thanks in advance.RZ.-

0
rzel24
Contributor
2 days ago
katericondo
Contributor
katericondoContributor
asked in Transformers
Extract minimum Z from rasters on intersect with polygon

I have several rasters with varying Z values and thousands of parcels. I’d like to extract the lowest z value from multiple rasters by parcel. Any help is appreciated!

3
todd_davis
Contributor
3 days ago
pkno
Contributor
pknoContributor
asked in Transformers
replace substrings based on a lookup table

I am trying to find a functionality within FME that allows me to replace substrings based on a lookup table. Since I have several hundred mappings, chaining string replacers together isn’t really an option.Basically something like an AttributeValueMapper that looks at substrings instead of the whole value only or a string replacer that accepts multiple string/replacement inputs.Is there such a transformer or any workaround to do this?Thank you! 

2
ebygomm
Contributor
3 days ago
salah.elfarissi
Contributor
salah.elfarissiContributor
asked in Transformers
PythonCaller Log does not show error line number (FME(R) 2024.1.1.0 (20240729 - Build 24619 - WIN64)

When python caller errors out.It does not show error line number. Message Type: fme::internal::_v0::py::ExceptionPython Exception <GEOSException>: LocateFailureException: Could not locate vertex.🟢06-Report (PythonFactory): PythonFactory failed to close properly

6
salah.elfarissi
Contributor
3 days ago
d.jimenez
Contributor
d.jimenezContributor
asked in Transformers
PythonCaller ArcPy 'FeatureProcessor' error

Hi,The below python code works in ArcGIS Pro:But returns the below error in FME:What would be the ‘FeatureProcessor’ python symbol?Regards

2
d.jimenez
Contributor
3 days ago
georgiec
Contributor
georgiecContributor
asked in Transformers
Modify relationships for ArcGIS Online view

I am writing a workflow that refreshes data within a hosted AGOL feature service.To enable continuity of service, I have 2 hosted feature services for the same layer.  eg.  Playgrounds_A and Playgrounds_B.    There is a view defined called Playgrounds_View whose source is either Playgrounds_A or Playgrounds_B My workspace plan is to refresh the contents of the ‘non-active’  feature service, and then set the Playgrounds_View to point to it.I have managed this previously with Python for ArcGIS scripts using commands like item.add_relationship() and item.delete_relationship()How can I recreate this functionality in FME workbench ?

4
todd_davis
Contributor
4 days ago
checcosisani
Contributor
checcosisaniContributor
asked in Transformers
How to use the CSS selector in HTML extractor

HiI would like to extract some info from a website that are inside a p tag inside a div class = paragraphs_item__body_paragraph_bundlethe website is https://www.padovanet.it/notizia/20221025/strade-chiuse See picture belowthx for support Francesco 

4
geomancer
Evangelist
4 days ago
so_much_more
Contributor
so_much_moreContributor
asked in Transformers
Dynamic workflow, extremely slow

I have a very basic dynamic workbench that is reading data from SQL Server. Before writing data to a postgis database it is changing an attriubte name with SubstringExtractor. But it is extremely slow doing so after almost 3 hours 150 000 objects has been read by the reader. Typically 100 000’s of objects is handled in matters of minutes. It is reading about 25 different feature classes I need to migrate daily.I cant wait hours for the workbench to be complete. 2024-09-27 15:11:02|6056.7|  0.8|INFORM|Reading source feature # 470002024-09-27 15:11:53|6106.9| 50.2|INFORM|Reading source feature # 47500It takes 50 seconds to read 500 features? What is wrong? Why is the process so slow? I cannot understand where the bottle neck is.  

3
bwn
Influencer
7 days ago
kidega
Contributor
kidegaContributor
asked in Transformers
Set the Row Height to 0 on the Feature Type

Hello,For the logged known issue in FME Form “FMEENGINE-82549” with “Excel Writer: Field Names row not written” the solution described is to Set the Row Height to 0 on the Feature Type, as discussed here. But what are the steps to do that?  Is it to simply just use transformer “ExcelStyler” and use setttings for “apply style to”?  Thanks!

4
kailinatsafe
Safer
7 days ago

Badge winners

Show all badges
29,799
Posts
Terms & ConditionsCookie settings