Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,684 Posts
50,749 Replies

When you subscribe we will email you when there is a new topic in this category

12684 Posts

soothsayersContributor

asked in Transformers

Surface Modeller getting stuck

Hi,I am using a Surface Modeller during the creation of TINs for 3D output. The majority of the time this works absolutely fine but some processes seem to stall at the same point (starting to build surface model) and I can't seem to work out why.It succeeds when there are more input coordinates than shown in the final line above. It succeeds with some more complex topographies than those that fail. It fails when there is only 1 Group in the output.I have tried altering the Surface Tolerance to a larger number but this made no difference, except to make the successful output more generalised!It occasionally stalls when building the Voronoi Diagram too, although we use the Triangles output in the process as opposed to Voronoi.It fails in both Desktop and Cloud environments.Thanks in advance!

asked in Transformers

How can I deal with arcs from DWG file

I have a DWG file that contains some arcs that are recognized as arcs and some as polylines with multiple segments. I would like turn all of them to arc with two nodes (start and end) with center point, radius and a rotation (cw or ccw). What would be the best steps that I would be able to take to achieve this?

asked in Transformers

how do i process all AGOL features at once instead of one by one?

new to FME so i apologize for the elementary question, but is there a way for me to bring in all features within a feature service at once so that i can process them with a python caller? i need to run counts and reference external csv files on the data and i can't do it properly without having all of the records. for example, if i wanted to send an email that contained a list of all employee names within a feature layer, how would i do that? currently its sending an email for every employee within the feature layer (100 employees = 100 emails) i need 1 email that contains 100 employee names.

asked in Transformers

Is there a transformer that is like Power BI's "pivot column" function or Python pandas' pivot function?

For the life of me, I cannot find a transformer that does this simple, often-used data transformation. I do NOT want to aggregate the values when I pivot as the AttributePivoter forces me to do, and the AttributeTransposer makes no sense to me at all; I've tried about every combination of options with it with no luck. I have given an example of the transformation I am trying to achieve in the attached picture. If anyone is familiar with Power Query within Power BI, it would be the same as pivoting an attribute column on top of a values column (with no aggregation). Similarly, this could be achieved by the pandas' pivot dataframe function.

nedwatermanContributor

asked in Transformers

FME replacing commas in url with characters

Hi,I'm using FME to query an API. I'm passing long-lats as a comma separated value to the API, but FME is turning the comma into a url character (%2C) so the request is failing. Is there a workaround for this?ThanksN

asked in Transformers

I'm getting an error associated with 'pmi_is_error' global variable. Does anyone have any ideas of what might be causing it?

I have a workspace which has worked previously but now keeps giving me the following error message: Attempting to retrieve global variable 'pmi_is_error' which was not set -- setting it to the empty stringFailed to create process, error was 'Access is denied. Does anyone know what this error might be associated with with or how I could approach solving it? I've tried searching for it but haven't found anything useful so far. Thanks

asked in Transformers

How to loop through text file?

This must be trivial but after long workday my brains are not working.I have a text file which I need to convert to table. Here is a simple example to demonstrate the problem. Input text file contains street names for cities. City-keyword indicate when the city change.Input text file: Output table:

asked in Transformers

How to create DateTimeNow without attribute without the milliseconds/seconds

Hi pretty new to this software/role as BI Developer. I have noticed that when using - @DateTimeParse(@round(@DateTimeNow()),%Y%m%d%H%M%s) In an attribute creator it returns an undefined value of - 19700101000009+00:00. What is the correct way to do this so it returns DateTimeNow.

asked in Transformers

Remove duplicates as simply as possible

Hello, After struggling with several transformers, I can't figure out how to simply remove duplicates from 2 identical Excel files with exact same column names, etc ... but with different numbers of rows. First file contains 3130 entries and second one 2926. What I want is to be able to extract the 204 missing lines to check their differences. In my small brain, a simple transformer that checks missing entries between two columns and group them in an inspector should exists but it seems not to be complicated enough ... ;o) Thanks for any help

asked in Transformers

I want to be able to retrieve a PDF from an open access website on a weekly basis.

I have been able to do this using the HTTP caller. The issue I have is the the URL that I am calling changes slightly each week. The number in the URL increases by one each week. Is there a way I can automate the change in the URL so that it will retrive the up to date document from the link? Thanks in advance for any assistance.

asked in Transformers

Timeline for ETL workbench to support Esri Communications Data Management model, part of Esri Utility Netowrk?

We are needing to migrate fiber data from a typical GIS-based fiber platform into the new Esri Communications Data Management model (uses Esri Utility Network), however, the data structures are completely different when it comes to associations for items like fiber strands and equipment ports.

thijsknapenContributor

asked in Transformers

Why are optional parameters always hidden for string functions, and always shown for math functions in the Text/Arithmic editer?

When I select a string function from the left banner of the the 'Text Editor' window, I notice that the function in the main window will only indicate required attributes to specify. For example, when selecting 'FindString', in the main window the example text '@FindString(<string>,<strToFind>)' is shown. However, if I look at the documentation on the string functions: https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Transformers/!Transformer_Parameters/StringFunctions.htm,I see that also the following optional parameters can be passed on to this string function: [startIdx] and [caseSensitive]. What I think is a bit strange however, is when I select a math function that has optional parameters, it will show the optional parameters for that function in the main window of the Text Editor/Arithmic Editor. Consider for example the floor function; selecting it will show '@floor(<float>,<precision>)' in the main function of

nicholasContributor

asked in Transformers

EPSG code not written in ECW header correctly

I am running FME(R) 2019.2.3.2 (20200320 - Build 19825 - WIN64)I am trying to convert a cloud-optimised geotiff into an ecw image (v2)The image has GDA2020 datum, MGA Zone 56 projection, which is EPSG: 7856https://epsg.io/7856 The output ecw does not have the correct values for datum & projection in the header. I can use ERDAS Imagine to read the header valuesThis is the result from FME (as per attached image from_FME.png)Datum EPSG: 1168Projection Name SUTM56EPSG Code 0 To compare, I used ERDAS Imagine to perform the same conversion and these are the header values (as per attached image from_Imagine.png)Datum GDA2020Projection Name Transverse MercatorEPSG Code 7856 I would prefer to use FME as it does bulk translations well. But I need the header information to be correct. How to fix?

thijsknapenContributor

asked in Transformers

Is there a transformer that can use generic expression (using string functions) for a group of attributes?

It seems to me like I'm looking for a transformer very similar to the ExpressionEvaluator with 'Evaluation Mode' = 'Overwrite existing Attributes', only without the numeric evaluation (that doesn't seemingly 'wrap' the expression in a arithmic editer). I thought about posting an idea about this (e.g. create new transformer or add parameter 'evaluation mode' = (text|arithmetic) to ExpressionEvaluator), but just wanted to check if I'm maybe overlooking existing functionality. Attached is a workspace that illustrates the numeric evaluation possibilities in the ExpressionEvaluator, and an example of how I would like to have the option for a 'text evaluation' possibility to e.g. add '_concat_@CurrentAttribute' to each attribute in the selected group.

asked in Transformers

Is there a way to make a partial fetch (only some column) with featureReader like with other (Legacy)Reader

When I use any SQL reader if I limit the attribute in the "User Attribute" tab with the option "Exposed Attributes": FME seems (regarding perf) to use a query like "Select Attrib1, Attrib2 from..." in place of a "Select * from ..." when I use Feature Reader It fetch all column even if I output to generic port and expose only some attribute. I have some Huge binary and text collumn that I dont need and I fetch thru a slow connection. Any Idea ?

asked in Transformers

Hey community! I need to know if I can export in a python script language my total transfomation of my workflow. Can I do it? And how can I make it?

Hey community! I need to know if I can export in a python script language my total transfomation of my workflow. Can I do it? And how can I make it?

asked in Transformers

How to find rivers that intersect two times with other rivers (think of river sleeves)

So, I have a linear dataset of rivers. I have developed a RIVER_ID that serves as a unique ID per river. Saying this, one RIVER_ID usually has more than 1 unique ID depending on how long the river is. I firstly created them grouping by name in the network topology and using the Network_ID as a RIVER_ID. Later, I calculated Strahler order and used that to assign to unnamed rivers. So, what I want to locate are rivers (same RIVER_ID, could be multiple unique features) that touch a different RIVER_ID minimum two times (think about river sleeves). So, I went with Spatial Relator but I am now realising that a Spatial Relator will only give me 1 related candidates if my Requestor is touching the same IDd river at two locations and not two as I was hoping to get. Another thing that pops on my mind is using a snipper to get the first and last vertices of my Requestor feature and find a number of overlaps with other features and generate a list with these overlaps and check if there are two sam

arnovananrooijContributor

asked in Transformers

Data from CoquitlamInfrastructureAR.fmw example workspace

Hi,I'am working on my first Augmented Reality model in FME. I have data from cables, sewers etcetera. As an example I found the webinar (https://www.safe.com/webinars/data-in-the-real-world-fme-ar-and-fme-data-express/). This webinar comes with some example workspaces. The workspace CoquitlamInfrastructureAR.fmw seems to do a lot like I would like to do. It looks way more complicated than I'd expected. It's even harder to go through cause the data used is missing. There's a feature reader reading shapefiles, bur the shapefiles are not included. There's also a google sheets reader that I can not use.Can someone provide the data? Thank you in advance,Arno

thijsknapenContributor

asked in Transformers

How does 'group by' option work for transformers that contain multiple input ports

Consider for example the case with a FeatureMerger or a FeatureJoiner. I have always been wondering how the groupBy is executed here. Is this on a single port (e.g. Requestor or Left) or across multiple ports. Especially in combination with the option 'Process when group changes'. I made a small illustration workspace, with the merging application inspired on 'a hiccup' I came across today where I wanted to accumulate incoming attributes at a 2DGridAccumulator, but there is no default field/option for this (an idea on this was already created, see; https://community.safe.com/s/idea/0874Q000000TlLbQAK/detail). To see differences in results, I changed the order of the features entering the supplier input port of the FeatureMerger, and for whether features should first route to the Requestor, or first to the Supplier port. In the cases when the feature order going to the supplier is changed (case 1 and 2), I see that most features don't merge, but I don't underst

asked in Transformers

I would like to rename a set of attributes (columns) in bulk from a lookup file (csv or xlsx), is this possible? It seems like it should be a fairly simple task, so apologies if this has already been asked.

I would like to rename a large dataset of many columns using a lookup file (csv or xlsx) - is this possible? I have explored the ..Mapper transformers, but am unable to get them to work in this way. The only method that appears possible at the moment is through the AttributeRenamer, but am finding this rather tedious entering one by one. The Import facility on this transformer only appears to name Input and Output Attributes with the same names when I use it.Happy to be corrected in my use of this transformer!The column name lookup I have structured in a spreadsheet as below;

asked in Transformers

Dynamic Attribute Mapping

Hi All, I have a Child workbench which takes input as SDE FeatureClasses and Creates FGDB. i am passing all feature classes dynamically to the writer (all different types like points, polygons and polyline featureclasses). My SDE Feature Class has Long Attribute(Fields) Names and I required to create FGDB Feature Classes with Short Attribute(Fields) names. I have a web service which gives JSON output of Short Names. For each feature class, i need to connect to web service and get short names, create FGDB feature class with these short names. Could anyone have an idea how can I dynamically update FGDB feature class?

asked in Transformers

Create a Grayscale (8bit), RGB(24bit) or Palette (8bit) Raster with the RasterInterpretationCoercer

I got some multiband raster images and want to create a workspace which allows the user to choose the bit depht/color depht between Grayscale (8bit), RGB(24bit) and Palette (8bit). I used the RasterInterpretationCoercer but it does not work with the Grayscale, because the input images contains multiple bands. Anynone can give me a hint to make it possible? Thx and best wishes Barry

asked in Transformers

Name Workspace output File like the RasterTIler output tile number.

I tiled a raster image with the RasterTiler and get as result 4 tiles and now I want to name the workspace output file like the output tile numbers. Like this: up left tile= 1 -> Filename_1.TIFup right tile=2 ->Filename_2.TIFbottom left tile=3 -> Filename_3.TIFbottom right tile= 4 -> Filename_4.TIF So I used the stringconcetonator to name the attributes like the tile numbers, but I dont get the desired result what am I doing wrong? Best Wishes Tina

asked in Transformers

How to create an Userparamter with picture depht/bit depht choice?

Hello all, I want to create an user parameter to let the workspace user choose between three different picture depht/bit depht: (gray 8, palette 8 and RGB24). I used the RasterInterpretationCoercer, but how do I connect it right with an user parameter? My Result is an userparameter prompt with an list of all possible choices of the RasterInterpretationCoercer (below in the attached picture) But I want just the 3 different possibilities Thank you very much.

asked in Transformers

Error while reading a XML-file

When i am trying to read the XML-file "bomen-elburg_short" I get this error: XML Parser error: 'Error in input dataset:'bomen-elburg_short.xml' line:23 column:46 message:prefix 'gml' can not be resolved to namespace URI'Whats going wrong, and how can i solve this?

1
...
173
174
175
176
177
178
179
...
508

Page 176 / 508

Badge winners

baileyatsafehas earned the badge 12 Days Participant (2024)
dos_gishas earned the badge 12 Days Participant (2024)
j.botterillhas earned the badge 12 Days Participant (2024)
fme_studenthas earned the badge Welcome Back
evoteckhas earned the badge 12 Days Participant (2024)

Show all badges

30,185: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.