- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,725 Posts
50,915 Replies

When you subscribe we will email you when there is a new topic in this category

12725 Posts

Most replies

Most views

Newest first

jalaryContributor

asked in Transformers

Anybody have solution to connect to an LDAP/Active directory server after Deprecation of the reader in FME 2023?

Now that LDAP/Active Directory reader have been put on the deprecation list in FME 2023, I'm trying to find an out of the box solution in FME to update my workbenches and continue using it.

3502

1 year ago

so_much_moreContributor

asked in Transformers

Getting User parameters with python is formatting input values weird

I am writing a shutdown script to logg a workbench result to a postgres database.To log the output location of a gpkg file I am fetching a public parameter like so fme.macroValues['dest_path']But i get some weird formatting where backslash etc ar written as verbose text instead of the actual path? How can I get the actual path? C:<backslash>Users<backslash>User<backslash>Documents<backslash>FME_proj<backslash>20230913_FME<backslash>WIP<solidus>output<backslash>myoutput.gpkg

193

1 year ago

rzrncParticipant

asked in Transformers

Hi; I have a question related to the Attribute Manager transformer, "Substitute Missing, Null and Empty by" option.

My input attributes have numeric or string values, with possible empty string values.I would like to replace empty string values with Null. When I use the option "Substitute Missing, Null and Empty by: Default Value", and set "Default Value: <null>", nothing happens. The values remain unchanged (with empty string values). I can get the desired result with the help of "Action:Set Value" and Value: Conditional Value -> If ATTRIBUTE IS EMPTY -> Value <null>". I know I can use the Null Attribute Mapper transformer, and the Set Conditional Value method above, but using the"Substitute Missing, Null and Empty by: Default Value" option seems the most elegant to me. Have I misunderstood the purpose of "Substitute Missing, Null and Empty by: Default Value" or am I using it the wrong way?

880

1 year ago

chris_rmwContributor

asked in Transformers

Attribute Validator "In" List Validation

I am using the attribute validator to test a list of pavement marking line marking types coming from a AutoDesk SDF. The validator is throwing false errors when I use the "In" ValidationThe list of values in the rule configuration are: Broken 1-1,Broken 1-8,Broken 3-3,Broken 3-6,Broken 3-9,Double Solid,Simultaneous Solid/Brkn-1,Simultaneous Solid/Brkn-2,SolidEverytime I run my workbench Broken 3-3 is reported as an error even though I've verified that the spelling is correct.I've also tried subbing out the commas with double quotes and it doesn't seem to work either.

234

1 year ago

marcyeranosContributor

asked in Transformers

How can you combine attributes from various tables using an expression

Hello all, I frequently used the FeatureMerger or FeatureJoiner transformers. However, none of them seem to offer a join based on an expression, such as checking if a value from one table contains a value from another table. How can this be achieved? Thanks for any assistance.

4240

1 year ago

geographygeekContributor

asked in Transformers

How can I convert a polygon layer to have all 90 degree angles

I have a polygon layer that was digitized manually and as a result, has some issues with overlaps and gaps. However, the first issue I would like to solve is making the polygons have right angles. They are all square or rectangle-type shapes so each vertex should have a 90 degree angle. Is there a way to manipultate the polgyons so that they are all at right angles? At this point, I would be able to check for snapping and other issues. Thanks!

2200

1 year ago

hannahwh05Contributor

asked in Transformers

How can I reproject this wms correctly?

I am trying to reproject a wms from the Environment Agency (https://environment.data.gov.uk/spatialdata/risk-of-flooding-from-surface-water-extent-0-1-percent-annual-chance/wms) from WGS 1984 to British National Grid. I need to know the cell size so I can provide a degree of accuracy of the data and have confidence in my areas of intersect calculations with some polygons. However, when I use the Reprojector, the spacing seems completely off. If I view it in ArcGIS Pro, the cell size appears to be 2m, which seems sensible. I have tweaked the parameters in the Reprojector but this doesn't give me the correct cell size. Any ideas what I'm doing wrong?

360

1 year ago

mdumka

asked in Transformers

Hello! I would like to interpolate Z values at a 10 metre interval along lines that appear in a shapefile. Is there a transformer to do this? Thanks!

I have an Esri ArcGIS Binary Grid and a line shapefile. The shapefile was produced by the Surface Draper transformer, so it is 3D and has Z values at the verticies from the same Grid. The Z values that I would like to generate at a 10m interval can be output to a csv, instead of being applied to the shapefile: that is, I do not require verticies to be created in the shapefile at a 10m interval. Just need the interpolated Z values every `10m down the line. Thanks!

190

1 year ago

peter_rContributor

asked in Transformers

Is there a way to preserve SQL column order when dynamically executing SQL statements?

To ensure our database's data integrity, which is periodically enriched with measurement data governed by users, we use FME to create data validation reports in Excel. With these reports, users can correct their data iteratively. To make this work, we use SQL statements stored as attributes in a table. Depending on the report to be generated, SQL statements are fed into a SQLExecutor transformer as attributes. At the time of writing, we employ close to 500 validation queries, each with their own set of columns as well as amount of columns. The picture below shows how the queries are inserted into the SQLExecutor as an attribute. This is then routed to a dynamic Excel writer by using the SchemaSetter custom transformer. The Excel report is generated as expected, except for the column order, which is sorted alphabetically instead of the order specified by the (dynamic) SQL queries. Is there a way to preserve the column order specified by the SQL queries instead of having them sorte

525

1 year ago

aronContributor

asked in Transformers

Flatten XML?

(Disclaimer: I have only rudimentary understandings of the inner workings of XML.)The source below is a GML file where I need to fragment/flatten the elements shown. I would like to be able to treat them as "normal" features with regular attributes. I am using the GML-reader associated with this specific data source, Norweigan SOSI, my settings are also below. Q: What would be the best way to flatten this data? (Or would the XMLfragmenter be a better tool? I must admit I find all this a bit confusing)

240

1 year ago

j.botterillInfluencer

asked in Transformers

HTMLreportgenerator ESRI leaflet - feature layer URL more info needed

Hi there,I'd like to add an arcgis online feature service to my Html report. When I use the Map Esri leaflet, I'm confused by the terminology of 'feature layer URL'.... Documentation/helpThis parameter allows the user to specify a list of comma delimited ArcGIS Online feature layer URLs, that will be displayed as additional layers on the map. Is this the feature service item Id URL? or do we need to be more specific and enter the REST URL of the layer in the feature service? As I understand it leaflet provides visualization capabilities for data hosted in Feature Services, Map Services & Image services. I think the documentation needs some detailed wording and/or examples. I don't seem to have much luck using this option in the html reports, but I'd very much like to!

1046

1 year ago

abdullah83Contributor

asked in Transformers

Convert IFC to Geopackage

Saya hendak menukar file IFC kepada geopackage. Semasa meletakan writer geopackage saya telah memilih table definition manual dan juga Automatic. Masalah yang saya hadapi pada writer yang disetting Automatic, tiada objek geometri dan pada writer yang disetting manual berlaku kegagalan…Hanya apabila memilih dinamik sahaja ianya ok. Maslah saya disini dalah tidak mahu menggunakan table definition secara dynamic. Mohon bantuan bagi yang mahir. Bersama ini disertakan file2 tersebut. Tqvm.

400

1 year ago

ranga_tolapiContributor

asked in Transformers

SQLExecutor - Required "Output Schema Before Data Features" parameter

Experiencing, Schema features output from the SQLExecutor only after the Data features. This is causing issues for dynamic workspace. Currently managing this by connecting FeatureHolder to the Result (Data features) port of SQLExecutor, to hold the Data features and let the Schema features reach dynamic writer first. From the above screenshot it can be noticed that, Schema features are started coming out only after the Data features. To address this, required either of the below for SQLExecutor.Schema features output first before Data features all the time.Required "Output Schema Before Data Features" parameter, similar to SchemaScanner. FME version: 2022.2.2

130

1 year ago

mlauer

asked in Transformers

Workflow brainstorm: Creating polylines with zero or many midpoints

I am trying to think through the best way to approach this in FME. I need to create polylines from a CSV file. I have two files in the following format: File1 contains one row per line, including the start and end coordinates for all lines:Line123, StartX, StartY, EndX, EndYLine456, StartX, StartY, EndX, EndY File2 may or may not have additional midpoints. Each midpoint is on a new row. So two midpoints for Line123 would look like: Line123, X1, Y1Line123, X2, Y2 I need to combine these in the correct order to rebuild the line. For each unique LineID, I need [StartXY] + [Midpoints] + [EndXY], and the midpoints need to be in the same order as originally presented. There are likely many ways to approach this. Here is my first attempt. I know I can use LineBuilder to construct any midpoints from the second file. It's set to wait for all inputs and process at the end, grouping by LineID. I know the order of vertices depends on the input. I want the LineBuilder to process the span S

109

1 year ago

johntContributor

asked in Transformers

FeatureReader multiple files not behaving correctly

Hi,My workspace worked in 2019.x, but I noticed an issue when it was migrated to 2022.2.0. I read in multiple *.TXT files from a single folder using a FeatureReader (passing the folder name with a parameter), they are actually csv files - so use that as the format. In the Parameters I set "Field Names Line" to None as there are none. I expose "col0,col1". It reads all the files and I get the correct feature count, but it reads the first file fine, but all subsequent files it uses the values from the first line as the field names - effectively ignoring the "Field Names Line" Parameter. Is this a bug? As I say, it worked before. Kind regards John

410

1 year ago

antoine.princeContributor

asked in Transformers

How to duplicate observations to assign group?

Hi everyone, I am looking for the right transformer to do a simple table manipulation here. So I have T1 (a table with multiple columns) and T2 (a table with a single column representing groups). I would like to duplicate T1 n number of times (n = number of groups in T2) where each row in T1 would be copied to be represented in each group to give T3 as a result. Thanks in advance!

1 year ago

tb09114Supporter

asked in Transformers

Does my reprojection work?

I have to write my results in EPSG:4099 and FME does not offer the coordinate system. I found the opportunity offered by safe to define a custom coordinate system by supplying (ESRI Projection) WKT.The resulting fme file and exception file went into my documents folder into the respective sub-directories of the FME folder.The webpage explains that by doing so every project in any installed FME version will know the coordinate system. The WKT definition for EPSG:4099 can be found here. I use the Reprojector to bring my data from EPSG:25832 to EPSG:409, write the results to file, where the writer is set to have a coordinate system of EPSG:4099. When I import the resulting dwg into QGIS the layer is recognized as EPSG:4095.When I read the resulting dwg again into FME and check the coordinate system with a CoordinateSystemExtractor then there are no information at all. Am I producing data in EPSG:4099 or not?

410

1 year ago

aronContributor

asked in Transformers

Trim white space from column names?

I have some datasets with unpredictable white spaces in the attribute (column) names. Is there a way to automatically trim these? The trimming tools I found all seem to be dealing with strings.

530

1 year ago

pabloolivaresmSupporter

asked in Transformers

Calculate afforestation rate by plots

Hi all, I have two geopackage files in QGIS: One of them a multipolygon with coverage tree and the second one a multipolygon with the plots. Im looking to calculate the afforestation rate by plots, that's means the percent of total plot surface that's covered by the tree layer and add this afforestation rate as a attribute in plot layer As you see in the image below, in green I have the coverage tree and the lines show the plots limits Thanks you allPablo

150

1 year ago

jamesblytheContributor

asked in Transformers

Hello everyone, I am writing this enquiry about Anchored Snapper. I have two line datasets, one is the Anchor and the other is the Candidate. Unfortunately all of my features are outputting to the Untouched port. Can you please help?

There are 95207 features within the Anchors layer and 82716 features within the Candidate layer. All Candidates are exporting through the Untouched Port and nothing is coming out of the Snapped port. I have attached the workspace. Our data is projected to GDA2020 MGAZ55. Any help would be greatly appreciated. Yours sincerely. James Blythe.

1 year ago

abdullah83Contributor

asked in Transformers

Freature with 2 vertex need to built line

Hi i have feature with 2 vertex (represent pipe line). How to built line from this 2vertex?

1 year ago

malikfadiParticipant

asked in Transformers

Hi, I am new to FME and trying to convert Multipatch Shapefile to CityGML file but I am unable to do so. I want the simple buildings not texture or any details else. Is there anyone who can just review my data and update the workspace?

Please take a look on the attached files and update my workspace. It would be great if anyone highlight the process which I am missing in the simple conversion?Thanks in advance.

910

1 year ago

benadei

asked in Transformers

I have three columns of data: (Week, Year, Flow). I would like to pivot or transpose this data without any calculations or summary statistics. Year in rows, Week in columns and just fill in the corresponding flow values. Thanks for any help with thi

130

1 year ago

mr_fmeEnthusiast

asked in Transformers

Expose attributes in Python Caller

Hi, My workspace attached only takes information from the Website and shows values in the log. How Can I expose the response in attributes using Python caller? Thank´s

2376

1 year ago

tim_bkrParticipant

asked in Transformers

Intersecting polygon dataset to keep only parts which don't intersect

Hi,I have two polygon datasets (A and B). Of B I want to keep only the parts of the polygons which are not overlapped by A. Let's call these output features the dataset C.Additionnaly, I'd like to calculate the area of the C polygons. Ideally, I'd need to know the area of each C polygon. I've noticed that AreaCalculator seems to ouput only one single feature...Thanks in advance for your help !

110

1 year ago

Page 43 / 509

Badge winners

dahbi_thas earned the badge Integrate Spatial Data
jamshethas earned the badge Expert (Grey)
jamshethas earned the badge Teacher (Grey)
jamshethas earned the badge Student (Grey)
rinadaenydoxhas earned the badge Teacher (Bronze)

Show all badges

30,610: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.