- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,681 Posts
50,728 Replies

When you subscribe we will email you when there is a new topic in this category

12681 Posts

Recently active

Most replies Most views Newest first

vxn43Supporter

asked in Transformers

Filters in Excel Sheet - how to create in FME Form?

I have a workspace that writes to a simple Excel sheet. The sheet has 3 columns: Report Name, Upload Date, and Upload Time.In Excel you can set a Filter for each column allowing a user to filter the data in that column. In Excel, I added a Filter to each column, but when I write to the sheet in FME Form, the Filters disappear. Is there a way to “keep” or “add” a Filter to each column in the sheet by tweaking a Writer parameter or is there another Transformer I need to add before the Writer? The screen capture below shows what I would like the sheet to look like:

1331

9 months ago

derekgParticipant

asked in Transformers

Using IN operator with tester transformer

I have a list of lab test results and only want to include the rows that match a list of analytes. I am trying to use the IN operator in the tester transformer.I have followed the advice from this post:Help with syntax when using Tester transformer | Community (safe.com)This is what I have:Sheet1 contains the test results, text_line_data contains the list of analytes as one feature. I have merged them to get this: The “text_line_data” column looks like this: My tester transformer is set up as below: However, all rows fail the test. What am I doing wrong?

722

9 months ago

debby

asked in Transformers

Linear Referencing

Hi All, I have a table with a 'route_ID' and a measure value (like a event table). On the other hand I have a polyline feature classe. The attribute 'Name' correspond to route_ID from the table. The measure values are points on the lines. Now the measure values changed by a predetermined value (e.g. the point was 10 m and now the point is 10.5m). My Problem, the Polyline feature class is not defined as route form a linear referencing system. And so the table and the Polylines have no relations. I don't no where (which coordinate) my old and new points are. Can I build a route feature class with FME? The Basisc should be my polyline Feature Class. I would have assumed a route feature class, how can I creat points (with coordinates) form the table? Thanks for your help. Debby

1965

9 months ago

xabiContributor

asked in Transformers

Active choice for custom transformers not working in version 2023

I have a workbench build in version 2022 using active choice to enable and disable parameters based on other parameter values. This option stopped working in the new 2023 version.Does anyone know if the active choice is discontinued?Thanks

462

9 months ago

d.jimenezContributor

asked in Transformers

FME Desktop 2022.1 crashes when trying to read Esri File Geodatabase - Reader works fine with any other format including Arc SDEs but crashes when setting format to File Geodatabase and trying to browse local drive

367

9 months ago

marta.podsiadSupporter

asked in Transformers

Dynamic Schema - wrong attribute order

Hi, I have a gdb with pleanty feature classes with unique schema and I use SchemaScanner and Dynamic gdb to save the layers. Feature layers saved in the gdb have correct schema but the order of the columns is wrong, it looks like the new feature layers have the columns ordered alfabeticaly

984

9 months ago

romarContributor

asked in Transformers

SQLExecutor Very slow when using DELETE FROM in Oracle

I am having issues with glacial speeds of using a delete from statement within a SQLExecutor pointed to Oracle Database. The SQL query is something like:DELETE FROM ABCWHERE ID = @value(id)AND TO_CHAR(DATETIME,’YYYYMMDDHH24’) > @value(timefrom)AND TO_CHAR(DATETIME,’YYYYMMDDHH24’) <= @value(timeto) (note: The query above is paraphrased and might contain syntax-errors, I have checked and confirmed the syntax in the actual version) The Oracle Table contains about 40 million rows, so I expect this to take some time (1-5 minutes per query) but not the >30 minutes for the first query (at which point I gave up, I have not confirmed if the query will ever finish) Currently I am using a workaround of Loading the primary keys of all features that fit the selection criteria and using a writer to DELETE all corresponding records, but this seems unnecessarily inefficient and wasteful. I can imagine that the error is caused by Oracle not returning a ‘succeeded’ or ‘finished’ message, causi

451

9 months ago

geovisionContributor

asked in Transformers

Create polygon from string of coordinates

I have XML file with features I'm trying to read.. that works. Next step is to create a polygon for each feature, I have a string with points that make the polygon. String looks like this: 173363.252 587903.412 173363.369 587902.665 173362.055 587900.798 173363.867 587888.745 173364.007 587887.815 173371.744 587888.843 173368.618 587904.7 173363.252 587903.412 That's a list of x and y coordinates, now I can't figure out a idea to make polygons from it. Any ideas? Do I have to seperate them, create lines and make a polygon from it? Any help is appreciated.

2715

9 months ago

aseyed

asked in Transformers

I would like to convert a json file to csv using a csv writer from a json fragmenter. How do I convert it? The json file is an output that is generated using API tokens. More message will b

I would like to convert a json file to csv using a csv writer from a json fragmenter. How do I convert it? The json file is an output that is generated using API tokens. When I run the FME workbench, the translation log is successful. But when I try to inspect the data, I get the below error message. Please look into it and do the needful. An error has occurred. Check the logfile above for detailsCSV reader: Failed to open file 'C:\\PSDCitywide_towns\\Lake simcoe\\LakeSimcoe_Trial_17J2024\\@Value(Assets).csv' for reading. Please ensure that the file exists and you have sufficient privileges to read itCSV reader: Failed to open file 'C:\\PSDCitywide_towns\\Lake simcoe\\LakeSimcoe_Trial_17J2024\\@Value(Assets).csv' for reading. Please ensure that the file exists and you have sufficient privileges to read itAn error has occurred. Check the logfile above for detailsFailed to specify the feature index as constraints on the readerAn error has occurred. Check the logfile abov

641

9 months ago

bkggContributor

asked in Transformers

Extracting the coordinate index nearest to point

Hey guys, I have a fairly large dataset of lines and points. The points need to receive the Z coordinate from the nearest index on the line. Using the CoordinateExtractor followed by a ListExploder isn't an option because that would be too heavy for my workspace. Isn't it possible to use the CoordinateExtractor in a way that in the setting 'Specify coordinate' you only extract the index that is nearest to a point feature? Is there a different way to go about this?

201

9 months ago

sschley8

asked in Transformers

I have an FME session set up, from shapefile to shapefile with a renamer. My number fields go in as "Long". They are set to come out as "Long". When I pull the output into ArcGIS, the format is "Double" What am I doing wrong?

141

9 months ago

pej.kContributor

asked in Transformers

Issue with RasterObjectDetectorSamplePreparer in sample preparation for object detection

Hello,I encountered an issue while using the RasterObjectDetectorSamplePreparer to prepare samples for the RasterObjectDetectorModelTrainer. My goal is to detect certain objects based on a digital orthophoto image. I created an annotation.txt file using OpenCV and provided the relative paths to the negative samples directory and the annotation file as inputs to the Sample Preparer transformer. However, when running my workspace, I received the following translation log message:Translation FAILED.The translation was terminated due to the following feature:RasterObjectDetectorSamplePreparer_<Rejected> (TeeFactory): RasterObjectDetectorSamplePreparer_<Rejected>: Termination Message: 'RasterObjectDetectorSamplePreparer output a <Rejected> feature. To continue translation when features are rejected, change 'Workspace Parameters' > Translation > 'Rejected Feature Handling' to 'Continue Translation''The feature on tag `PYOUTPUT' fail

355

9 months ago

aronContributor

asked in Transformers

Correct syntax for SystemCaller?

(This is a spin of question from https://community.safe.com/s/feed/0D5OO000004YH4O0AW, but I thought it made sense to rephrase the question) I am trying to run a shell script from SystemCaller but for some weird reason I can not make it work. My command line is: cd "/Volumes/disc1/test_systemcaller/" && my_script.sh 25 5The numbers at the end are parameters for the script. The error I get from the log file is:sh: my_script.sh: command not foundThe file 'my_script.sh' is placed in the actual folder, so should be found.If I test the file path by asking it to do something simple, eg mkdir, it will happily do so in the right place.If I run the command from Terminal it works fine. I made a second script in the folder with a mkdir just for testing. While it works fine in Terminal, FME claims to know nothing about it. Since system caller cant find the script file, even though it is in the folder, I guess that something might be wrong with my syntax? I'm on a Mac if that matters.

725

9 months ago

kattContributor

asked in Transformers

hardcode to not use FME MF DIR ?

My fmw is saved in a directory called C:\\DATA\\VariousTasks. A parameter called InputFolder is pointing to a subfolder of this directory. Is it possible not to use FME MF DIR predefined parameter ? I use a text parameter to point to C:\\DATA\\VariousTasks\\DEV but the script is replacing it automatically by "$(FME_MF_DIR_USERTYPED)DEV" when executing which translates to C:\\DATA\\VariousTasks/DEV . I am using a python script later and python is every sensitive to / and \\ . How can I force FME to use C:\\DATA\\VariousTasks\\DEV instead of $(FME_MF_DIR_USERTYPED)DEV (translating to C:\\DATA\\VariousTasks/DEV) ?

551

9 months ago

totree30Contributor

asked in Transformers

how to create a CityGML format in LOD2?

1191

9 months ago

aruja2000Contributor

asked in Transformers

I would like to extrude footprint which is available in Shape file till Building roofs, But extruded buildings are above the given building roof, Even I am not able clip the extruded buildings. Any suggestions and solutions if any?

162

9 months ago

lakContributor

asked in Transformers

@Value(attribute) appearing as a literal string "@Value(attribute)" instead of the dynamic value

I have a workspace that takes a spreadsheet that contains these fields: And I've got that reader feeding into a FeatureReader that grabs the Source Dataset feature classes from a specified .gdb. I would like to dynamically create a new attribute called "_description" and populate it with the values in the Feature Description column. The values that are referenced in the Feature Description column are not exposed, but I can view the values when I click on a feature in the visual preview. I've tried to use an AttributeCreator with the following parameters:However the output looks like the literal string input values, instead of dynamically grabbing the values from the feature:Is there another way I can achieve this?

294

9 months ago

geouser97Contributor

asked in Transformers

Topologybuilder: z values are not considered while computing intersections.

Hello, i used the topologybuilder transformer to build the topology of a network ( roads centrlines). The problem is that z values are not considered while computing intersections. So it may not produce correct results for overpasses, inderpasses....Any recommandations please. Thank you.

102

9 months ago

esraahefzy25

asked in Transformers

How to convert XML data from Overpass API to SHP file?

I have got this Geometry XML data from HTTPCaller and need to know what is next to convert it to SHP file or other ESRI formats, I tried to find an XML template for geometry and run it with XML Processor and then XMLFragmente, but I didn't get the data.

461

9 months ago

joySupporter

asked in Transformers

How to remove rows with only NULL Values

Hello everyone, This might be a simple question, but for some reason I can't figure out how to remove rows with only Null Values (Of course I can useTestFiler or Tester, but would be cumbersome work, since I have a lot of columns and I don't want to go into that rabbit hole)These rows with Null values came into existence, since I read in an excel file with two worksheets with two different schemas. So the column names in worksheet 1, is different compared to the column names in worksheet 2. Therefore all the values from worksheet 2 have null values. I actually don't need worksheet 2, so I was thinking there might be 2 solutions. 1) don't read in worksheet 2 or2) remove the null values For both of them I don't know the answer.....dramatic sound effects..So if someone knows the answer, that would be very nice.

3644

9 months ago

so_much_moreContributor

asked in Transformers

Dynamic writer does not find existing schema

I am writing to MSSQL using a dynamic featureWriter. But I can not understand why it fail to write to an existing schema. Warning: Cannot find a matching schema named 'dbo.MyTable' in the known set of schemas: ''. Known schema sources are: 'MSSQL_SPATIAL_1'. Please verify writer feature type configuration Error: Microsoft SQL Server Spatial Writer: A feature has arrived with 'fme_feature_type' of dbo.MyTable, but the feature type is not recognized. Halting translationMSSQL_SPATIAL writer: A fatal error has occurred. Check the logfile above for details. The fme_feature_type here is "MyTable". In the writer I use dbo as table Qualifier to match the existing table in my database "dbo.MyTable".What is it I am not getting? I have set the Schema Definition Name to the default option because it should use the table definition for the fme_feature_type "dbo.MyTable". I will try to prefix the Schema Definition Name with the dbo. prefi

1545

9 months ago

adam_w

asked in Transformers

Intersector, LineonAreaOverlayer and Clipper leaving dangles

I am trying to segment a line dataset at every intersection with a polygon dataset. Instead of breaking the line at the true intersection, the transformer appears to generalize the polygon first, then break the line at resulting intersections. The result is as seen in the image, in this case a dangle of about 7'. (candidate line left to right, original polygon in brown, and Intersector's drawn line from bottom left to top right. Selected blue line should end at polygon boundary.)I've tried LineOnAreaOverlayer, Intersector and Clipper with similar results. I've manipulated the coordinate systems of each dataset and changed their source type with no differences. What am I doing wrong? Thanks!

9 months ago

000craig

asked in Transformers

Preserving ESRI Domain Descriptions (not codes) when exporting data.

Pretty simple data export, I have a reader referencing some SDE data and then a writer to a file geodatabase. But reviewing the attributes in the file geodatabase I see that the domain attributes are the codes (1,2.3, etc) not the descriptions (copper, steel, PVC, etc).Is there a way to write the domain descriptions and not codes? The same is true for the subtypes, it is writing the code (1,2,3) and not the description (tap, bend, saddle, etc).

2866

9 months ago

marta.podsiadSupporter

asked in Transformers

Expose Data Source info from Feature Layer/ArcMap

Hi,How can I expose the information that are visible in the Properties/Source tab of feature layer

222

9 months ago

markcoopersdcContributor

asked in Transformers

FeatureJoiner rejecting where null left key

I am joining 3 tables together. There will always be a record in the first table and there may or may not be a related record in the second. If there is a related record, there may or may not be a record in the third. I always want to have the record from the first table.The relationships are as follows:Left: Table 1 primary key - Right: Table 2 foreign keyLeft: Table 2 primary key - Right: Table 3 foregin keyWhen I try and set this up using FeatureJoiner transformers, it works ok on the first, but if there is no record in the second table, it cannot join to the third as there is no left key. Is there any way to pass records with a null left key in FeatureJoiner? If I did a similar workflow in a Microsoft Access query I would still have the record from the first table. I presume I could use a FeatureMerger and pass Merged and UnmergedRequestor into the input of the next transformer. This could work ok but I do much prefer the FeatureJoinerMany thanks

2753

10 months ago

Page 31 / 508

Badge winners

reveszhas earned the badge FME Flow Authoring Training
magdahirschhas earned the badge FME Certified Professional
sandrawanghas earned the badge FME Flow Authoring Training
mglancloshas earned the badge FME Flow Authoring Training
halinakozak29has earned the badge English Speaker

Show all badges

30,159: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.