- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,725 Posts
50,913 Replies

When you subscribe we will email you when there is a new topic in this category

12725 Posts

Most replies

Most views

Newest first

galigisEnthusiast

asked in Transformers

FeatureReader Performance Improvement

Hi All,I have created a workflow that reads a few large GIS datasets in vector format across different areas. To avoid reading all the records in the dataset and reduce time I have used the FeatureReader transformer which is connected to the layers and an Area of Interest. The Spatial Filter option is ‘turned on’ as Boundary Boxes OGC-Intersect to read only those records within the Area of Interest. The problem is still takes ages to read,I have got a few FeatureReaders within the workflow and I was thinking to use only one FeatureReader (as all the data comes form the same GDB) to improve the performance, Any ideas to improve the performance of the workflow?

10811

8 months ago

siguseider56Contributor

asked in Transformers

SQLExecutor Not Inserting All Rows

I have a SQLExecutor that inserts data child records for contract IDs. It does fine if it’s a one-to-one but if it’s one contract ID with many children, it only inserts one. Nowhere in my workbench does it group by the contract ID though. If there are 2 contracts and each has 2 children, there are 4 individual rows of data to insert. I managed to resolve the issue by adding a select statement after the insert to produce a result. I don’t understand why it’s behaving this way though. Note that I’m using a SQL Executor instead of a writer because of the need to set the audit user for each insert. Below is the sql statement I’m using. Why does the select statement at the end make it work? FME_SQL_DELIMITER |EXEC sp_set_session_context 'AuditUser', 'SNOW Sync' |INSERT INTO CONTRACT_ASSOCIATE (CONTRACT_ASSOCIATE_ID, BA_ID, CONTRACT_ID, CONTRACT_ROLE_ID)SELECT @Value(CA_ID), '@Value(BA_ID)', @Value(CONTRACT_ID), @Value(CA_ROLE)WHERE NOT EXISTS (SELECT 1 FROM CONTRACT_ASSOCIATE WHERE CONTRAC

160

8 months ago

dallas2011Contributor

asked in Transformers

Calculation of IRI by integration for a colliding surface

How to calculate the IRI between two points in FME if we know the distance and the slope?Thank you.

423

8 months ago

ottadini

asked in Transformers

Is there a way to use a python virtual environment?

In FME 2018, I want to use a custom python interpreter, and a specific python virtual environment (conda environments).How can I do this?

1849

8 months ago

lsugumarContributor

asked in Transformers

Convert Excel to pdf

Hi! I am trying to convert an excel spread sheet (no spatial data involved, just plain data) into a pdf file with pagination based on a field in the spread sheet. Can somebody help me through the steps of this conversion? I have seen posts about using table adder, text adder, pdf styler, pdf page formatter etc. but I am trying to understand the high-level steps to start developing this process.I was hoping SAFE would have some webinar or tutorial on simple excel to pdf conversion, all I can find is extracting data from pdf and converting to excel.Any help is much appreciated.Thank you,LSugumar.

1281

8 months ago

filipovitzContributor

asked in Transformers

Custom HTML automatic value addition

351

8 months ago

filipovitzContributor

asked in Transformers

List of special characters in Text Editor

Hi, I'm looking for a list of special characters used in a text editor. Is there a description of their function? Are there any others available that are not listed in the window? For example, I use the MSWordStyler transformerThanksFilip

1995

8 months ago

asabhinavgreats

asked in Transformers

Scheduling workbench on local system

Is there a possibility to schedule the workbench on our local system rather than putting it on the server due to data confidentiality issues?

1796

8 months ago

alejacdContributor

asked in Transformers

Count if event occurred consecutively

Hello,I have some data which shows if an event occured per month. Events 202301 202302 202303 202304 202305 202306 a 1 1 0 0 1 1 b 1 1 1 1 0 0 c 0 0 0 1 1 1 d 1 0 1 0 1 0 I want to count the events which occurred 3 or more times consecutively. So I want to get thisEvents More than 3 consecutive events? count b yes 4 c yes 3 Not sure how I should do this in FME. Can someone help me?Thank you!

531

8 months ago

mgg_becaContributor

asked in Transformers

Filter Point Cloud above/below a TIN surface

Hi there, If I have been given a TIN and a point cloud, how can I find out which points are above the surface and which are below, without rasterizing the surface to retain maximum surface fidelity.Thanks,Marc

603

8 months ago

787dContributor

asked in Transformers

Vertical coordinate system

Hello,I am trying to transform a point cloud with ellipsoidal heights into orthomethic heights (DHHN2016) using the CsmapReprojector. The settings can be seen in the image. For the Geoid Height Grid I need a file in .gdc format. My target system is DHHN2016, for which I have the quasigeoid in various file formats (e.g. JPG, TIFF, GEM, TXT, GSF, GFF, GGF) but not in .gdc. Is there a website from which I can download the appropriate format or another way?Thank you very much.Translated with DeepL.com (free version)

291

8 months ago

tiki13457

asked in Transformers

Am using DateTimeConverter to change date YYYYMMDD into YYYY-MM-DD (CSV File), it is converting it when check on Visual Preview. But when open in excel, does not show it. Seeing FME_Rejection_Code = Invalid Input

677

8 months ago

eridoParticipant

asked in Transformers

In my workflows I have the problem with the elements "CompoundCurve" and "Curvepolygon" when writing to a postgresql / postgis database with default schemas for osm_point, osm_line and osm_polygon.

Geometry type "CompoundCurve"Because of the given schemas the postgis writer has problems with the geometry "CompoundCurve". I want to convert this in the process into a normal line element, which can be read in the osm_line table with the geometry "linestring". Today my process in the Workbench crashes with an element with the geometry "CompoundCurve". Geometry type "Curvepolygon"The second problem is the geometry type "Curvepolygon". This is written correctly into the postgis table osm_polygon. But then I have to delete these objects manually in pg_admin, so that the generated data can be read by the application software. Is there a possibility in FME to convert the elements with the geometry type "Curvepolygon" into a normal polygon? With best thanks for your support! Erido

3323

8 months ago

aronContributor

asked in Transformers

Cant find pdf-reader in FME Form 2024?

The PDF-reader seems to have disappeared from FME Form 2024 for Mac (silicon). It worked fine in the 2023 version. I took a look at the writer, and there is no dot under Read there either. Has this reader been removed for some reason? Or is this a bugg?

10412

8 months ago

cosminciotinaContributor

asked in Transformers

Manual join for unmatched data.

Hi there,I have a small project where I've performed a join between two tables (Table1 and Table2) using the CityName field as a common identifier.However, I've noticed some minor inconsistencies in the city names between the two tables, resulting in 10 unjoined features.Is there a transformer or method available to manually specify that the X row from Table1 should be joined with the Y row from Table2?Regards

341

8 months ago

juanmahereSupporter

asked in Transformers

HttpCaller - DELETE in batch mode

Hi all,I’m using: FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)I do want to know if there is the possibility to use the HttpCaller to launch chunk of requests. My DELETE request: https://xyz.api.here.com/hub/spaces/@Value(space)/features/@Value(xyz_id)each request sends to that Hub the action to delete each Feature by its ID (xyz_id).I need to delete around 4M records, and running the workbench feature by feature, takes days.Is that possible to get it faster? Thanks for you help,Juanma

384

8 months ago

apbContributor

asked in Transformers

Find all line segments from a network between end segment and the 3rd closest point along the line

I need to pick all segments of a line (they are separate features) that go between the end of the line (the last segment, in blue below) and a point that is along the line, but which I need to define with the rule of being the 3rd closest to the end of the line. I tried to illustrate in the figure below. I managed to find the end of the line (the last segment in blue). Between the blue segment and the points A (red) and B (dark blue) there are 6 segments (separation between them are marked in black). How can I find point A and B and have the IDs of the 6 segments between the last one and the point B? Hope this is clear enough and thanks in advance.

471

8 months ago

joySupporter

asked in Transformers

A question in regards to reading in dgn files. How can one make distinction between Drawing,Design and Sheet models?

I got this question from a colleague. I know after reading in a dgn file you can aggregate features together based on igds_model_name, but I was wondering if there is a way to make a distinction/aggregation based on the type of model (drawing, desgin, Sheet). Within Microstation you have to attribute msdModelType which can contain the following values that correspond to Sheet, Design, Drawing:1) msdModelTypeSheet for Sheets2) msdModelTypeDefault3) msdModelTypeModel I was wondering whether there is an equivalent for that attribute within FME desktop or whether there is another way one can make distinction between those three type of models (Sheet, Drawing, Design).

409

8 months ago

ileung_cnwContributor

asked in Transformers

AGOL Feature Service Reading Issue

I've encountered a problem since upgrading to FME Workbench 2024.0. Previously, I could select Feature Services using Esri ArcGIS Online (AGOL) or FeatureReader without any issues. However, now I'm getting an error resembling the following:"Could not find a Feature Service item matching the Feature Service directive 'Parks and Recreation - Tree Inventory/Tree Taxonomy List(<item ID>)'."Interestingly, removing the quotations and <item ID> in the Constraints parameter allows successful reading. Is this the expected behavior? Do I now need to manually adjust parameters for reading every feature service?Any feedback or advice would be greatly appreciated. Thank you in advance!

1331

8 months ago

geminiContributor

asked in Transformers

Appending a single value to multiple records

I have a simple Excel spreadsheet which keeps track of modification dates in the format (YYYYMMDDHHMMSS). I use the InlineQuerier to get the maximum date from the column called Last_Update. I have confirmed, by outputting this value to a text file, that it is pulling the correct date from the Excel column. Now I wish to append this date as a new field on all records of another table coming from Oracle. Each record from Oracle should have the same new field called Last_Export and the same date coming from the Excel spreadsheet. FeatureMerger does not work as I don't have a common attribute between the two tables.

11111

8 months ago

fbrwsBANNED

asked in Transformers

DO WHILE LOOP

I want to update a table from a HTTP request for x times depending on the last update and the current date. What would be the best practice? So I have to fill in the green part in this workflow.

1022

8 months ago

787dContributor

asked in Transformers

EsriReprojector Vertical Transformation

Hello,I am trying to transform a point cloud with ellipsoidal heights (WGS84) to DHHN2016 heights using EsriReprojector. However, only "None" can be selected for "Vertical Transformation". (see picture)Why is this the case and what can I do to make the transformation work?Thank you very much

351

8 months ago

robertgilleyContributor

asked in Transformers

Capture a string using @SubstringRegularExpression

I am trying to return values for multiple fields (codes), parsing data from one incoming field (NAICS_CODE), using a AttributeManager transformer and SubstringRegularExpression.The field containing the incoming data is called NAICS_CODE and can contain data for up to 30 separate codes. For example, in one record the field NAICS_CODE has 10 separate codes. Using an online regex editor, I have the following code, where the index for each parsed field would be 0-9.^\s*(?:\S+\s+){0}(\S+) THROUGH ^\s*(?:\S+\s+){9}(\S+)And when I test this code against the following data with the online REGEX editor:236210-DBE/MBE/SBE 236220-DBE/MBE/SBE 238210-DBE/MBE/SBE 238990-DBE/MBE/SBE 335311-DBE/MBE/SBE 335312-DBE/MBE/SBE 335313-DBE/MBE/SBE 335314-DBE/MBE/SBE 335999-DBE/MBE/SBE 423610-DBE/MBE/SBEThe results seem to be what I am looking for, returning the correct code from the field for each indexed value.^\s*(?:\S+\s+){0}(\S+) returns 236210-DBE/MBE/SBETHROUGH^\s*(?:\S+\s+){9}(\S+) retur

1652

8 months ago

aronContributor

asked in Transformers

How to Georeference a PDF?

Using two files: a PDF with no geodata, and a georeferenced polygon. They cover the exact same area (bounding box of PDF = polygon). The polygon and the PDF were originally created in the same coordinate system. There should be no need for "warping". Its just only the georeferenced coordinates in the PDF that are missing. Q: How do I georeference the PDF using the polygon?

437

8 months ago

_jacques_Supporter

asked in Transformers

Obtain path to database connection file using pythoncaller

Hi, I’m working on a script which copies data from an Esri arcsde geodatabase to a postgis database. I need to know if the table in the arcsde geodatabase is versioned before I run the rest of the script, and I have a pythoncaller which runs something like this (simplified here):layername = "schema.layerName"connectionFile = "path_to_connection_file"arcpy.env.workspace = connectionFiledesc = arcpy.Describe(layername)isVer = desc.isversionedfeature.setAttribute("versioned",isVer) self.pyoutput(feature)Now, I don’t want to type in the path to the connection file manually, but rather obtain it by some function which can collect the data from the list of database connections I entered in the settings. Is this possible? I’ve looked into the FME Web Services API reference for such a function without any luck. Best regards,Jacques 👷🏼

961

8 months ago

Page 25 / 509

Badge winners

scarterhas earned the badge Teacher (Silver)
reyhas earned the badge Welcome Back
alc33has earned the badge Welcome Back
rishavsharmahas earned the badge FME Form Basic Training
emiliodepalmahas earned the badge Student (Grey)

Show all badges

30,353: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.