- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,683 Posts
50,744 Replies

When you subscribe we will email you when there is a new topic in this category

12683 Posts

Recently active

Most replies Most views Newest first

monicarmContributor

asked in Transformers

I get an error "Invalid Layer: Raster layer Provider is not valid" when trying to open a raster I have imported to Postgis using FME 2020.

I am getting an invalid layer message when trying to open a raster in QGIS. This raster I have imported into Postgis using FME. I was using column=rast . I have set the coordinate system as the reader, but when importing the SRID is not being written. Invalid Layer: Raster layer Provider is not valid (provider: postgresraster, URI: PG: dbname='xxxxx' host=xxxxx port=5432 user='myuser' password='mypassword' sslmode=disable mode=2 schema='myschema' column='rast' table='GEOTIFF' Any tips, how to fix this?

632

3 years ago

mostafa1811

asked in Transformers

AnchoredSnapper

Hello everyone, I need your help with AnchoredSnapper, basically I have two vector layers: - linear layer which is in the form of a road network. - point layer (Camera positions). I would like to attach these camera points to the road network, what I have problems with is the areas where we have road intersections, I don't know how to configure it so that it snaps the points to the right segments, if you go to the image link, i tried to show you that the last point is attached to the correct segment, but in reality it is going to be snapped on the other segment which is closer to it. So if you have any answers, I'm interested, and thank you link image: https://zupimages.net/viewer.php?id=21/25/2nrm.png

246

3 years ago

ssisman06

asked in Transformers

About the Raster Expression Evaluator

Hı,I want to extract certain color codes from the photograph. I tried but I couldn't. I want to get the white areas in the sample image . how can I do it. Thank you

3 years ago

melvanenter

asked in Transformers

Fatal error when running Intro to Desktop exercise 1.1?

Hi, I am new to FME and have just started doing the intro to desktop training material. I am doing Exercise 1.1 where it asks me to run the process but I keep getting this message KML: Cannot open dataset `C:\\FMEData2019\\Data\\Boundaries\\LocalAreas.kml'KML: Error initializing reader and I don't know how to fix it? Can anyone please help? I would appreciate it .

3 years ago

virtualcitymattEvangelist

asked in Transformers

Online coordinate system generator doe not seem to be working

The online custom coordinate system generator does not appear to be working anymore. @daveatsafe - any ideas?

3 years ago

mostafa1811

asked in Transformers

Distance from start of segment

Hello everyone, this is my first time writing in the Forum, by the way I am coming to you for a little problem on FME. To get you up to speed, I have two layers:- Road network: consists of several numbered segments.- Point layer that represents the camera location. After the application of Anchored snapper in order to attach the camera positions on my road network, my goal is to assign to each entity of the attached point layer, the distance from the origin of the segment on which is attached of the road network, please find attached an image by which I have tried to present my problem, thank you in advance for your help. Link Image: https://www.zupimages.net/viewer.php?id=21/25/1sxs.png

112

3 years ago

mark_f

asked in Transformers

Excel Reading Empty Worksheet Returns One Feature

Hi I’m finding when reading an Excel Worksheet containing only headers in Row 1 and no other data that I have one feature read with <missing> values for all columns.Surely if there are no rows there should be no features read?Process:New Excel Workbook containing one Worksheet and create the header in row 1 as follows:In cell A1 enter MyCol1 and use the right arrow to store that value in the cell and move to cell B1.Enter in cell B1 MyCol2 and use the left arrow to return to cell A1.This ensures that no other cells have been interacted with.Read this Workbook with an Excel reader and it returns one feature with missing values for MyCol1 and MyCol2.If you actually have data in row 2 you also get one feature read correctly.Thanks

112

3 years ago

rkay

asked in Transformers

Why don't GDA2020 tranformations work in SQLCreator?

Hi all,I'm trying to read from a Postgresql DB (postgis) applying a spatial filter using the SQLCreator transformer.Here's the sql statement set in the transformer:SELECT capture_start, capture_end, metadata_url, status, project, geom FROM "public"."Metadata_Index" WHERE ST_Intersects(ST_Transform(ST_GeometryFromText('POINT(142.94 -37.28)',4326),7844), geom) This is the error I'm getting - it's logged as a warning but definitely what is failing the process:2021-06-23 13:07:41| 1.7| 0.0|WARN |Error executing SQL command ('declare "public_custom_query_crsr" cursor for SELECT capture_start, capture_end, metadata_url, status, project, geom FROM "public"."Metadata_Index" WHERE ST_Intersects(ST_Transform(ST_GeometryFromText('POINT(142.94 -37.28)',4283),7844), geom)'): 'ERROR: GetProj4StringSPI: Cannot find SRID (7844) in spatial_ref_sys'I've read through the docs available on the Safe websit

150

3 years ago

heya

asked in Transformers

How to read the specific sheet from Excel Reader

Hi there, I want to know if there is any method to read specific sheet only by using Excel Reader, e.g. I have multiple Readers in the same workspace to input various datasets, one is EXCEL, the other is IFC. If I want to read the sheet whose name is the same as my IFC Reader's source data name. Any method to achieve this? I guess fme_basename helps, but not sure how to achieve this. Thanks in advance.

632

3 years ago

philipwhittenContributor

asked in Transformers

Shutdown Python Script not executing for a Failed Translation

The article on shutdown scripts states A shutdown script runs after all of the transformers, readers, writers, and the log file are closed in a successful translation. In the case of a failed translation, the script will still execute but may fail as only fme.status and fme.failureMessage are guaranteed to contain valid values.I have a FME Workspace that has a "Translation FAILED" message. The last three lines of the Translation Log are:Program TerminatingTranslation FAILED.Warning: not all FMESessions that were created were destroyed before shutdown. This may cause instabilityTesting that I have done indicate that the FME Python Shutdown Script is not being executed. I assume this is because some FMESessions are still open. As part of testing I have removed the import or use of any FME related python library from my Python Shutdown Script, and, have tested this script on other workspaces. Is there anyway to force the FME Python Shutdown Script to run when the Translation has Fai

142

3 years ago

redlands_gis

asked in Transformers

Child Record Attributes Appended to end of Parent Records

I have two tables that form a child parent relationship. The parent record has a primary key and some field data, and the child record has a foreign key and some field data. I am trying to append each child record's field data onto the end of each parent record. There can be anywhere between 1 and 99 child records for every parent record, and the field names from the child record should be repeating. I have attached some sample data to show what I am trying to achieve. The spreadsheet contains a parent table, a child table, and a final table showing the desired final format. Parent: Child: Final: It basically look something like this: Parent Table:Parent-Field 1 (Key) | Parent-Field 2 Child Table:Child-Field 1 (F-Key) | Child-Field 2 | Child-Field 3 Final Table:Parent-Field 1 (Key) | Parent-Field 2 | Child-Field 2 {0} | Child-Field 3 {0} | Child-Field 2 {n} | Child-Field 3 {n} I have tried using aggregators, feature joiners, database joiners, aggregators, list builders, and splitt

376

3 years ago

jan-henkContributor

asked in Transformers

I Get an error in my workflow: expression: edgecurves_[edge].has_value() error

I can nowhere find information for this error?Does someone know how I can fix this?--Stored 82 feature(s) to FME feature store file `C:\\Users\\CENTRA~1\\AppData\\Local\\Temp\\wb-cache-03_Buffers_Bouwen-xPalBe\\Main_LineCombiner -1 152 fo 0 LINE 0 932eff0b162b454a4c8fc28137d419000e8ade26.ffsupdating'Saving spatial index into file 'C:\\Users\\CENTRA~1\\AppData\\Local\\Temp\\wb-cache-03_Buffers_Bouwen-xPalBe\\Main_LineCombiner -1 152 fo 0 LINE 0 932eff0b162b454a4c8fc28137d419000e8ade26.fsi'Finished saving spatial index into file 'C:\\Users\\CENTRA~1\\AppData\\Local\\Temp\\wb-cache-03_Buffers_Bouwen-xPalBe\\Main_LineCombiner -1 152 fo 0 LINE 0 932eff0b162b454a4c8fc28137d419000e8ade26.fsi'Expression: edgeCurves_[edge].has_value()FME Session Duration: 2 minutes 17.7 seconds. (CPU: 114.9s user, 19.7s system)END - ProcessID: 8116, peak process memory usage: 299160 kB, current process memory usage: 105972 kBExpression: edgeCurves_[edge].has_value()Program TerminatingTransla

7328

3 years ago

xstophe

asked in Transformers

My request is to transform the x,y coordinates which are in CC49 of the attached file into UTM 31 N (epsg 32631) The attached project does not change the coordinates and duplicates 3 times the data for each phase. Could you help me ? Thank you

3 years ago

frank_herbert

asked in Transformers

Calculate the highest points on a DEM in a number of areas and create point feature

I have a DEM raster and also a vector layer containing 20+ polygons. I would like to calculate the highest points within each polygon and then create a point feature for each high point, but I'm not sure how to enable the workbench to cycle through all of the areas. There's a similar post explaining a workflow to calculate the highest points in a single area, but I would like to apply this to several different areas. Here's a link to the original post for reference: https://community.safe.com/s/question/0D54Q000080hQhISAU/find-position-and-value-of-highest-elevation-on-a-dem-raster

711

3 years ago

georam

asked in Transformers

Rendering problems with MVT Tileset Writer and complex data

We get multiple problems when rendering complex data with the MVT Tileset writer: Small polygons vanish on different zoom levelsLines are on some zoomlevels so simplified, they look like a subway plan (see screenshot)Some content does not get rendered at all on some tiles, but is visible on neighbouring tiles at the same zoomlevel (see screenshot) The data we render consists of 5 input layers. Polygons and points are mixed in the tileset, but homogenous for each layer. The input polyogons are very complex (lots of vertices per polygon). We produce a single tileset with the input data. MVT Tileset writer parameters are default. We als tried with simplification parameter "2" with the same results. It is not really clear what number to use with the simplification parameter, the documentation is not clear. Maybe someone can provide samples how to calculate the number to fill in? FME version is 2021.0.3 b21326. Viewer is QGIS 3.18.3. Viewing with maputnik shows the same results.

111

3 years ago

ganeshsomesula

asked in Transformers

Not able to export Join via relationship table(eg:eo_cable_exi_phase) while exporting Cable Segment to ESRI FGDB

Hi Support, I am trying to export the Smallworld Electric Office 5.x data into ESRI File Geodatabase(FGdb). I wanted to export the Cable Segment, Cable & Cable Existing Phase records with the same join relationships to ESRI, while doing that I am not able to choose the Cable Existing Phase table(eo_cable_exi_phase) even though I have selected 'Expose Internal tables' option(please refer attached screenshot). How can I export the Cable Existing Phase table data from Smallworld. I have verified in the Community articles and couldn't find any. Can you please help.

3 years ago

geoquizzer82193

asked in Transformers

Converting data from features/rows to attributes/columns to create comma-delimited CSV files.

Hello, this is a pretty basic question, but I have been wracking my brain as to how to do it. When I read data from an XML file, it treats each value in my data as a new feature/row. This means that when I convert the features into CSV format, I get one value per line, as opposed to a long string of values delimited by commas. (see the two pictures to get a sense of what I mean). Is there an easy way to fix this? The basic solution in something like excel would be to transpose the data, but there doesn't seem to be a simple functionality for that. (Additionally, if anyone after looking at my workspace has a better way to get my 'msec' values to be first in the csv, I'm all ears!) Any help would be appreciated!

732

3 years ago

huguesContributor

asked in Transformers

Writer for bulkattribute renamer

Hi everyone. I have a easy question but i can't be able to ressolve. I have a bulkattributerenamer. The reader is a Directory and path filename. The folder containt PDF (no spatial). The name of all the PDF begin with __, like __PZ440.pdf. I want to remove the __ for keep the PZ440.pdf But i have some trouble with the writer. I can't find the right writer. I know is a beginner question so thank you for help

3 years ago

plynnParticipant

asked in Transformers

Transformation or Python Script?

I have two things that I am trying to accomplish with the current feature/attributes that I have joined. For each row of data, I need to write out 5 new rows. Also, in the new rows, some of the column values are the column names of the input feature. Here is an example: (Attribute Name: Attribute Value)input: ASSETNUM: 12345, VLVCOND:Good, TRNSOPEN:10, OPENDRTN: Clockwise, STRUCTUR:No, SURCOVER: Blue, INSPECTOR:Joe SmithOutput: ASSETNUM:12345, METERNAME:VLVCOND, OBSERVATION:Good, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:TRNSOPEN, OBSERVATION:10, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:OPENDRTN,OBSERVATION:Clockwise, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:STRUCTUR, OBSERVATION:No, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:SURCOVER, OBSERVATION:Blue, INSPECTOR:Joe Smith Any help would be greatly appreciated.Thanks.

3 years ago

nielsgerrits

asked in Transformers

Module 'AUTOCAD_OD' is unavailable for use with this FME edition

I have a 2016.1.1 workspace, reading from gdb, writing to dwg (Autodesk AutoCAD Map 3D Object Data).When I run it on Desktop, I get the following errors.2019-07-03 12:13:55| 5.9| 0.0|WARN |Library 'D:\apps\fme_2016_1_1_64\plugins/realdwg/REALDWG.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this library2019-07-03 12:13:55| 5.9| 0.0|ERROR |Module 'AUTOCAD_OD' is unavailable for use with this FME edition2019-07-03 12:13:55| 5.9| 0.0|ERROR |Module 'AUTOCAD_OD' is unavailable for use with this FME edition2019-07-03 12:13:55| 5.9| 0.0|ERROR |FeatureWriter_3(WriterFactory): Module 'AUTOCAD_OD' is unavailable for use with this FME edition2019-07-03 12:13:55| 5.9| 0.0|ERROR |Module 'AUTOCAD_OD' is unavailable for use with this FME editionWhen I run it on Server, I get the same errors for some datasets, but not all.I synced back the production data to my local machine, run the workbench with the same dataset as it works on server, and st

1588

3 years ago

fmesafe.podporaContributor

asked in Transformers

Filtering based on attribute values

Hello. I have a question. Is there a transformer that can filter based on attribute values? Something like SpatialFilter, but without spatial data. I have two datasets in the workspace and I need to compare one column in each dataset against each other and get only those rows in the output where the value will be the same. I tried to look for some more filters, but I didn't find anything functional. Thank you, very much

3073

3 years ago

holyg

asked in Transformers

How to do Point in polygon Spatial query filtering on maximum attribute

I have point table and polygon table in PostgreSQL / PostGIS The polygon table is a series of concentric polygons getting ever smaller / nearest the point See PictureEach point could be in 1 or many polygonsWithin this table is a level column How do I perform a spatial query returning the join between the polygon contains the point where MAX(level) ? The result I’m expecting is 1 polygon per point (A polygon can contain 1 or more points)

372

3 years ago

liaotaofan

asked in Transformers

how to deal with spatial analysis or topology in pythoncaller ?Please

why i can not use the FMESpatialIndex in pythoncaller? it will report the desktop can not support some function

3 years ago

magdakosior

asked in Transformers

Is it possible to use something like RasterMosaicker on not-georeferenced tiff files? Say that you have many screenshots of strava heatmaps that look like the attached image. Is it possible to mosaic these and then add coordinate info after?

It is possible to ground truth one or a few prior or possibly mosaic them together and then to add georeferencing after.

3 years ago

pbyhistorianContributor

asked in Transformers

Writer trying to update a non-null Postgres field with a null value

The Writer is generating SQL for an Attribute that doesn't exist in the Feature, during an Update operation on a Postgres table. Here is the error message:Error executing SQL command ('update "schema_name"."table_name" set "date_created" = NULL,"date_updated" = E'2021-05-18T07:47:58.73945-07:00',"distance" = E'1.00' WHERE "unique_id" = E'51''): 'ERROR: null value in column "date_created" violates not-null constraint During an Update operation, date_created should not be changed. Although the data flow is read from the same table it's being written to, an AttributeManager specifically removes date_created from the Features on the ChangeDetector's Updated port. unique_id=51 is the very first Feature being fed to the Writer. Like every other Feature from the Updated port, its fme_db_operation Attribute is "UPDATE". The Feature Operation field of the Writer is con

492

3 years ago

Page 155 / 508

Badge winners

ali.hojjathas earned the badge Welcome Back
hamadshammakh97has earned the badge English Speaker
hamadshammakh97has earned the badge Arabic Speaker
mishgun1476has earned the badge Welcome Back
samvernonhas earned the badge Student (Grey)

Show all badges

30,177: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.