Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,711 Replies
10000 Posts
mdk
Contributor
mdkContributor
asked in Transformers
I have an attribute that I want to split into component parts. What transformer will accommodate wild cards etc. or varying delimiters into its logic?

"4;30;4;20;SW,SE",,, Here is my attribute string, I want everything between the quotes to be split at the ; and the rest to be split at the commas. (There are no values held there in this example.) Please help. m

190
geomancer
Evangelist
T
tsirkuselab
asked in Transformers
Geometry from SQL executor

Hello,I often use SQL creator and SQL executor to extract data of my dB.My select-queries always include the oracle geometry (stored in a SHAPE column).However, I noticed only in some cases the geometry is extracted in my workflow.I have, to this day, not been able to understand in which cases this works and in which it doesn't (I then add a feature merger to re-append the geometry to the features).Can someone explain this to me?Thank you

4224
M
monicarm
Contributor
monicarmContributor
asked in Transformers
I get an error "Invalid Layer: Raster layer Provider is not valid" when trying to open a raster I have imported to Postgis using FME 2020.

I am getting an invalid layer message when trying to open a raster in QGIS. This raster I have imported into Postgis using FME. I was using column=rast . I have set the coordinate system as the reader, but when importing the SRID is not being written.  Invalid Layer: Raster layer Provider is not valid (provider: postgresraster, URI: PG: dbname='xxxxx' host=xxxxx port=5432 user='myuser' password='mypassword' sslmode=disable mode=2 schema='myschema' column='rast' table='GEOTIFF' Any tips, how to fix this?

1010
monicarm
Contributor
M
mostafa1811
asked in Transformers
AnchoredSnapper

Hello everyone, I need your help with AnchoredSnapper, basically I have two vector layers:  - linear layer which is in the form of a road network. - point layer (Camera positions).  I would like to attach these camera points to the road network, what I have problems with is the areas where we have road intersections, I don't know how to configure it so that it snaps the points to the right segments, if you go to the image link, i tried to show you that the last point is attached to the correct segment, but in reality it is going to be snapped on the other segment which is closer to it. So if you have any answers, I'm interested, and thank you link image: https://zupimages.net/viewer.php?id=21/25/2nrm.png

440
M
S
ssisman06
asked in Transformers
About the Raster Expression Evaluator

Hı,I want to extract certain color codes from the photograph. I tried but I couldn't. I want to get the white areas in the sample image . how can I do it. Thank you

90
virtualcitymatt
Celebrity
M
melvanenter
asked in Transformers
Fatal error when running Intro to Desktop exercise 1.1?

Hi, I am new to FME and have just started doing the intro to desktop training material. I am doing Exercise 1.1 where it asks me to run the process but I keep getting this message KML: Cannot open dataset `C:\\FMEData2019\\Data\\Boundaries\\LocalAreas.kml'KML: Error initializing reader and I don't know how to fix it? Can anyone please help? I would appreciate it .

60
redgeographics
Celebrity
virtualcitymatt
Celebrity
virtualcitymattCelebrity
asked in Transformers
Online coordinate system generator doe not seem to be working

The online custom coordinate system generator does not appear to be working anymore.  @daveatsafe​  - any ideas?

90
virtualcitymatt
Celebrity
M
mostafa1811
asked in Transformers
Distance from start of segment

Hello everyone, this is my first time writing in the Forum, by the way I am coming to you for a little problem on FME. To get you up to speed, I have two layers:- Road network: consists of several numbered segments.- Point layer that represents the camera location. After the application of Anchored snapper in order to attach the camera positions on my road network, my goal is to assign to each entity of the attached point layer, the distance from the origin of the segment on which is attached of the road network, please find attached an image by which I have tried to present my problem, thank you in advance for your help. Link Image: https://www.zupimages.net/viewer.php?id=21/25/1sxs.png

170
M
M
mark_f
asked in Transformers
Excel Reading Empty Worksheet Returns One Feature

Hi I’m finding when reading an Excel Worksheet containing only headers in Row 1 and no other data that I have one feature read with <missing> values for all columns.Surely if there are no rows there should be no features read?Process:New Excel Workbook containing one Worksheet and create the header in row 1 as follows:In cell A1 enter MyCol1 and use the right arrow to store that value in the cell and move to cell B1.Enter in cell B1 MyCol2 and use the left arrow to return to cell A1.This ensures that no other cells have been interacted with.Read this Workbook with an Excel reader and it returns one feature with missing values for MyCol1 and MyCol2.If you actually have data in row 2 you also get one feature read correctly.Thanks

160
M
R
rkay
asked in Transformers
Why don't GDA2020 tranformations work in SQLCreator?

Hi all,I'm trying to read from a Postgresql DB (postgis) applying a spatial filter using the SQLCreator transformer.Here's the sql statement set in the transformer:SELECT capture_start, capture_end, metadata_url, status, project, geom FROM "public"."Metadata_Index" WHERE ST_Intersects(ST_Transform(ST_GeometryFromText('POINT(142.94 -37.28)',4326),7844), geom) This is the error I'm getting - it's logged as a warning but definitely what is failing the process:2021-06-23 13:07:41| 1.7| 0.0|WARN |Error executing SQL command ('declare "public_custom_query_crsr" cursor for SELECT capture_start, capture_end, metadata_url, status, project, geom FROM "public"."Metadata_Index" WHERE ST_Intersects(ST_Transform(ST_GeometryFromText('POINT(142.94 -37.28)',4283),7844), geom)'): 'ERROR: GetProj4StringSPI: Cannot find SRID (7844) in spatial_ref_sys'I've read through the docs available on the Safe websit

330
R
H
heya
asked in Transformers
How to read the specific sheet from Excel Reader

Hi there, I want to know if there is any method to read specific sheet only by using Excel Reader, e.g. I have multiple Readers in the same workspace to input various datasets, one is EXCEL, the other is IFC. If I want to read the sheet whose name is the same as my IFC Reader's source data name. Any method to achieve this? I guess fme_basename helps, but not sure how to achieve this. Thanks in advance.

1550
H
philipwhitten
Supporter
philipwhittenSupporter
asked in Transformers
Shutdown Python Script not executing for a Failed Translation

The article on shutdown scripts states A shutdown script runs after all of the transformers, readers, writers, and the log file are closed in a successful translation. In the case of a failed translation, the script will still execute but may fail as only fme.status and fme.failureMessage are guaranteed to contain valid values.I have a FME Workspace that has a "Translation FAILED" message.  The last three lines of the Translation Log are:Program TerminatingTranslation FAILED.Warning: not all FMESessions that were created were destroyed before shutdown.  This may cause instabilityTesting that I have done indicate that the FME Python Shutdown Script is not being executed.  I assume this is because some FMESessions are still open.  As part of testing I have removed the import or use of any FME related python library from my Python Shutdown Script, and, have tested this script on other workspaces.   Is there anyway to force the FME Python Shutdown Script to run when the Translation has Fai

280
philipwhitten
Supporter
R
redlands_gis
asked in Transformers
Child Record Attributes Appended to end of Parent Records

I have two tables that form a child parent relationship. The parent record has a primary key and some field data, and the child record has a foreign key and some field data. I am trying to append each child record's field data onto the end of each parent record. There can be anywhere between 1 and 99 child records for every parent record, and the field names from the child record should be repeating. I have attached some sample data to show what I am trying to achieve. The spreadsheet contains a parent table, a child table, and a final table showing the desired final format. Parent: Child: Final: It basically look something like this: Parent Table:Parent-Field 1 (Key) | Parent-Field 2 Child Table:Child-Field 1 (F-Key) | Child-Field 2 | Child-Field 3 Final Table:Parent-Field 1 (Key) | Parent-Field 2 | Child-Field 2 {0} | Child-Field 3 {0} | Child-Field 2 {n} | Child-Field 3 {n}  I have tried using aggregators, feature joiners, database joiners, aggregators, list builders, and splitt

520
R
jan-henk
Contributor
jan-henkContributor
asked in Transformers
I Get an error in my workflow: expression: edgecurves_[edge].has_value() error

I can nowhere find information for this error?Does someone know how I can fix this?--Stored 82 feature(s) to FME feature store file `C:\\Users\\CENTRA~1\\AppData\\Local\\Temp\\wb-cache-03_Buffers_Bouwen-xPalBe\\Main_LineCombiner -1 152 fo 0 LINE 0 932eff0b162b454a4c8fc28137d419000e8ade26.ffsupdating'Saving spatial index into file 'C:\\Users\\CENTRA~1\\AppData\\Local\\Temp\\wb-cache-03_Buffers_Bouwen-xPalBe\\Main_LineCombiner -1 152 fo 0 LINE 0 932eff0b162b454a4c8fc28137d419000e8ade26.fsi'Finished saving spatial index into file 'C:\\Users\\CENTRA~1\\AppData\\Local\\Temp\\wb-cache-03_Buffers_Bouwen-xPalBe\\Main_LineCombiner -1 152 fo 0 LINE 0 932eff0b162b454a4c8fc28137d419000e8ade26.fsi'Expression: edgeCurves_[edge].has_value()FME Session Duration: 2 minutes 17.7 seconds. (CPU: 114.9s user, 19.7s system)END - ProcessID: 8116, peak process memory usage: 299160 kB, current process memory usage: 105972 kBExpression: edgeCurves_[edge].has_value()Program TerminatingTransla

1040
hansb
Contributor
X
xstophe
asked in Transformers
My request is to transform the x,y coordinates which are in CC49 of the attached file into UTM 31 N (epsg 32631) The attached project does not change the coordinates and duplicates 3 times the data for each phase. Could you help me ? Thank you

My request is to transform the x,y coordinates which are in CC49 of the attached file into UTM 31 N (epsg 32631) The attached project does not change the coordinates and duplicates 3 times the data for each phase. Could you help me ? Thank you

50
X
F
frank_herbert
asked in Transformers
Calculate the highest points on a DEM in a number of areas and create point feature

I have a DEM raster and also a vector layer containing 20+ polygons. I would like to calculate the highest points within each polygon and then create a point feature for each high point, but I'm not sure how to enable the workbench to cycle through all of the areas.  There's a similar post explaining a workflow to calculate the highest points in a single area, but I would like to apply this to several different areas. Here's a link to the original post for reference: https://community.safe.com/s/question/0D54Q000080hQhISAU/find-position-and-value-of-highest-elevation-on-a-dem-raster

1430
redgeographics
Celebrity
G
georam
asked in Transformers
Rendering problems with MVT Tileset Writer and complex data

We get multiple problems when rendering complex data with the MVT Tileset writer: Small polygons vanish on different zoom levelsLines are on some zoomlevels so simplified, they look like a subway plan (see screenshot)Some content does not get rendered at all on some tiles, but is visible on neighbouring tiles at the same zoomlevel (see screenshot) The data we render consists of 5 input layers. Polygons and points are mixed in the tileset, but homogenous for each layer. The input polyogons are very complex (lots of vertices per polygon). We produce a single tileset with the input data.  MVT Tileset writer parameters are default.  We als tried with simplification parameter "2" with the same results. It is not really clear what number to use with the simplification parameter, the documentation is not clear. Maybe someone can provide samples how to calculate the number to fill in? FME version is 2021.0.3 b21326. Viewer is QGIS 3.18.3. Viewing with maputnik shows the same results.

140
G
G
ganeshsomesula
asked in Transformers
Not able to export Join via relationship table(eg:eo_cable_exi_phase) while exporting Cable Segment to ESRI FGDB

Hi Support, I am trying to export the Smallworld Electric Office 5.x data into ESRI File Geodatabase(FGdb). I wanted to export the Cable Segment, Cable & Cable Existing Phase records with the same join relationships to ESRI, while doing that I am not able to choose the Cable Existing Phase table(eo_cable_exi_phase) even though I have selected 'Expose Internal tables' option(please refer attached screenshot). How can I export the Cable Existing Phase table data from Smallworld. I have verified in the Community articles and couldn't find any. Can you please help.

20
G
G
geoquizzer82193
asked in Transformers
Converting data from features/rows to attributes/columns to create comma-delimited CSV files.

Hello, this is a pretty basic question, but I have been wracking my brain as to how to do it.  When I read data from an XML file, it treats each value in my data as a new feature/row. This means that when I convert the features into CSV format, I get one value per line, as opposed to a long string of values delimited by commas. (see the two pictures to get a sense of what I mean). Is there an easy way to fix this? The basic solution in something like excel would be to transpose the data, but there doesn't seem to be a simple functionality for that. (Additionally, if anyone after looking at my workspace has a better way to get my 'msec' values to be first in the csv, I'm all ears!) Any help would be appreciated! 

1400
G
hugues
Contributor
huguesContributor
asked in Transformers
Writer for bulkattribute renamer

Hi everyone. I have a easy question but i can't be able to ressolve. I have a bulkattributerenamer. The reader is a Directory and path filename. The folder containt PDF (no spatial). The name of all the PDF begin with __, like __PZ440.pdf. I want to remove the __ for keep the PZ440.pdf But i have some trouble with the writer. I can't find the right writer. I know is a beginner question so thank you for help

70
debbiatsafe
Safer
plynn
Contributor
plynnContributor
asked in Transformers
Transformation or Python Script?

I have two things that I am trying to accomplish with the current feature/attributes that I have joined. For each row of data, I need to write out 5 new rows. Also, in the new rows, some of the column values are the column names of the input feature. Here is an example: (Attribute Name: Attribute Value)input: ASSETNUM: 12345, VLVCOND:Good, TRNSOPEN:10, OPENDRTN: Clockwise, STRUCTUR:No, SURCOVER: Blue, INSPECTOR:Joe SmithOutput: ASSETNUM:12345, METERNAME:VLVCOND, OBSERVATION:Good, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:TRNSOPEN, OBSERVATION:10, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:OPENDRTN,OBSERVATION:Clockwise, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:STRUCTUR, OBSERVATION:No, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:SURCOVER, OBSERVATION:Blue, INSPECTOR:Joe Smith Any help would be greatly appreciated.Thanks.

100
plynn
Contributor
nielsgerrits
VIP
nielsgerrits
asked in Transformers
Module 'AUTOCAD_OD' is unavailable for use with this FME edition

I have a 2016.1.1 workspace, reading from gdb, writing to dwg (Autodesk AutoCAD Map 3D Object Data).When I run it on Desktop, I get the following errors.2019-07-03 12:13:55|   5.9|  0.0|WARN  |Library 'D:\apps\fme_2016_1_1_64\plugins/realdwg/REALDWG.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this library2019-07-03 12:13:55|   5.9|  0.0|ERROR |Module 'AUTOCAD_OD' is unavailable for use with this FME edition2019-07-03 12:13:55|   5.9|  0.0|ERROR |Module 'AUTOCAD_OD' is unavailable for use with this FME edition2019-07-03 12:13:55|   5.9|  0.0|ERROR |FeatureWriter_3(WriterFactory): Module 'AUTOCAD_OD' is unavailable for use with this FME edition2019-07-03 12:13:55|   5.9|  0.0|ERROR |Module 'AUTOCAD_OD' is unavailable for use with this FME editionWhen I run it on Server, I get the same errors for some datasets, but not all.I synced back the production data to my local machine, run the workbench with the same dataset as it works on server, and st

2430
Y
fmesafe.podpora
Contributor
fmesafe.podporaContributor
asked in Transformers
Filtering based on attribute values

Hello. I have a question. Is there a transformer that can filter based on attribute values? Something like SpatialFilter, but without spatial data. I have two datasets in the workspace and I need to compare one column in each dataset against each other and get only those rows in the output where the value will be the same. I tried to look for some more filters, but I didn't find anything functional. Thank you, very much

6270
fmesafe.podpora
Contributor
H
holyg
asked in Transformers
How to do Point in polygon Spatial query filtering on maximum attribute

I have point table and polygon table in PostgreSQL / PostGIS The polygon table is a series of concentric polygons getting ever smaller / nearest the point See PictureEach point could be in 1 or many polygonsWithin this table is a level column  How do I perform a spatial query returning the join between the polygon contains the point where MAX(level) ? The result I’m expecting is 1 polygon per point (A polygon can contain 1 or more points)

520
H
liaotaofan
liaotaofan
asked in Transformers
how to deal with spatial analysis or topology in pythoncaller ?Please

why i can not use the FMESpatialIndex in pythoncaller? it will report the desktop can not support some function​

90
liaotaofan

Badge Winners

  • FME Form Advanced Training
    maz.ghasemihas earned the badge FME Form Advanced Training
  • Welcome Back
    nataliarojashas earned the badge Welcome Back
  • Integrate Spatial Data
    dezuviriamhas earned the badge Integrate Spatial Data
  • FME Form Basic Training
    johnrochehas earned the badge FME Form Basic Training
  • FME Form Advanced Training
    sahan969has earned the badge FME Form Advanced Training
Show all badges

Community Stats

31,801
Posts
120,804
Replies
39,418
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.