- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,682 Posts
50,735 Replies

When you subscribe we will email you when there is a new topic in this category

12682 Posts

Recently active

Most replies Most views Newest first

smfks911

asked in Transformers

Why attribute is missing after area on area overlay?

Hi altruist, I am having an issue in after using AreaOnArea overlay operation. I have overlaid two polygon datasets and ideally the output should have attributes from layer when there is _overlap field have 2 and more. This is what happened for other overlay operations. However, in the following cases I do not see the attribute from one of the polygons after the overlay operations: This is the attributes before overlay:The overlay operations:After the overlay:Does anyone have idea why that may happen?

394

2 years ago

daichisuba

asked in Transformers

How can I write or create a newline-delimited GeoJSON file

I'm currently exploring MapBox and their Tiling Service, which is currently in Beta and I'm trying to figure out how to create a line-delimited GeoJSON output so I can upload via their Tileset API. The data/file needs to take the format as per the example below: Normal GeoJSON{ "type": "FeatureCollection", "features": [ { "type": "Feature", "properties": { "name": "Melbourne" }, "geometry": { "type": "Point", "coordinates": [ 144.9584, -37.8173 ] } }, { "type": "Feature", "properties": { "name": "Canberra" }, "geometry": { "type": "Point", "coordinates": [ 149.1009, -35.3039 ] } }, { "type": "Feature", "properties": { "name": "Sydney"

812

2 years ago

fionahf

asked in Transformers

Why is this URL causing an error with FeatureReader?

I am trying to read the following URL (https://eprostor.gov.si/ods/atom?id=1&type=data) with a FeatureReader transformer so that it will download the zip file and process the data within. This works fine with many other URLs I have used in this way (e.g. https://services.cuzk.cz/gml/inspire/ad/epsg-4258/583723.zip), but not for this one.The error is:XML Parser error: 'Error in input dataset: 'https://eprostor.gov.si/ods/atom?id=11&type=data' line: 1 column: 11 message: invalid byte '�' at position 1 of a 1-byte sequence' I have attached an example workbench and associated csv containing a successful and failing URL in a list. I'm wondering if anyone else has ever come across this issue, and/or if anyone has any ideas as to what is causing the problem, and if it can be resolved in some way. The only thing I can think at the moment is the fact that the URL that is failing does not contain `.zip` at the end of the URL, or is maybe passing in some mis-information in the headers - t

151

2 years ago

fmesafe.podporaContributor

asked in Transformers

Data merging

Hi. I need some advice please. I have a 5x data branch at the end of WS. Each branch contains a defined attribute, see note. This attribute is part of the DepartureLeg. Each departureLeg contains a startpoint and an endpoint, two points (it can be one of the variants of five branches ( airportstartpoint, navaidendpoint... etc. ) and each departureLeg is part of a Departure. Chronologically, it goes like this. A departure contains several departureLegs and each departureLeg has two points ( airportStartpoint, navaidStartpoint, navaidEndpoint, etc. ) This is how I need to group it, but I can't. I think I have all the ids I need.

138

2 years ago

helmoetzContributor

asked in Transformers

GML posList mixed up?

Hi, I'm struggling reading geometry from an xml file. When looking at a part of the (0.7Gb) large xml, I can see it has coordinates that reference a location I do not expect:<gml:LineString srsName="urn:ogc:def:crs:EPSG::4258" gml:id="GEOMETRY_98ce8c1e-3676-4a60-b2a8-d7e63fe97d1d"><gml:posList srsDimension="3">51.77106873325691 5.459700336196274 49.41166353587596 3.2520665388839736 47.937498062913775 8.934025947231504 51.771400476701494 5.460105669526139 49.412014702926356 3.25205099130662 47.937476504785614 8.934700858000644 51.77170841095756 5.460502642204418 49.412240574188026 3.252040990938717 47.93746470527796 8.935070205423436 51.771910436397455 5.46090045825306 49.41302764854071 3.2520061426583493 47.9374374566226 8.935922993715176 51.77277383456701 5.462819713112839 ...</gml:posList></gml:LineString>The 3D coordinates seem to alternate, which might have something to do with a side view from the data, I guess. When I look at the data in the viewer, it loo

368

2 years ago

mr_fmeEnthusiast

asked in Transformers

remove duplicates values from Excel

Hi, I have one column in my excel file that show tha values like below: VARIEDADE ABB4, ABB2, ABB4, ABB5ABB4ABB2, ABB5ABB2, ABB2ABB4, ABB4, ABB4, ABB4 The two last lines have the same value separated by comma. I would like to simplify like below: ABB2ABB4 How Can I do this? Thank´s

192

2 years ago

eric_armitageContributor

asked in Transformers

Reading Microstation DGN Header information

The documentation for the IGDS (DGN) reader states that "Design files consist of a header, followed by a series of elements. The header contains global information including the transformation equation from design units to user coordinates, as well as the dimension of the elements in the file" . My question is how do I read only the header information - coordinates and dimensions etc. I have a large number of files and I just want to the header info from each one. I know how to run the batch processing part with the workspace runner but can't figure out how to set up the reader.

342

2 years ago

brandonguoContributor

asked in Transformers

How to design a customised loop transformer?

I am trying to solve the application allocation issue through FME. The scenario is I have a list of applications and a list of places with limited spaces. My initial thought is to sort applications by date, every time, send only one application to the neighbour finder and then change the place's available spaces. The issue that annoys me is it seems like two loops running parallel but also linked together. Not sure what's the best way to design this type of loop? My loop design seems like just creating an endless circle.Any guide would be much appreciated.

595

2 years ago

oiram

asked in Transformers

Split up polygon where it becomes long and narrow

I have a dataset where polygon sometimes have a long and narrow part like in this image (upper narrow part of the highlighted polygon): I am looking for a way to cut polygons like this in two parts so that the small polygons becomes a separate shape.Any idea how to do this automatically?

8411

2 years ago

neel_d

asked in Transformers

How to apply formatting to pivot table when writing to excell using dynamic writer

I have a dataset with 3 attributes (REF_ID, orde, DMdrempel) and one (DHMdrempel) has formatting (colouring) applied.There is a 1 to many relation between REF_ID and orde, a 1to1 between DHMdrempel and orde (although sometimes values of DHMdrempel can be identical).I want to create a pivottabel as this one but with the formatting applied:I apply an attributepivoter with parameters set as follows: group rows by REF_ID, group colums by orde and attribute to analyze is DHMdrempel.Because of automation purposes and because I don't know the (maximal) number of 'orde'/columns, I cannot use the attributeExposer (or at least I think I can't). I therefore use a Dynamic writer to create my excel file.But I want to include the formatting (colouring) of the DHMdrempel into my pivotted table but I can't find out how to do this. Can you help me?

151

2 years ago

lopes8

asked in Transformers

SystemCaller on FME Server appears to work but isnt

I have an ETL doing one thing, running SystemCaller to run a python script. This works fine in Workbench but is not working on Server even though the log shows an EXITCODE of 0. Both desktop and server are windows 64 environments, FME 2019.0.1.If we log in to the server box and call the script from cmd, it works just fine. We tried logging in as the fme user account and it ran just fine as well. Its only when running on FME Server that we are having problems. I have tried referencing the python script from a directory drive and copied to the Server box, doesnt seem to matter. Some clues. The log for the job has an exitcode of 0. When running successfully on Workbench we can see in the log where SystemCaller executes the Python and it logs everything the script does. The log on Server executes the Python and moves on to the next Transformer (no log from the python script running).The Python script being ran must import other Python scripts. When I remove these other scripts as

2397

2 years ago

snehaContributor

asked in Transformers

How to convert the attribute value to a parameter? I tried many ways but i am not able to succeed.

The attribute values is from GitLab pipeline which is called in JSONFragmenter and stored in Attribute Keeper. Now need to pass these attribute value to an azure file storage connector.But the Azure Storage connector is not taking the Attribute values, only parameters are working.Able to pass the published parameters as well as the private parameters.Kindly help me with this.

402

2 years ago

janghanie1

asked in Transformers

Limiting 3ds file size from 3ds writer

Hi, I'm working with a mesh feature with around 200 vertices and edges.I saved it to my local PC in 3ds format.I guess the file size is too large than ordinary 3ds file(maybe 4~5 times bigger compared with almost the same file.)I found that 3ds writer in fme is using native fme entity rather than 3ds entity type.(similar question: https://community.safe.com/s/article/fme-creates-large-autocad-dxf-files)I couldn't find any parameters or methods to do the similar thing...Is there any way to reduce my 3ds file output? Thanks a lot.

2 years ago

benvkContributor

asked in Transformers

Can I use TestFilter to find rows over one week old?

I currently use this WHERE on my reader:[Last_Updated] < DATEADD(week,-1,GETDATE()) or [Last_Updated] IS NullI now have a need to use the items that are older than 1 week, then another need to process those items that are less than a week old. I have added a TestFilter, the NULL test is easy, it is the 1 week item that brings me unstuck. Is this possible to do? Or do I need to add another step in my chain of processes? Thanks heaps.

224

2 years ago

talha

asked in Transformers

I want to create textured models to cesium 3d tiles from obj files

Hi,I have several obj files for a city. I succeeded to convert these obj files into cesium 3D tiles. At the result of tiles, texture of models created darknessly. To solve this situation, I used AppearanceSetter, then set Shininess value. However, textures of models got lost. How do I set shininess value of my building with textures? I want to share created models by using AppearanceSetter:I want to share without AppearanceSetter:Its my workflow:Thanks for your interest.

32515

2 years ago

erik_janContributor

asked in Transformers

FME Server job gets queued

I am using FME Server 2017.0.0.2When I start a job (jobsubmitter service) from the repository, it gets queued.But at the moment no job is running and an engine is available.When I go into the queue and resubmit the job, a new job gets executed running the same workspace without any issues.Has anybody seen this before?And if so, how to solve it?

1158

2 years ago

virtualcitymattEvangelist

asked in Transformers

Help with creating geometries from Python

Hi guys, I'm after a bit of help for creating FME Geometries with a Python Caller. The module I'm using is giving me an object in the following form (it should be a TIN) [((x1, y1, z1), (x2, y2, z2), (xn, yn, zn)), ((next triangle)), ((last triangle))] I want to have this as a multi polygon or TIN and my Python skills are fairly lacking. My first thought was to try and format it as WKT in FME but I figured there must be a more elegant way to do this in the Python script itself. Any suggestions on the best approach here would be nice. The ideal output would be either a multi-polygon or Multi-Surface.

10111

2 years ago

candemiroguz

asked in Transformers

Does write exif gpstimestamp attribute on jpeg file ?

I have .csv file which includes time stamp, lat, lon, altitude and image name columns. I matched image name column on .csv file with image's fme_basename via feature merger transformer. And also, i can write as exif in JPEG file lat,lon,altitude. But i can not write timestamp as a exif on my JPEG image file. Could you help me in this situation?

261

2 years ago

warrendevEnthusiast

asked in Transformers

Coordinate System Shift between 2021.1 and 2022.1

We recently upgraded from FME Desktop and Server 2021.1 to 2022.1 and are now noticing about a 3' shift while using the Reprojector and CsmapReprojector. The shift is not present while using the ESRIReprojector and PROJReprojector. In this example scenario I've attached workspaces for both version and shapefile outputs of the coordinates. The workspace has not been modified and has been ran in each version to generate shapefiles for reference that contain the coordinate values that differ between the two. We are going from NSRS11.LL to TX83-CF. Is there anything specific that has changed in the newer version that I might be missing when handling certain reprojections? Both workspaces have reprojection engine set to FME.

302

2 years ago

nsevenseven

asked in Transformers

Write Features Written row counts and tablenames to database

We have a workspace that retrieves data from 40+ tables in on and off-site databases and writes the results to tables in an on-site Oracle database. The workspace consists of SQLexecutors and SQLcreators which read the data using ODBC, and Oracle non-spatial writers which write to the local tables. To help with data verification, for each table written to in the local database I want to write a row to a data verification table with the tablename and the number of rows written. I've tried using Counters and Samplers attached to each reader to get the number of rows written, and can route those to a writer to write to the data verification table, but can't seem to get the table name exposed. The attributeexposer and exploders expose the column names but not the table names. And I was hoping there may be a more efficient way of doing this than by attaching individual counters and samplers. Basically, I want the Features Written Summary from the workspace log written to the data ve

106

2 years ago

james_c_452Supporter

asked in Transformers

Separate points in a point cloud into those with colour and those without

Hi, I have a single point cloud which has contains both points with colour and points without. Does anyone know how I can split it so that I can separate the two types of points? I have a script to turn the intensity component into black and white colour values but I don't want apply it to points that actually have colour information already. Does anyone have any ideas? Possibly there is some expression for the PointCloudExpressionEvaluator I could do? But I can't think what. Any help would be appreciated

167

2 years ago

bgossett127

asked in Transformers

Help with configuring attribute splitter to skip specific delimiters

I'm having trouble using AttributeSplitter to split everything with a semicolon as delimiter, EXPCEPT skip seimcolon's that are within parentheses. Please help! Thanks! Example 1424462 (EXT: 1488296; 1491537); 1428106; 1436651; 1436653 What I need is:1424462 (EXT: 1488296; 1491537)142810614366511436653

2 years ago

smfks911

asked in Transformers

Is it HTTPcaller error or API error?

Hi altruist, I am trying to fetch data through API for the first time through GET method. However, I am getting error message each time with a code 401 (unauthorized access). Can you kindly tell me from the first image, whether I have correctly put information in the HTTPcaller transformer? I mean the access is really unauthorized or need to other parameter values? I have used the site owner provided credentials to get the request URL. A help will be really appreciated.

148

2 years ago

muzhnastoContributor

asked in Transformers

Local coordinates of the raster to the geometry.

Hello. There is an interesting problem, but I can't solve it. I really need your help.1. I have an image footprint. This geometry (polygon)2 . I have an image from a drone. I know the area of interest on the raster. But the area of interest in the local coordinates of the raster , for example, the size of the raster is 80x100 pixels and the area of interest is set to Row and Column 11,13;11,64;25,64;25,133. how to create a zone of interest with a distortion in the geometry, based on this data ?

247

2 years ago

connornew

asked in Transformers

Help extracting text from an XML. I am confused about using XMLXQueryExtractor.

I have an XML attribute containing metadata of a large number of tables. For each table I want to search through the metadata and extract the table name, all of its attributes, and the attribute descriptions. Each table has a varying number of attributes. Once I have the values want to print them clearly on a Word document where the table name is at the top of the page with all of the attributes listed below.

141

2 years ago

Page 106 / 508

Badge winners

acookehas earned the badge Integrate Spatial Data
eskelinensarahas earned the badge FME Form Basic Training
rwnewcshas earned the badge Welcome Back
rwnewcshas earned the badge FME Form Basic Training
jkenneyhas earned the badge Teacher (Grey)

Show all badges

30,162: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.