- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,676 Posts
50,709 Replies

When you subscribe we will email you when there is a new topic in this category

12676 Posts

Recently active

Most replies Most views Newest first

vishnuiamContributor

asked in Transformers

How can I pull Google BigQuery Data in FME

I want to pull Google BigQuery data in FME and write as shapefile. Can somebody help me on how to do that?

4 minutes ago

malthern

asked in Transformers

How do I add a folder with FME Packages SDK

I have been using the FME Packager in Python to create my own transformers. I am trying to add an “images” folder to my package that my transformer will use however I get errors whenever I try to package my project.This is my package.yml file, Ive been using the Hello World Package guide for references and trying to look up ways to do it This is my file structure This is the error I get

17 minutes ago

bmwhbmwhContributor

asked in Transformers

Splitting .las

Hello, my previous post was not well Described apparently, i need to split .las just like that. please if you suggest any workflow do describe it a little more than just the name of transformer as that is usless for me (i dont really know how to use FME)

628

19 minutes ago

hnahoulderContributor

asked in Transformers

Feature writer reformat my json attribute

For my process, I use pythonCaller and I have a JSON-type attribute. However, since the setAttribute function doesn’t recognize the JSON type, I have to use json.dumps() to convert the JSON into a string. I then connect a featureWriter to the output of pythonCaller to write the result in JSON format. However, I don’t understand why the featureWriter reformats the JSON on input. How can I have a correct json formatHere is an example of the file from featureWriter [ { "result_json" : "[{\"millesime\": [{\"2022\": {\"echelles\": {\"Y\": {\"max\": \"20.39\", \"min\": \"18.11\"}, \"X\": {\"max\": 461.0, \"min\": 0}}, \"resultats\": [{\"distance\": 0, \"pixel_value\": \"20.39\"}, {\"distance\": 425.0, \"pixel_value\": \"19.76\"}, {\"distance\": 265.0, \"pixel_value\": \"19.4\"}, {\"distance\": 461.0, \"pixel_value\": \"18.11\"}]}}, {\"2023\": {\"echelles\": {\"Y\": {\"max\": \"2039\", \"min\": \"1811\"}, \"X\": {\"max\": 461.0, \"min\": 0}}, \"resultats\": [{\"distance\": 0, \"pixel_value\"

42 minutes ago

carstenhpt

asked in Transformers

Python Caller MinMax Problem

I am using a python Caller to determine if a value is in a range of two other values which are read from a csv file.For Example: Is SearchValue LMH_HNR_Z in the range of value PTOa and value PTOb? If yes, set the variable Fall = B3, if not set it to B3f.LMH_HNR_Z = 5, PTOa = 1, PTOb = 10 should return: Fall=3B, LMH_HNR_Z = 11, PTOa=1, PTOb=10 should return: Fall=3Bf The Code in this picture is part of a bigger function where I discovered the problem but I narrowed the problematic part down to this. The row where the problem happens is this:if (min(PTOa, PTOb) <= LMH_HNR_Z <= max(PTOa, PTOb)):What happens is, that this request randomly returns false even if the search value LMH_HNR_Z is in the range of PTOa and PTOb. The output of some tested values and ranges is also visible in the lower part of this post. I can’t really see a pattern there, maybe one of you?Is someone aware of a bug that causes this behavior? I am using FME Data Interoperability, FME(R) 2022.2.1.0 (20221202 -

222

47 minutes ago

sgsolingenContributor

asked in Transformers

Output Raster jpeg2000 with alpha band from Ascii Grid

We have merged Ascii grid and then classified the Raster using “RasterExpressionEvaluator” the Interpretation is set to UINT8 The color values have been assigned defining the interpretation of the palette as RGB24 using an AttributeCreator and then adding the color values to the RasterPaletteAdder. Export in Geotif format is possible. The Tif is transparent between the classified raster cells via the Nodata value.For performance reasons, we want to use a jpeg2000 and control the transparency via an alpha band as the jpeg2000 format does not support nodata values.How can we export the classified raster image in jpeg2000 with an alpha band?Thank you very much for your help in advance.

292

1 hour ago

alanbcContributor

asked in Transformers

Has anyone resolved the workspace log Warning for coordinate system when working with Snowflake Spatial Reader?

Has anyone resolved the workspace log Warning for coordinate system when working with Snowflake Spatial Reader? Coordinate system of reader identified by keyword `SNOWFLAKE_SPATIAL_1' has changed from `LL-WGS84' to `' If you set the coordinate system on the Snowflake Spatial reader to LL-WGS84 the warning changes to. NOT changing coordinate system of reader identified by keyword `SNOWFLAKE_SPATIAL_1' from `LL-WGS84' to `' -- mapping file setting of `LL-WGS84' overrides coordinate system `' read from file. If you set the coordinate system on the Snowflake Spatial reader to EPSG:4326 the warning changes to. NOT changing coordinate system of reader identified by keyword `SNOWFLAKE_SPATIAL_1' from `EPSG:4326' to `LL-WGS84' -- mapping file setting of `EPSG:4326' overrides coordinate system `LL-WGS84' read from file. Ultimately the Warning has no impact on the workbench or translation, the data is definitely LL-WGS84 and a CoordinateSystemE

19210

1 hour ago

slustado

asked in Transformers

What is the best way to download Esri Feature Services from multiple sources and download onto a local file geodatabase?

Hi community! I've been trying to formulate an efficient workspace that would:Extract feature service URLs from an excel sheet (many have the item ID number at the end)Download the GIS data from each feature serviceTransform the idea with typical cleaning upWrite out to a file GDB on a local server drive For steps 1 and 2, I've been experimenting with HTTPCaller and FeatureReader but haven't yielded a successful extraction yet. I think 3 and 4 will be straightforward, but if there any any suggestions (specifically with getting from 1 to 2) welcomed, and appreciate any feedback in advance!

304

3 hours ago

lifalin2016Contributor

asked in Transformers

2024.2 yields an error in SharepointOnlineConnector ?

Hi.I built a workspace in 2024.1, that fetches a number of files from a customer Sharepoint site. It works (in 2024.1) without problems.I just installed 2024.2, and ran the workspace (with no changes).Now it issues an error with a SyntaxWarning from the package “safe.microsoft-sharepoint”:C:\Users\xxx\AppData\Roaming\Safe Software\FME\Packages\24783-win64\python\safe.microsoft-sharepoint\stringcase.py:247: SyntaxWarning: invalid escape sequence '\W' return re.sub("\W+", "", string)Is this something that I should worry about ?SharepointOnlineConnector is not listed as an upgradable transformer in 2024.2Cheers.

154

6 hours ago

pknoContributor

asked in Transformers

Identify matching substrings from multiple attributes

Hi everyone,I am trying to match attributes and write the matching part of the substrings into a new attribute. The following table explains it best: 1 2 3 4 match 03.02.06.03.02.01 03.02.06.03.04 03.02.06.03.02.02 03.02.06.04.03.01 03.02.06 03.02.06.03.04.02 03.02.06.03.09.01 03.02.06.03.01.01 03.02.06.03.04.01 03.02.06.03 03.01.04.05 03.01.04 03.01.04 Note that the fields may also be empty and should then be ignored and not all strings are the same lenght. I am also trying to match from the start of the string only. The only idea that came to me so far is to create lists for each attribute using the attribute splitter and then use conditionals to compare each two-digit part seperately, create each sequence and then string them back together. Maybe there is an easier way? Best reagrds.

565

7 hours ago

deanhowellEnthusiast

asked in Transformers

Lines from Points file

I have a text file that has a list of pointse.g. ID, X, Y I then have another file that has a list of linese.g. ID, FromPointID, ToPointID How do I create the lines using the coordinates listed from the points file?

263

15 hours ago

jakestenson

asked in Transformers

Emailer not connecting to microsoft - unable to retrieve access token

Hello, I’m trying to connect to my microsoft email with the emailer transformer. I get the ‘Unable to retrieve access token’ error after logging into my account and using authenticator app. I get this error with veryify HTTPS certificates enabled or disabled. Any help on this?Thanks

121

17 hours ago

galigisEnthusiast

asked in Transformers

Force FME to use ArcMap instead of ArcPro?

Hi All,How can I force FME to use ArcMap 10.8 for reading GDB instead of ArcPro 3.x? I have a workflow that needs to use ArcMap because of a python script and everything works fine on my machine, my current versions of FME (2018, 2020, 2023...etc) use ArcMap to read GDB. Happy days. See below: One my colleagues also uses the same workflow, same version of ArcMap and FME but his workflow goes to ArcGIS Pro instead to ArcMap,How can I force FME to use ArcMap to read/write GDBs?Thanks :)

213

1 day ago

mikeinhamiltonParticipant

asked in Transformers

Formatting Headers In Excel

I’m trying format the headers of an excel file. I’m attempting to use a template but can’t get it to work. The output always has a tab that is formatted like the template, and a tab with the data without the formatted headers. I’d like to write the data to the formatted tab. Is this possible?

301

1 day ago

antjaContributor

asked in Transformers

INSPIRE GML writer - importing wrong XSD

Hi,I have a workspace transforming data to write it in INSPIRE GML format (theme Hydrography). Earlier this year, some of the INSPIRE application schemas (XSDs) where upgraded to a new version Include changes from 2024.1 schema release · Issue #1027 · INSPIRE-MIF/helpdesk-validator, including the hy-p one that I’m using here (v4.0 to v5.0).Therefore I changed my INSPIRE GML writer to point to the new XSD URI and adapted the xsi:schemaLocation parameter consequently. However, when indicating the v5.0 the output GML is not written correctly: there are remnants of the v4.0 in it.First in the imports, see xmlns:hy-p4 and xmlns:hy4:<gml:FeatureCollection xmlns:omor="http://inspire.ec.europa.eu/schemas/omor/3.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:sr="http://inspire.ec.europa.eu/schemas/sr/4.0" xmlns:base="http://inspire.ec.europa.eu/schemas/base/4.0" xmlns:gts="http://www.isotc211.org/2005/gts" xmlns:hy-n="http://inspire.ec.europa.eu/schemas/hy-n/4.0" xmlns:omop="

656

1 day ago

matthewbContributor

asked in Transformers

Is it possible for a user parameter to default to today's date?

I’m querying databases using SQL Creator and have a Where clause date > ‘$(dateuserparameter)’. I would like the dateuserparameter default value to be yesterday’s date, for example ‘2024-10-07’. Is it possible to set the parameter’s default value to be yesterday’s date?

15411

1 day ago

quanguContributor

asked in Transformers

Hi, fellow FMEers! We have some trouble to working on I3S.

We want to automatically write 3D data to an existing 3DScene in ArcGIS Online. The data consists of borehole samples (geometry simple 3D-cylinder). We have tried using the Esri Indexed 3D Scene Layer-writer but the output does not show correctly and we can't create pop-ups showing the attribute data (although it looks like it's there). We're not sure why this doesn't work but figured we'd try here first to see if we can get any pointers to a best practice. So, can anyone please help shed some light on the best way of doing this - updating 3D-data to an existing 3D-scene in ArcGIS Online? (We will want to be able to do this also with mesh-data... for instance a ground model.)

10911

1 day ago

jugoslaviaaSupporter

asked in Transformers

Preventing Small Holes in Polygons from Being Removed in FME

I’m reading a GPKG table, and when I view the data in the Data Inspector, I notice that FME removes some small holes in my polygons. How can I prevent this from happening?

363

1 day ago

marta.podsiadSupporter

asked in Transformers

Split polygon into equal parts

Hi, I am trying to edit the workbench from https://fme.safe.com/blog/2016/05/point-cloud-power/ so it splits the polygon into the number of parts or area I provide. I cannot figure out how to change the PointCloudCoercer to allow me to do so

231

2 days ago

tiztrainContributor

asked in Transformers

CenterlineReplacer - Error Not Installed

Hey all,So I upgraded FME Desktop to 2024.1 (through ArcGIS Pro installation) and opened up an exisitng workspace I had created in a previous version. When it opens I get the message stating:Transformers are used that are not installed: 'CenterlineReplacer (version 6)'https://docs.safe.com/fme/html/FME-Form-Documentation/FME-Transformers/Transformers/centerlinereplacer.htmWhy is this happening? I have no option to upgrade the existing transformer and it disappears from my workbench and when I try to search to add another ‘CenterlineReplace’ transformer, it is missing from the list.I have ran a repair on the installation but it is still missing.

362

2 days ago

aaronp_osniContributor

asked in Transformers

RasterExtractor duplicating one blob value for all input feature types

Hi folks,I have multiple images I need to extract blob data for. When I input my individual feature types into the Raster Extractor (eg. 32 JPEGs, as shown in image below) the raster extractor seems to duplicate the first image for all of the feature types, so I end up with a blob of the first image for all of my individual feature types:This results in the first image duplicated, as a blob, for all 32 features - when I require a unique blob value for each input feature. The only workaround I’ve found is to have a raster extractor for each feature type, which is not suitable.Any help is greatly appreciated. Kind regards, Aaron

2 days ago

liamfezInfluencer

asked in Transformers

Unknown Failure or stalling out

My team has a workspace that has ran thousands of times before that has started failing in two different ways. The first failure does not actually trigger FME to fail, it stalls out on the ContourGenerator and does not move. Memory space, RAM, CPU usage, and GPU usage are all fine, none of them spike or max out. In fact RAM usage is quite low. Other times it will fail, at the same spot and give this error:An error occurred. FME will attempt to obtain more information on the error, but this may cause the translation to be terminatedAn error occurred. Here is the information that FME was able to find on the errorget_next_capacity, allocator's max size reachedI found this post from four years ago suggesting to just contact the support team. Any ideas before I do so, or is that still the recommended route to take?Version is FME 2021.1.3.0 (20211002 - Build 21631 - WIN64) I know this is an older build, I was told by my management that a new build would not fix any issues/make a difference a

303

2 days ago

nicholasContributor

asked in Transformers

How to calculate length of polyline in metres when dataset is Lat Long?

I have a dataset, representing a road network, in a Geographic Lat/Long coordinate reference system. The area covers three UTM zones.I want to calculate the length of roads / polylines with metres as the unit of measurement.What transformer should I use?

293

2 days ago

matthieuvContributor

asked in Transformers

AIXM 5.1 geometry from AirspaceTimeSlice not loaded when referenced with xlink:href

I use the AIXM 5.1 Reader with the default settings to read all AirspaceTimeSlice. Some of them are missing geometry. For example, I have a feature which uses xlink:href to reference the geometry of a CTR. The CTR in itself has an UNION and consists of two CTR's which are also referenced with xlink:href. How can I get FME to get this geometry. It somehow doesn't seem to follow up on the xlink:href. I use FME Desktop 2019.2.3.1

13030

3 days ago

cguillaumeParticipant

asked in Transformers

HTTPCaller - API SIRENE v3.11

Bonjour,Je bataille depuis quelques temps avec l’appel de l’API SIRENE v3.11https://api.insee.fr/catalogue/site/themes/wso2/subthemes/insee/pages/item-info.jag?name=Sirene&version=V3.11&provider=insee En utilisant un HTTPCaller j’arrive bien à faire fonctionner l’API mais je ne comprend pas comment appliquer les variables de la recherche multicritère de l’API POST /siret.Avez vous déjà fait appel à cette API et des conseils à me donner ?Merci d’avance :) Voici l’appel à l’API que je souhaite : Et voici les paramétrages que j’ai essayer dans mon transformer :Fonctionnel mais sans filtresNon fonctionnel

233

3 days ago

Page 1 / 508

Badge winners

malthernhas earned the badge Student (Grey)
sgsolingenhas earned the badge Teacher (Grey)
changeofmotionhas earned the badge Teacher (Grey)
User15923979821343989192has earned the badge Welcome Back
ahmadrezakarimhas earned the badge Teacher (Grey)

Show all badges

30,146: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.