- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,725 Posts
50,914 Replies

When you subscribe we will email you when there is a new topic in this category

12725 Posts

Most replies

Most views

Newest first

dustinInfluencer

asked in Transformers

JSON Extractor, but problems with the source JSON

I’m dealing with a rather large JSON file. The issue I have is that some element values contain literal quotes and double quotes, and these are causing Rejections in the JSONExtractor. The quotes/double quotes are not escaped in the original source. Is there a way to escape these automatically with other FME JSON transformers?My efforts to fix thus far using the StringReplacers have resulted in errors throughout the entire JSON string, since quotes/double quotes are native to JSON formatting.

981

10 months ago

silverjContributor

asked in Transformers

ChangeDetector Update slow to write

Hello, We have been troubleshooting this FME translation for a while and can’t figure out a solution. The Inserted, Deleted features of the ChangeDetector write reasonably quickly but the Update features are writing so slow it will be unusable, GIF for reference. Things we’ve tried without any differences:Indexing all fields in ArcCatalogIndexing Just the Match Column fields (3 Fields to make a Unique ID)Indexing and using a CRCCalculator field for the Match ColumnsAdding a FeatureHolder after the ChangeDetectorAdding a AttributeManager after the ChangeDetector removing unused fieldsWriting to a File Geodatabase (SDE is ultimately the goal and being used in the gif below)Not Checking the Geometry in the ChangeDetectorChanging Transaction types in the WriterChanging and testing various other settings in the transformers and writers Thank you for any suggestions!!

1114

10 months ago

mariakaContributor

asked in Transformers

expose attributes of a list

Hi there,I have following input:a list with unknown/varying keys and valuesWhat I need:the name of the keys as attribute valuesExamplesWhat I already tried:ListHistogrammer This has no effect. Is it because it’s a “nested list”? Cheers,Maria

1652

10 months ago

nick_aContributor

asked in Transformers

Comparing GIS Attribute values to CAD text and update the CAD file

Parcels are created, removed or changed in GIS, but we also have a CAD Map3d basemap that we also maintain. One of these basemaps contains a text layer that has the address number for each parcel, what I am trying to do is compare the parcel address number from the GIS against the cad basemap find out which ones have changed, removed or inserted then make the changes to the cad file.I have already setup readers for the GIS and CAD parcel polygons and using a change detector I know what is different compared to the polygon basemap, but now I need to take that result and check it against the text in the cad basemap and update it. for some reason the number of changes don’t seem to match when I compre the text. how would you suggest I attempt to do this, is there something I am missing.

836

10 months ago

jaywenContributor

asked in Transformers

FME collation setting

Hi, I am using FME to write tables into SQL Server, is there any setting for collation i can add Latin1_General_CI_AI Any suggestion is greatly appreciated. Thanks,Jay

684

10 months ago

castilloParticipant

asked in Transformers

fme transformador para encontrar geometrias duplicadas en una base de datos

hola necesito encontrar en mi base de datos si tengo alguna geometría duplicada.Alguien sabe de algún transformador?

492

10 months ago

trigger93

asked in Transformers

FME-Desktop crashes while loading main Window

Hello there,i have a big Problem. My FME-Desktop-Application crashes while loading the main window. If i start FME the littel loading window appears. But when the main window is loading the launcher crashes without any errormessage.Reinstalling the software didnt solve the problem.Have anyone a idea what i can do? Thanks 🙂

99527

10 months ago

aronContributor

asked in Transformers

Convert ALL vertice in a line/polygon into points?

Lines/polygons contain ordered data of every vertice that they are made up of. Is there an easy way to extract ALL these positions as points? (preferably while retaining attributes)

381

10 months ago

yagami9Contributor

asked in Transformers

How to Convert an autocad DWG 2D floorplan into an IFC file ?

I’ve read this article : https://support.safe.com/s/article/autocad-to-ifc-conversion-example that converts a DWG plan consisting of a 3 storey layer , and all the object have a HEIGHT attribute that is used to extrude the 3D geometry from the 2D input , then the ifc file is created with all the infos in a single ifcSpace . But my need is different ,in the input , my autocad file has attributes of HEIGHT , as well as TYPE ,which would contain the type of each object (WALL , DOOR , WINDOW , Stairs , etc ).and so i want the output ifc file to be a rich file with multiple types of objects : ifcDoor , ifcWindow , ifcWall ,.. . instead of just a 3D model in an ifcSpace .

2752

10 months ago

kalbertContributor

asked in Transformers

SQLITE Reader and FeatureMerger - User Attributes behavior

When using the SQLITE3 Reader, unchecked attributes from the User Attributes tab are not exposed downstream to any transformer like AttributeManager, -Remover, -Keeper. This behavior is as expected.However when using the FeatureType downstream on the Requestor side of a FetureMerger and the conflict resolution is set to ‘Use Requestor’ , the unchecked attribute is still active behind the scene and take precedence over the attribute of the same name coming from the Supplier.It turned out that I need to keep the unwanted attribute ‘checked’ and remove it actively with an AttributeRemover to avoid the unexpected usage in the FeatureMerger.I also tried to force it by changing the workspace option Reader/Writer Options > Allow Reader Feature Type Editing, but it made no difference.Question: is this a bug or dangerously intended? Setup: FME Forms 2023.2 for win 64

432

10 months ago

myadegaryiutacContributor

asked in Transformers

Original Color from Civil 3D DWG file changed to black/white

Hi,I am converting a Civil 3D DWG file to GDB. However, once I read the DWG file, the colors appear to be changed to black and white. I attempted to use DWGStyler, but the colors are still not reverting to their original state. I've checked the Reader Parameters to ensure that "Resolve Entity Color" is selected. Could someone please assist me?1 more thing that I found is that, once I use autocad_color or fme_color in DWGStyler the values disappear. Thanks in advance

1067

10 months ago

andr__dContributor

asked in Transformers

Function @uuid() versus transformer UniqueIdentifierGenerator

Hello, Is the result of the function @uuid() the same as the transformer UniqueIdentifierGenerator ?I would like to create directly an UUID in an attribute creator instead of using 2 transformers (UniqueIdentifierGenerator and AttributeCreator). Thanks.

541

10 months ago

mitygrid26Contributor

asked in Transformers

Pass custom Python Interpreter and Python Home to a batch script that triggers a FME workbench script.

I am trying to pass custom Python Interpreter and Python Home to a batch script. The batch script then triggers a FME workbench script. Here’s the commands I am using in the batch script: set NEW_TIME=%TIME: =0%set LOG_DATE=%DATE:~4,2%_%DATE:~7,2%_%DATE:~10,4%_%NEW_TIME:~0,2%_%NEW_TIME:~3,2%SET path=<path to log directory>SET filename=%path%batch_log%LOG_DATE%.txtecho ************* Started FME Update ********** > %filename%echo.>> %filename%echo.>> %filename%echo Time Stamp: %DATE% %TIME% >> %filename%:: activating clone python env which contains all the dependencies for the PythonCaller referenced in the Workbench scriptcall "C:\Program Files\ArcGIS\Pro\bin\Python\Scripts\activate.bat" arcgispro-py3-clone >> %filename%:: Use custom Python set to true"C:\Program Files\FME\fme.exe" APPLY_SETTINGS SYSTEM "Python/Use Custom Python" true >> %filename%:: Use custom Python Interpreter. Directory: "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro

1413

10 months ago

armando_amadorContributor

asked in Transformers

Generalize multipart polygons

Hi all, I have a layer with multiple polygons sharing a specific attribute (Area_ID), and they are spread with no geometry among them. Multipart polygons sharing same attribute value.Then, I would like to know the way to identify the area that could be filled considering the vertex points that can make up a border.Area between multipart polygons that need to be filled.Finally, the need is to merge all of the multipart polygons into one, without moving those multipart from the coordinates they are now, just filling the space between the polygons with the same attribute in common.Any thouhts? Thanks a lot!

1072

10 months ago

vkiContributor

asked in Transformers

Create Excel-List of layers out of GetCapabilities-Document

I would like to create an Excel list from our GetCapabilities document, where all our wms services are listed.Some of our services are grouped together and I don't want to list these group layers, just the lowest level of layers.The list should include name, title, abstract and metadata link (xlink:href).I have searched the community for examples, and although there are many questions about XML, I have not been able to apply these solutions to my problem and thus create a list.I probably have to use the XQueryExtractor to find the desired layer elements, but I am not able to insert the XQuery expression (Layer[child::CRS]).URL: https://map.geo.sz.ch/mapserv_proxy?SERVICE=WMS&REQUEST=GetCapabilities&lang=deAny help will be appreciated!Thanks in advanceVera

371

10 months ago

kai_fmeContributor

asked in Transformers

SQLExecutor with Azure Synapse SQL

Hi,we connected from FME Desktop 2022.2.5 successfully to a Azure Synapse SQL Pool using the "Microsoft Azure SQL Database (JDBC)" connection. I can use the Reader without any problems and query data from the tables. However I need to use SQLExecutor Transformer as the queries need to be dynamically created. But this gives me the following error:com.microsoft.sqlserver.jdbc.SQLServerException: '@@TRANCOUNT' is not supported.Seems like the SQLExecutor performs additional statements in the background which are not supported by Synapse. Are there any workarounds to avoid this issue or to force SQLExecutor not to use additional statements?Thx for your help!

1002

10 months ago

peter100Contributor

asked in Transformers

Errror 'DBASE writer: 'unknown' is not recognized as a valid encoding name'.

Cache problem?At writing a dbf-file happens errror "DBASE writer: 'unknown' is not recognized as a valid encoding name". FME(R) 2023.2.0.0 (20231201 - Build 23764 - WIN64) Error happens since today Feature Caching set off Result files: .cpg, .dbf, ‘.dbt’ Each process creates 51 files of altogether 283 --> maybe a caching problem? Same error happens also with DBASE writer -> character encoding 'utf-8'Reader file:xlsx-file (MS Office 2016)Writer dBase (DBF) with character encoding Latin-1 Western European (iso8859-1)Parameter tab --> Name-table "JPB_NR" (format: number(3,0) all together 283 lines of dataDBASE writer:Writing files using character encoding 'iso-8859-1' OS Locale Encoding : windows-1252 Process Encoding : UTF-8Test files are in attachments.Can anybody help?Regards,Steffen P.

593

10 months ago

jurgenmackContributor

asked in Transformers

JsonTempater Geometry template usage

I have created a geojson file from nine features drawn from a postgis database. I have tried all the examples from the community pages with no success. Can anybody point me in the right direction?

9413

10 months ago

fmeuser_gcContributor

asked in Transformers

FIltering out large number of Attribute values

Need to filter out the large list of Attribute values(Around random 10000 values) to be processed. Currently it is tedious using 'AttributeFilter' transformer as it needs all 10000 output ports to be connected to next transformer for further processing.There should be other transformers for sure which I don't remember any. Please help.-Thanks

1465

10 months ago

myadegaryiutacContributor

asked in Transformers

How to convert DWG to Feature Class gdb?

Hi everyone,I need to convert multiple 3D .dwg files to feature class gdb. that can be readable and presentable in ArcGIS Pro, or Enterprise.The manual process in ArcGIS pro include these 3 steps Step 1. Bring in MultiPatch feature to ArcProStep 2. Select the original MultiPatch feature class and export data to geodatabaseStep 3. Use the new exported data feature class and input it into the colour model builderbut it is time consuming and I am receiving 25 file each day.Do you know which transformers can be used?here are a few important notes:the color for the component in GIS must be same as original dwg file The workspace need to be dynamic, which means every day the files need to be read from online datasets, from different locations. (I think I need to start with “Creator” ) The files are 3D in dwg and I need to have them 3D as well the dwg files are in NAD 1983 CSRS MTM 10 and before publishing to enterprise or pro it need to be converted to WGS 1984 Web Mercator (auxiliary spher

3211

10 months ago

stephen.bosse11Participant

asked in Transformers

Attempting to combine mulitple string replacements in attribute manager text editor

@ReplaceRegularExpression(@Value(DETAILS),<.+?>,,caseSensitive=FALSE), @ReplaceString(@Value(DETAILS),&qout;,",caseSensitive=TRUE) The first expression replaces any text in details attribute that is bracketed with <> to be deleted.the second expression replaces any instance where &qout; appears with “.These work fine as separate transformations, however when trying to lump them into a single statement in attribute manager’s text editor the transform fails.I’ve tried comma separating, spacing, and barring the functions, but have had no luck. Any suggestions on how to get this to run? Thanks!

1035

10 months ago

lukas108Contributor

asked in Transformers

Workspace Runner - space in file path

Hi. I run the workspace runner with the file path in user parameter. If there is a space (“ “) in the path, the parameter is loaded in a weird way: --DestDataset_ACAD {${=I:<backslash>Data<backslash>CAH<backslash>GAK<backslash>Data<backslash>GAK<backslash>FME-WorkSpace<backslash>09-Export<space>ZML<solidus>_final…But it works fine if I run original workspace. Is there some bug with Workspace runner?

584

10 months ago

chris_accContributor

asked in Transformers

Concatenate fields with comma but exclude if a field is empty

Hello,I am using the String Concatenator to join two fields and separate them with a comma.However some fields are blank so I end up with some records that contain a comma only and others that contain a comma and then the value of one of the fields.My current setup looks like belowgenerally works well, except for some results like theseIs it possible to modify existing Transformer or is a different one more suitable?My only other thought is to perform some sort of trim on an other transformer after this one to remove first character?Thank you

702

10 months ago

vxn43Supporter

asked in Transformers

Adding "name of person who uploaded file" to CSV file

I have a dozen files in a folder. I was able to use the Path Names Reader to write the File Name, Upload Date, Upload Time, and File Size to the CSV Writer. Does anyone know how, or if it is even possible, to get the name of the user who copied/uploaded a file into a folder? I see in the Pathname Reader the path_ownername attribute, but all this has in it is the value “Administrators”, no user name.

311

10 months ago

vxn43Supporter

asked in Transformers

Filters in Excel Sheet - how to create in FME Form?

I have a workspace that writes to a simple Excel sheet. The sheet has 3 columns: Report Name, Upload Date, and Upload Time.In Excel you can set a Filter for each column allowing a user to filter the data in that column. In Excel, I added a Filter to each column, but when I write to the sheet in FME Form, the Filters disappear. Is there a way to “keep” or “add” a Filter to each column in the sheet by tweaking a Writer parameter or is there another Transformer I need to add before the Writer? The screen capture below shows what I would like the sheet to look like:

1511

10 months ago

Page 32 / 509

Badge winners

ivanbakkerhas earned the badge Integrate Spatial Data
johanmarkshas earned the badge Integrate Spatial Data
kokilamhas earned the badge FME Form Basic Training
mahapandianhas earned the badge Teacher (Bronze)
karolhas earned the badge FME Certified Professional

Show all badges

30,353: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.