Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 12,682 Posts
  • 50,741 Replies
12682 Posts
arash_hokm
Contributor
arash_hokmContributor
asked in Transformers
Delete heading in CSV file

Hi FME Community,I have converted my Excel file into a CSV file. I would like the heading to be automatically deleted.In the picture I have shown with red marking which part has to be deletedI would be grateful if you could tell me whether there is a solution.Thanks in advance

202
arash_hokm
Contributor
3 years ago
arnovananrooij
Contributor
arnovananrooijContributor
asked in Transformers
Scripted python parameter value changes when feature caching is on

Hi,I have a scripted python parameter which generates a unique id. This parameter is used in a lot of SQLexecuters to to create and insert into temporary with this id in the name of the table and such. When I run the workspace it works fine, but when I put feature caching on the value of the parameter seems to change each time it's used in a SQLExecuter. Is this a knwn issue? Is there a simple work around?I use FME 2021.1.3.0. I don't know if it worked before. Thank you,Arno

43
arnovananrooij
Contributor
3 years ago
Z
zacharylee1204
asked in Transformers
How to find a missing value in a range of data

Hello, so I want to find a missing value as all the "Unit" must be in sequence in each floor.​Here are my rules:All the units should be assigned sequentially to the corresponding floor, meaning 1/F: Unit = 0001, 0002, 0003, till to the largest number in the data2/F: Unit = 0001, 0002, 0003, till to the largest number in the data​I have "FloorNo_FromFloorPolyID", meaning the level of floors."Test_Unit_No" meaning the numbering of the unit.​I want to find out the missing unit number of each floor as the input data will have a lot of floors in the future. As the sample shown below, Floor 10 is missing Unit 0001 to 0004.​Could someone please give me a hand. Should I use python caller? Yet I have no clue how to write script ... please help.​Thank you in advanced.

361
jkr_wrk
Influencer
3 years ago
I
ikubra800
asked in Transformers
How convert to complex XML to creating relational database tables ? using xml hieararchy

How convert to complex XML to creating relational database tables ? using xml hieararchy

111
jkr_wrk
Influencer
3 years ago
I
ikubra800
asked in Transformers
Convert complex XML to creating relational database tables ?

I have xml file and convert relatinal database tables for using xml hierarchy(parent-child) so is there any automation tool for this process ?

100
I
3 years ago
aryalahasa04
Contributor
aryalahasa04Contributor
asked in Transformers
How to expose attributes of a layer of CAD?

Hi all!My CAD layer is a mapimport from shapefile. So, it basically still has attributes when I converted to a layer with point type. When I wanted to export again to shapefile through FME, I don't know how to retain those attributes.  In CAD, actually you can use MAPEXPORT to retain attributes, but then it will be time-consuming if you need to export one by one when you have many.  So guys, do you have a solution for me to solve this problem? Thanks in advance!

1013
nielsgerrits
VIP
3 years ago
tdun
Contributor
tdunContributor
asked in Transformers
How can I update attributes based on a SQL query?

Hi all,I have a CSV which I read into FME desktop. It is bore hole data with attributes:site: Adepth: 0depth: 20depth: 30end depth: 35 I want to select the max(depth) for each 'site' and update that value to be 'end depth', then proceed with other transformations. Note sure what transformer to use to do this?I've looked at Tester, inlinequerier...help ? thanks

292
tdun
Contributor
3 years ago
Z
zacharylee1204
asked in Transformers
How to group all the transformer into one single transformer

Hello everyone,​So I want to do something similar to "IMDF Validator".​My data format is "GeoJSON" in one single file. When I import the data, it will break into 4 feature types. ​I just not sure how to set up something similar to IMDF validator, with "Creator" at the front (just like the picture I uploaded? Also, the user parameter of IMDF validator is set default in ZIP file, yet I have to set it to geojson file.​Should I use Create Custom Transformer? But I am not sure how to set the parameter. It is because my data will be getting more and more complicated. I have to make it more tidy first.​Thank you in advanced. Zach

73
Z
3 years ago
stearnsweaver
Participant
stearnsweaverParticipant
asked in Transformers
Troubleshoot SchemaMapper transformer setup

I'm trying to import a text file without headers to FILEGDB while using the SchemaMapper Transformer to rename the columns. I've followed tutorials and articles but am not successful. Columns aren't being renamed and when I run the workspace no features are written.Any tips would be greatly appreciated. Here are screenshots of my parameters and workspace: Schema Map (CSV):SourceAttribute,DestinationAttributecol0,TYPEcol1,STRAPcol2,SECTIONcol3,TOWNSHIPcol4,RANGEcol5,MAP_IDcol6,CONF_FLGcol7,ADDR_1col8,ADDR_2col9,CITYcol10,STATEcol11,ZIPcol12,DOR_CDcol13,SUBcol14,DSCRcol15,PLAT_BKcol16,PLAT_PGcol17,NH_CDcol18,PCT_SOHcol19,INC_FLGcol20,BASE_YRcol21,ASD_VALcol22,SOH_VALcol23,BLD_VALcol24,JST_VALcol25,TAX_DISTcol26,TAX_DISTcol27,TAX DISTcol28,MILL_CDcol29,SQFTcol30,ACREAGE

243
stearnsweaver
Participant
3 years ago
L
l.tilson
asked in Transformers
Wanting to replace data in multiple attributes to multiple strings of text. Is there a transformer that I can use for this?

So I have multiple columns of data that return a yes or no value. I'm really only concerned with the yes value.  When the value in the Cut Grass attribute is 'Yes' - i want to replace the Yes with say "cut grass to 100mm"Then i have another Yes value in Remove Flammable materials column and I want to replace the Yes with "remove materials".  Is there a multiple string replacer transformer that I can use.  I need to do this for approx 13 different attributes. I have read about string replacer or attribute value mapper. But whilst string replacer can replace multiple attributes to the same replacement text it doesn't allow for differing replacement text individual to a column.

2055
mark2atsafe
Safer
3 years ago
townest
Contributor
townestContributor
asked in Transformers
FME Python API error writing to Tableau HYPER file

I have set up a python script to run a workspace through the FME Python API using FMEWorkspaceRunner. Python is throwing an error called 'FMEException: 1: Failure running workspace "<my path.fmw>" '. I did some troubleshooting by removing the HYPER writer and replacing with a csv writer, then a gdb writer. Both of those writers worked fine. Also, the workspace works fine without going through the API. Something about the HYPER and the API. Any suggestions or known issues? Thank you, TylerFME 2021Python 3.7

125
danminneyatsaf
Safer
3 years ago
R
robeesafe
asked in Transformers
I have time-series data collected at 5 minutes intervals and I would like to summarize or average it to the daily interval. How do I go about it in FME? Thanks

I have time-series data collected at 5 minutes intervals and I would like to summarize or average it to the daily interval. How do I go about it in FME? Thanks

72
R
3 years ago
M
michaeld
asked in Transformers
Bulk attribute renaming after Feature Reader using FR <SCHEMA"> feature type??? (FME Workbench 2018.1)

Hi all. I'm reading five feature types from Oracle using a Feature Reader and I want to suffix each of the attributes in each feature type with a text string.  The reason for this is that I'm running some line on line and line on area transformers and the attributes from each feature type have identical names. The end goal is to generate a dynamic schema (with renamed attributes) on the output tables based on merged feature types from the transformers mentioned above. Is the bulk attribute remover the correct transformer to be using here? Thanks,Michael What have I missed?

173
kailinatsafe
Safer
3 years ago
mr_fme
Enthusiast
mr_fmeEnthusiast
asked in Transformers
How to validate if number is pair or odd?

Hi, I need to validade if the sum of the numbers is pair or odd. How to make this?

992
A
3 years ago
arash_hokm
Contributor
arash_hokmContributor
asked in Transformers
Reprojector

Hi FME Community,I would like to reproject my file into another coordinate system. I am looking for correct coordinate system. ArcMap gives me a correct result. FME gives me wrong coordinate after the reprojector.the pictures show which coordinate systems I used in FME and ArcMap. In addition, my file belongs to Germany. Thanks a lot in advance   

143
arash_hokm
Contributor
3 years ago
paalped
Contributor
paalpedContributor
asked in Transformers
How can I use asyncio in Python-Caller/Creator?

I wonder if aynone has expericence with using asyncio in python FME?I've been trying to decorate with some asyncio.coroutine and do some async def, but I cannot grasp the whole picture on how to combine a syncronized FME project with an async library like asyncio.Anyone who would share their knowledge on this topic would be Awsome!Paal

2412
paalped
Contributor
3 years ago
I
ikubra800
asked in Transformers
How associate two tables with using xml_id's (unique id) ?

Table1:table1_id:id-element-1.2.1.1.3(xml_id)id-element-1.2.1.1.4(xml_id)id-element-1.2.1.1.5(xml_id) Table2table2_id:id-element2-1.2.1.1.3.1(xml_id)id-element2-1.2.1.1.3.2(xml_id)id-element2-1.2.1.1.4.1(xml_id)id-element2-1.2.1.1.5.1(xml_id) I want this result:Table3:table1_id table2_id ..3 ..3.1 ..3 ..3.2 ..4 ..4.1 ..5 ..5.1 Thanks   

31
muzhnasto
Contributor
3 years ago
R
richard_che
asked in Transformers
How to add distance as Z value in polyline dataset?

Hi I have a polyline dataset with X,Y values but the Z field is empty. I'd like to generate the accumulating distance of each polyline vertex as the Z field. Essentially I'd like to just add distance as the Z value.

61
muzhnasto
Contributor
3 years ago
G
garethgis
asked in Transformers
I am new to the i3s ESRI format and am wondering if there is a workflow or transformer or set of steps you need to take to convert OBJ to i3s?

I am new to the i3s ESRI format and am wondering if there is a workflow or transformer or set of steps you need to take to convert OBJ to i3s?

491
muzhnasto
Contributor
3 years ago
C
clowncutie
asked in Transformers
Handle where server app service is saving data.

similar post which describes better but there is no actual answer where /how to choose where data is saved on server. I dont mean the zip that works already I mean control where the files that user uploads will be saved.  Is it possible to control where the Server App download service will download files? (safe.com) Using FME Data Streaming, the user selects one or multiple files to upload, processes those files and it works so the resulting report is downloaded through a zip. My problem is now what if there are multiple runs at the same time? I managed to use the FME_JOB_ID to create subfolders with my logs. for examplein my fme_server_data_reposatory however all files are always uploaded in some weird temporary guid folder.If I use "upload" files in my app, how can I choose where those "temporary files" should be saved? I then want my job submitter to use those folders to look for the data. This is to separate so the result logs for different runs doesnt read the

400
C
3 years ago
parashari
parashari
asked in Transformers
Create an average/mean line from points

I don't know if this is already answered somewhere already but couldn't find it.This is in regards to my previous thread about aligning randomly distributed line geometry as per building footprints. Now, I could find GPS traces as point data to align my line geometry as per the points.In the image below: The black line is the approximate required solutionI tried using NeighbourFinder with 3m distance and then MeasureSetter for putting weights. Ideally, I wanted that points towards the center are weighted more than the outer ones. I have attached some sample data for the same. Could someone help me out with any ideas?Thanks.

15411
M
3 years ago
aron
Contributor
aronContributor
asked in Transformers
Cull (thin/simplify) points from groups?

I have groups of points (2D centroids) that I want to declutter by removing points so that there is a minimum distance between the remaining points whilst retaining the overall "shape" of each group.  The PointCloudSimplifier seems to do this, but is there an alternative for 2d objects? If not, is there a way to convert regular ol' points to fancy point clouds? Or is there an another, better, way to achieve the desired result?

71
virtualcitymatt
Evangelist
3 years ago
coldon
Contributor
coldonContributor
asked in Transformers
Truncate table before insert

I am trying to do an insert to CARTO table. It is mandatory to not drop the table because it is necessary anytime a table is created to make a specific SQL statement. This table just has to have the last insert values so a truncate command is required. I have tried with a SQL Executor with two statements. Truncate and Insert. What SQL Executor does is a truncate for every insert. At the end I have a table with only one row, the last value inserted. Any ideas?

2132
coldon
Contributor
3 years ago
Y
youseem
asked in Transformers
When I use the .hyper writer, I receive an error, when I use the .tde writer, no problems

The error I am receiving just says: Error running translation. Thoughts?

102
tara_he
Contributor
3 years ago
D
dave_on716
asked in Transformers
How to use overlapping clippers without data loss

perhaps the easiest way ahead is to explain the bigger picture of what I am trying to achieve. I want to produce individual location maps and block plans for about 30,000 properties. Each plan would be centered its dedicated property but show some detail of neighboring houses and roads etc. I am trying to use the clipper (using buffered property land parcels as the clipper) to clip a base map. Obviously the clippers overlap. The way the clipper works, each clipper takes a bite through the base map, and outputs the result. This means that some properties have many bite chunks removed from their data and their output is incomplete. Ive used FME for over 20 years, but I me not a techy programmer. Ideally the Clipper transformer would have tick box option that says 'retain input clippees for multiple processing' or something....... All suggestions welcome. Regards Dave     

516
M
3 years ago

Badge winners

  • Welcome Back
    jeovishas earned the badge Welcome Back
  • Welcome Back
    bill_sullivanhas earned the badge Welcome Back
  • Socializer (Storyteller)
    marcusthas earned the badge Socializer (Storyteller)
  • Welcome Back
    canerakinhas earned the badge Welcome Back
  • Welcome Back
    mmestrovhas earned the badge Welcome Back
Show all badges
30,176
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.