Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,709 Replies
10000 Posts
lindsay
Contributor
lindsayContributor
asked in Transformers
Best method to resample, mosaic, and then tile large amount of raster files?

Hi,The problem I'm trying to solve is as follows:I have about 2,000 aerial imagery ECW files, averaging in size around 30MB (so around 60GB in total).Each of the files cover 1km x 1km on the ground at a resolution of 10cm, so are 10,000px x 10,000px.I have been asked to downsample each file to 2,048px x 2,048px and output the results as a series of 4km x 4km tiles (each tile being 8,192px x 8,192px).I have an index feature class that lists each 'FileName' and its corresponding 'Tile' attribute.I've attached an image that shows this spatially, below.Large black squares and number labels represent the tiles that I want to output. The coloured squares with red outlines represent the original files.Previously, when working with a much smaller amount of data, I've been able to use my index feature class, in conjunction with a StringConcatenater, to provide the full path of each file to an 'ER Mapper ECW' FeatureReader.From there, I used RasterResampler an

2480
lindsay
Contributor
lorinda
Contributor
lorindaContributor
asked in Transformers
Workspace runs with service account in Desktop but not completely in FME Server

Have two workspaces that when I run it under my account or the service account on the server, it runs fine, published to FME Server and set up automation. It APPEARS to run (one workspace checks for the latest zip file in a directory on a file share and then copies to the resources directory and unzips on the server - this works as it should under both accounts and in FME server when run separately thru Run Workspace). The second workspace is to process the data that was unzipped and place in the resources directory - the files are separated into two directories due to how the vendor supplies the data for download - the script will read this data via either account. It will operate as expected when run with Workbench. Running via Server it processes, but when I look at the output data, not all of it is there! The csv files appear to be appending to the tables in the SDE. The graphic data doesn't even show that it attempted to write to the feature class. I'm stumped. The graph

300
lorinda
Contributor
I
ikubra800
asked in Transformers
How can I get parent_id in xml for creating database tables ? (I used FeatureReader,XMLFragmenter and etc. but I cannot get xml_parent_id)

110
I
birgit
Influencer
birgitInfluencer
asked in Transformers
Autodesk BIM360 Docs Connector transformer cannot download file to a location specified in a feature attribute value

Hi everyone, I am trying to download a set of files with the AutodeskBIM360DocsConnector and save them to a temporary location. The temp location is generated with the TempPathCreator. The BIM 360 connector does not have the option to pick an attribute for the "Download to Folder" parameter. Typing out @Value(DownloadLocation) seems to trigger FME to recognize that I want to use an attribute value, however during translation the attribute value is ignored and instead FME uses the string I typed in i.e. it creates a map named "@Value(DownloadFolder)".   

340
birgit
Influencer
L
lidiad
asked in Transformers
String Replacer - find symbol or letter or number followed by Capital Letter and insert a space

I have text where spaces between some words is missing. These spots are easy to find with regex because it is always something following by capital letter without the space. I can't workout how to add the space though. My String Replacer looks like this: @ReplaceRegEx(@Value(Speciality),([^ ])([A-Z]), \\1, \\2) The output it produces is:Anxiety, Panic & Phobia shildren & Adolescent selationships Outside work (ndividual counselling )eadership Original:Anxiety, Panic & PhobiasChildren & AdolescentsRelationships Outside work (Individual counselling)Leadership So it adds space, just not where I need it and removes the capital letter. I tried many variations, but none of them produces the needed outcome. 

914
L
S
sgsc
asked in Transformers
Is there a way to gracefully terminate a looping Custom Transformer?

My flow includes a looping Custom Transformer that gets records from a paginated API until there are no records left to get - unfortunately the API doesn't have a "last page" flag or anything, so the only way to check that the flow should end is to keep trying until we get a 400 Bad Request status code with a message like "Request out of range". When this happens, the loop should break and output all the features that have been created up to that point. At the moment, the only way I can get this to break is with a Terminator, which is (a) making the flow look like it failed, and (b) not allowing me to continue with the next steps of generating a HTML report. Is there a more graceful way to exit a loop? The transformer looks like this:The relevant part in the flow itself looks like this. The Tester is doing exactly what it's supposed to, but it doesn't seem to be reaching the HTMLReportGenerator.

1420
hkingsbury
Celebrity
arash_hokm
Contributor
arash_hokmContributor
asked in Transformers
Delete heading in CSV file

Hi FME Community,I have converted my Excel file into a CSV file. I would like the heading to be automatically deleted.In the picture I have shown with red marking which part has to be deletedI would be grateful if you could tell me whether there is a solution.Thanks in advance

260
arash_hokm
Contributor
arnovananrooij
Contributor
arnovananrooijContributor
asked in Transformers
Scripted python parameter value changes when feature caching is on

Hi,I have a scripted python parameter which generates a unique id. This parameter is used in a lot of SQLexecuters to to create and insert into temporary with this id in the name of the table and such. When I run the workspace it works fine, but when I put feature caching on the value of the parameter seems to change each time it's used in a SQLExecuter. Is this a knwn issue? Is there a simple work around?I use FME 2021.1.3.0. I don't know if it worked before. Thank you,Arno

50
arnovananrooij
Contributor
Z
zacharylee1204
asked in Transformers
How to find a missing value in a range of data

Hello, so I want to find a missing value as all the "Unit" must be in sequence in each floor.​Here are my rules:All the units should be assigned sequentially to the corresponding floor, meaning 1/F: Unit = 0001, 0002, 0003, till to the largest number in the data2/F: Unit = 0001, 0002, 0003, till to the largest number in the data​I have "FloorNo_FromFloorPolyID", meaning the level of floors."Test_Unit_No" meaning the numbering of the unit.​I want to find out the missing unit number of each floor as the input data will have a lot of floors in the future. As the sample shown below, Floor 10 is missing Unit 0001 to 0004.​Could someone please give me a hand. Should I use python caller? Yet I have no clue how to write script ... please help.​Thank you in advanced.

700
jkr_wrk
Influencer
I
ikubra800
asked in Transformers
How convert to complex XML to creating relational database tables ? using xml hieararchy

How convert to complex XML to creating relational database tables ? using xml hieararchy

150
jkr_wrk
Influencer
I
ikubra800
asked in Transformers
Convert complex XML to creating relational database tables ?

I have xml file and convert relatinal database tables for using xml hierarchy(parent-child) so is there any automation tool for this process ?

120
I
aryalahasa04
Contributor
aryalahasa04Contributor
asked in Transformers
How to expose attributes of a layer of CAD?

Hi all!My CAD layer is a mapimport from shapefile. So, it basically still has attributes when I converted to a layer with point type. When I wanted to export again to shapefile through FME, I don't know how to retain those attributes.  In CAD, actually you can use MAPEXPORT to retain attributes, but then it will be time-consuming if you need to export one by one when you have many.  So guys, do you have a solution for me to solve this problem? Thanks in advance!

1770
nielsgerrits
VIP
tdun
Contributor
tdunContributor
asked in Transformers
How can I update attributes based on a SQL query?

Hi all,I have a CSV which I read into FME desktop. It is bore hole data with attributes:site: Adepth: 0depth: 20depth: 30end depth: 35 I want to select the max(depth) for each 'site' and update that value to be 'end depth', then proceed with other transformations. Note sure what transformer to use to do this?I've looked at Tester, inlinequerier...help ? thanks

460
tdun
Contributor
Z
zacharylee1204
asked in Transformers
How to group all the transformer into one single transformer

Hello everyone,​So I want to do something similar to "IMDF Validator".​My data format is "GeoJSON" in one single file. When I import the data, it will break into 4 feature types. ​I just not sure how to set up something similar to IMDF validator, with "Creator" at the front (just like the picture I uploaded? Also, the user parameter of IMDF validator is set default in ZIP file, yet I have to set it to geojson file.​Should I use Create Custom Transformer? But I am not sure how to set the parameter. It is because my data will be getting more and more complicated. I have to make it more tidy first.​Thank you in advanced. Zach

160
Z
stearnsweaver
Contributor
stearnsweaverContributor
asked in Transformers
Troubleshoot SchemaMapper transformer setup

I'm trying to import a text file without headers to FILEGDB while using the SchemaMapper Transformer to rename the columns. I've followed tutorials and articles but am not successful. Columns aren't being renamed and when I run the workspace no features are written.Any tips would be greatly appreciated. Here are screenshots of my parameters and workspace: Schema Map (CSV):SourceAttribute,DestinationAttributecol0,TYPEcol1,STRAPcol2,SECTIONcol3,TOWNSHIPcol4,RANGEcol5,MAP_IDcol6,CONF_FLGcol7,ADDR_1col8,ADDR_2col9,CITYcol10,STATEcol11,ZIPcol12,DOR_CDcol13,SUBcol14,DSCRcol15,PLAT_BKcol16,PLAT_PGcol17,NH_CDcol18,PCT_SOHcol19,INC_FLGcol20,BASE_YRcol21,ASD_VALcol22,SOH_VALcol23,BLD_VALcol24,JST_VALcol25,TAX_DISTcol26,TAX_DISTcol27,TAX DISTcol28,MILL_CDcol29,SQFTcol30,ACREAGE

410
stearnsweaver
Contributor
L
l.tilson
asked in Transformers
Wanting to replace data in multiple attributes to multiple strings of text. Is there a transformer that I can use for this?

So I have multiple columns of data that return a yes or no value. I'm really only concerned with the yes value.  When the value in the Cut Grass attribute is 'Yes' - i want to replace the Yes with say "cut grass to 100mm"Then i have another Yes value in Remove Flammable materials column and I want to replace the Yes with "remove materials".  Is there a multiple string replacer transformer that I can use.  I need to do this for approx 13 different attributes. I have read about string replacer or attribute value mapper. But whilst string replacer can replace multiple attributes to the same replacement text it doesn't allow for differing replacement text individual to a column.

4165
mark2atsafe
Safer
townest
Contributor
townestContributor
asked in Transformers
FME Python API error writing to Tableau HYPER file

I have set up a python script to run a workspace through the FME Python API using FMEWorkspaceRunner. Python is throwing an error called 'FMEException: 1: Failure running workspace "<my path.fmw>" '. I did some troubleshooting by removing the HYPER writer and replacing with a csv writer, then a gdb writer. Both of those writers worked fine. Also, the workspace works fine without going through the API. Something about the HYPER and the API. Any suggestions or known issues? Thank you, TylerFME 2021Python 3.7

185
danminneyatsaf
Safer
R
robeesafe
asked in Transformers
I have time-series data collected at 5 minutes intervals and I would like to summarize or average it to the daily interval. How do I go about it in FME? Thanks

I have time-series data collected at 5 minutes intervals and I would like to summarize or average it to the daily interval. How do I go about it in FME? Thanks

90
R
M
michaeld
asked in Transformers
Bulk attribute renaming after Feature Reader using FR <SCHEMA"> feature type??? (FME Workbench 2018.1)

Hi all. I'm reading five feature types from Oracle using a Feature Reader and I want to suffix each of the attributes in each feature type with a text string.  The reason for this is that I'm running some line on line and line on area transformers and the attributes from each feature type have identical names. The end goal is to generate a dynamic schema (with renamed attributes) on the output tables based on merged feature types from the transformers mentioned above. Is the bulk attribute remover the correct transformer to be using here? Thanks,Michael What have I missed?

330
kailinatsafe
Safer
mr_fme
Enthusiast
mr_fmeEnthusiast
asked in Transformers
How to validate if number is pair or odd?

Hi, I need to validade if the sum of the numbers is pair or odd. How to make this?

1790
A
arash_hokm
Contributor
arash_hokmContributor
asked in Transformers
Reprojector

Hi FME Community,I would like to reproject my file into another coordinate system. I am looking for correct coordinate system. ArcMap gives me a correct result. FME gives me wrong coordinate after the reprojector.the pictures show which coordinate systems I used in FME and ArcMap. In addition, my file belongs to Germany. Thanks a lot in advance   

170
arash_hokm
Contributor
paalped
Contributor
paalpedContributor
asked in Transformers
How can I use asyncio in Python-Caller/Creator?

I wonder if aynone has expericence with using asyncio in python FME?I've been trying to decorate with some asyncio.coroutine and do some async def, but I cannot grasp the whole picture on how to combine a syncronized FME project with an async library like asyncio.Anyone who would share their knowledge on this topic would be Awsome!Paal

350
paalped
Contributor
I
ikubra800
asked in Transformers
How associate two tables with using xml_id's (unique id) ?

Table1:table1_id:id-element-1.2.1.1.3(xml_id)id-element-1.2.1.1.4(xml_id)id-element-1.2.1.1.5(xml_id) Table2table2_id:id-element2-1.2.1.1.3.1(xml_id)id-element2-1.2.1.1.3.2(xml_id)id-element2-1.2.1.1.4.1(xml_id)id-element2-1.2.1.1.5.1(xml_id) I want this result:Table3:table1_id table2_id ..3 ..3.1 ..3 ..3.2 ..4 ..4.1 ..5 ..5.1 Thanks   

40
muzhnasto
Contributor
R
richard_che
asked in Transformers
How to add distance as Z value in polyline dataset?

Hi I have a polyline dataset with X,Y values but the Z field is empty. I'd like to generate the accumulating distance of each polyline vertex as the Z field. Essentially I'd like to just add distance as the Z value.

60
muzhnasto
Contributor
G
garethgis
asked in Transformers
I am new to the i3s ESRI format and am wondering if there is a workflow or transformer or set of steps you need to take to convert OBJ to i3s?

I am new to the i3s ESRI format and am wondering if there is a workflow or transformer or set of steps you need to take to convert OBJ to i3s?

880
muzhnasto
Contributor

Badge Winners

  • Integrate Data with the FME Platform Training
    johnrochehas earned the badge Integrate Data with the FME Platform Training
  • Student (Grey)
    westerbrinkhas earned the badge Student (Grey)
  • Teacher (Grey)
    westerbrinkhas earned the badge Teacher (Grey)
  • Student (Grey)
    artec186has earned the badge Student (Grey)
  • Teacher (Grey)
    artec186has earned the badge Teacher (Grey)
Show all badges

Community Stats

31,797
Posts
120,787
Replies
39,413
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.