- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,682 Posts
50,735 Replies

When you subscribe we will email you when there is a new topic in this category

12682 Posts

Recently active

Most replies Most views Newest first

slade_bridges

asked in Transformers

Pass a shape to a reader to spatially select an sde feature so a large amount of data doesn't have to be read

i have a feature in the sde db that is 1.7M records, the data i am trying to select has a field i want the user to select from. the 1.7M records data set does not have that field so i want to select them spatially, which i am doing now, without all 1.7M records having to be read by the workbench. 1000 or so records to select takes about an hour due to the workbench reading all the records before the spatial selection happens. is there any way to pass my buffer results from the users selection to the reader in the envelope section of the reader before all the record are read?

1114

2 years ago

krishnamohan

asked in Transformers

Creating and enclosed polygon of the point data. Hi, I have a pole data connected to houses. I wanted to create an enclosed polygon with the pole and all its corresponding demand points. Can some one help. Attached is the requirement

158

2 years ago

reschContributor

asked in Transformers

Esri ArcGIS Portal Feature Service Writer - How i have to format date-values?

Hello, i have problems to write data with the Esri ArcGIS Portal Feature Service Writer.The writer is not able to write the date-values into the date-type-attribute. I've did research in the internet and tried a lot of different date-formats but nothing is working.I've also created a hosted feature layer in Portal for ArcGIS to see how the dates are written when i add features. I cloned that date-format in the workspace but this also failed. Is anyone out there who successfully wrote date-data with the Esri ArcGIS Portal Feature Service Writer or has an approach to solve the problem? I'm using Workbench 2020.2.0.0 (20201027 - Build 20787 - WIN64). Thank you very much! Greetings!

1583

2 years ago

gisgis

asked in Transformers

How do I multiply some string attribute values based on another number value ?

I need something like 3*bottle = bottle;bottle;bollte. First table is what I have and second what I need.

344

2 years ago

j.jeuschede

asked in Transformers

How do I properly convert a CityGML with instanced geometries to Cesium 3D Tiles?

I have created a 3D object that used as a geometry instance and placed at a set of point coordinates. My input was a citygml exported from an original sketchup model and a shapefile file for the points. I created a final citygml file combining those two with the instanced geometries. When I upload it to cesium ion as the citygml it works perfectly fine and cesium creates the tiles for me. Since I need the 3D Tile to use in my application, I then also tried to transform this citygml into a 3D Tile with FME. I simply used the 3D Tile writer. It works without errors and I also can upload it in Cesium ion and I don't get an error. However, when I try to use this 3D Tile in my Stories on Cesium Ion, I cannot see anything. My 3D objects do not show up. Does anyone have an idea what the problem might be? The citygml that I created seems to be perfectly fine and usable in cesium but the 3D Tile that I create with FME does not show anything in Cesium. I would really appreciate some help

932

2 years ago

chlaw2001Participant

asked in Transformers

Concatenate texts from two columns in text editor in attribute manager

Hi, I am new to FME. I would like to concatenate two columns into one by simply putting the names of the title of columns together in the text editor in attribute manager. It is always successful in 2018 but keep failing in 2022. The two columns are ordinary character type of data without any special characters like * or / etc. Thank you for the help!!!

1041

2 years ago

giuseppecfgeo

asked in Transformers

Hey community! How can I create DWG blocks with related attributes? I need to create topographic point blocks with various attributes, such as point number, point type and other attributes Thanks

422

2 years ago

xtian79Contributor

asked in Transformers

How to handle quotes in a Excel's sheet's name a generic reader

I have an excel file, it has a sheet with quotes inside its name:I created a workspace that includes a feature reader with the following configuration: and use an Attribute Creator transformer to pass the correct information about the file path and sheet name:When I run the workspace, I receive :Opening the GENERIC Reader on dataset `C:\Temp\problematic_excel.xlsx'Excel Reader: Output cell formulas: 'false'Excel Reader: Output cell formatting: 'false'Excel Reader: Output cell comments: 'false'Excel Reader: Force full datetime values: 'false'Excel Reader: Opening dataset 'C:\Temp\problematic_excel.xlsx'...Excel Reader: Reading sheet ''OSVAT-42"''...Excel Reader: Internal error: Could not find any sheets to readCreating reader for format: Generic (Any Format)Trying to find a DYNAMIC plugin for reader named `GENERIC'FME API version of module 'GENERIC' matches current internal version (3.8 20210203)Generic Reader: No valid reader name specified, guessing reader name from dataset 'C:\Temp\

381

2 years ago

franco69Contributor

asked in Transformers

Select first sheet in an Excel File

Hi Guys,for sure someone has aked this before but i didnt find an article.....it is a very simple questioni have to handle with a lot of excel sheets i have to select always the first sheet in any excel file.....but sometimes they have different namesso how can i select the first one.... Greetz and Cheers Franco

1226

2 years ago

joySupporter

asked in Transformers

How run the next transformation only when all features have gone trough the transformer beforehand?

I want to delete the input data in my script with the help of the Featurereade and the hub FileDeleter , but only when all features have been beforehand wrtitten to an export map in the FeatureWriter (see image below). So I don't want featurereader and the FileDeleter already running when not yet all files have been exported . I was wondering how that can be achieved in FME desktop? In case my question is a bit vague, just let know.

2 years ago

gerard

asked in Transformers

Merging SHP located in different directories

I have one shapefile with polygons representing a cartographic sheets at some scale. Each polygon has an unique identifier (IDn). I have used SpatialRelator transformer (see attached image) to look for neighbor sheets for each of them, and ListConcatenator to save for each polygon the list of neighbor polygons identifiers. The attached example shows that selected polygon (ID0) has 3 neighbor polygons (ID1,ID2,ID3). The IDn is the identifier included in the shapefile name located in some directory following this pattern: .\\IDn\\*IDn*.shpI have to merge the 4 shp corresponding to ID0, ID1, ID2, ID3 to output only one shapefile. I have used Directory and File Pathnames READER in other context but here I don't know how to look for these files. Maybe using WorkspaceRunner or PythonCaller? Please, could you give some advice? Thank you in advance!

2 years ago

rclarkenzContributor

asked in Transformers

Can I make the WMTS Reader stream rather than download tiles?

We're experiencing issues accessing raster data through WMTS from a particular provider. After discussing with the provider what the issue could be they said that seeing FME is downloading all the tiles rather than streaming them, it places a massive request so it is blocked.Is there a way to make FME stream rather than download?

8612

2 years ago

chris28

asked in Transformers

Update table - SDE Geodatabase

I have a ESRI SDE Geodatabase that was created using an identity field. So, to update the table I am using the Microsoft SQL Server Non-Spatial Writer. For some reason though it won't update the table. The table parameters I have are as follows:Feature Operation: UpdateTable Handling: Use ExistingWhere Clause: **Set to the unique fields necessary**Insert into identity column: Yes Is there anything else that needs to be set to update a record?

1255

2 years ago

bschweiger

asked in Transformers

Surface Normal of citygml roof surfaces

Hello,I am loading citygml data with the OGC Citygml Reader and afterwards I want to calculate the normal vector of each roof surface.How can this be done in FME for a big data set? Using the SurfaceNormalExtractor I get some errors that result in stopping the calculation. After sorting out that surface I have to restart the reader and the surface normal extractor. Is there a better workaround?Thank you for your help in advance!

817

2 years ago

bubblebebContributor

asked in Transformers

More efficient aggregation

I have a dataset with 29m polygons some of which have the same attribute (say Key ID). I need to aggregate them by the Key ID but the dataset is not ordered. After nearly 12 hours of run time it has only aggregated 1.1m features. I need to find a better way of aggregating. Any ideas? The data is being read from about 10 shapefiles as the source data. I have access to Postgis if that would help.

737

2 years ago

gisgis

asked in Transformers

How to label some line features on HTML file generated by "HTMLReportGenerator" ?

I am trying to find out if there is a way to label some line features (lets say some streets or rivers) so that when I write HTML file to see directly these labels (like we label features in any GIS Platform e.g. ArcGIS). My solution so far (look the image below but I am not very happy with it): I used "Labeller" Transformer and then "TextStroker" but not very hapy since text stroker gives text outlines which is not very nice to see and therefore I dont have a lot of control over font style, font size etc. Any Idea ? I am using FME 2022.0.0.1.

2 years ago

asked in Transformers

FME Server 2019 Error: The log file for job ID "2613" does not exist

I've search quite a bit and can't seem to find an answer. Why would a log file not get created? If anyone has any ideas, I'd appreciate it. -Kurt

34412

2 years ago

jasperwisEnthusiast

asked in Transformers

WorkspaceRunner in Custom Transformer: wait untill all results are ready

Hi, A question closely related to this older post: https://community.safe.com/s/question/0D54Q000080hE6vSAE/workspacerunner-how-to-catch-all-items-created?t=1657893646062 I have placed a WorkspaceRunner in a Custom Transformer. The WorkspaceRunner is set to Wait for Job to Complete. With the suggestion from the older post, I have placed it in a custom transformer so it can run multiple jobs in parallel but still is able to wait untill jobs are completed. Parallellism is set to Moderate, so 7 threads can be used on my machine. I can see the first 'batch' of 7 results being send out of the custom transformer. Later I can see the next 7 results being send out. But immediately after, it's not longer waiting for the other 115 Jobs to finish and continues. I have tried to prevent this by using a FeatureHolder and a Sampler (Last), but no result. Flow should only continue after finishing all 129 features. Any ideas? In the older post there was a Python suggestion of @Takashi Iiji

180

2 years ago

eric_armitageContributor

asked in Transformers

How do I read the coordinate reference system in a DGN file?

I have DGN file. In Microstation I can see that it had a defined GCS (ETRS89 / UTM zone 32N) When I read the file with FME the coordinate system is not recognised. How do I get FME to read the GCS details?

2105

2 years ago

ozuritah

asked in Transformers

Shared Border Lengths Between Polygons

Hi,I have a shapefile with municipality polygons and I am using the SpatialRelator with the option "Requestor Touches Supplier" to count the number of neighbours of each polygon. However, I need to know the lenght of each common border for all polygons. Is there a way to output that information? In QGIS is posible (as explained on this link https://spatialthoughts.com/2020/04/08/calculating-shared-border-lengths/#more-962 ) but it's not very fast to run, therefore I would like to do the same in FME.Thanks and best regardsOscar

1297

2 years ago

nicholasContributor

asked in Transformers

NetCDF writer: Failed to end definition. The error was 'NetCDF: One or more variable sizes violate format constraints'

I want to mosaick 188 netCDF files into a single netCDF file. I get the errorNetCDF writer: Failed to end definition. The error was 'NetCDF: One or more variable sizes violate format constraints'The data is a DEM, so only one band which is elevation.I have attempted both "Classic" and "64-bit Offset" ParameterWhat am I doing wrong?

2198

2 years ago

rokop

asked in Transformers

Rcaller Output having issues with a list of output attributes

Hi,I want to run some Rscript and so installed an R-interpreter and installed some Libraries. As a test case I downloaded the workspace from a rather old article "RCaller: Ins and outs of using R in FME". The workspace is from 2020 though so i ran it on both 2019 and 2021 versions but it returned the same error in both cases. Actually the exact same error as mentioned in the article itself: "Failed with exit code 1 when executing R script. Output was: Loading required package: gsubfn.......". Now the article mentions to check spelling but as the workspace is an exact copy from safe I expect that to be tested and ok and furthermore that is just not the issue as the line "fmeOutput<-data.frame(meanEst,meanAct, r2, m, k)" in the Rcaller works just fine if I just pick one of the columns for output, irrespective which one. e.g. "fmeOutput<-data.frame(r2)" But the moment I comma separate a few data frame columns for output I get the error.Any hel

709

2 years ago

olivierContributor

asked in Transformers

How can I simulate GDAL's "Offset from zero relative to which to interpret intervals" parameter using FME Workbench for contour generation?

Hi, I am creating contour lines and contour polygons from a raster geotiff file with 50m intervals. In lowland areas near the sea a lot of tiny lines/polygons are created wherever the elevation fluctuates around value 0-m. GDAL has a parameter (Offset from zero relative to which to interpret intervals) which allows setting an offset so as to reflect only significant low elevations (by setting it to -5 for instance). However this parameter is not present in the ContourGenerator transformer of FME.Can you think of a workaround for simulating such behavior? Otherwise is it easy to call the GDAL function from within FME?Thank you! Best regards, Olivier

302

2 years ago

oihdosjContributor

asked in Transformers

Can you set an shapefile writer to use a dynamic schema definition from a generic feature reader?

I have a workbench that takes a zip file as a user input and checks if it contains a shapfile. If it does, it goes to a FeatureReader and then on to a shapefile writer. I have tried every setting I can, but I can't get it to generate an output shapefile if the shapefile writer is set to use a Dynamic Schema Definition Am I missing something, or is this just not possible? The log says the workbench ran successfully, but no shapefile was created: > Translation was SUCCESSFUL with 9 warning(s) (353 feature(s) output)>FME Session Duration: 3.1 seconds. (CPU: 0.6s user, 0.8s system)>END - ProcessID: 940, peak process memory usage: 116280 kB, current process memory usage: 111672 kB>Translation was SUCCESSFUL Ultimately, I'd like to publish an enhanced version of this to FME Server and create an app so that colleagues can upload zipped shapefiles and have convert their data to different coordinate system. I'm running FME Desktop/Server 2021.2. Thanks, Dave

762

2 years ago

townestContributor

asked in Transformers

Update output attributes of the Feature Reader transformer

Greetings,I have a Feature Reader transformer, reading a list of dwgs. Sometime after I initially created the Feature Reader I needed to expose additional attributes, and so did by adding to this list......however, the newly exposed attributes are not showing up in my output ports. I'm not seeing the Feature Reader in the 'Update Readers' command, so am not sure exactly how to get the newly exposed attributes exposed. Any pointers would be appreciated.TylerFME WorkBench 2021

252

2 years ago

Page 107 / 508

Badge winners

xiaomengatsafehas earned the badge Welcome Back
acookehas earned the badge Integrate Spatial Data
eskelinensarahas earned the badge FME Form Basic Training
rwnewcshas earned the badge Welcome Back
rwnewcshas earned the badge FME Form Basic Training

Show all badges

30,162: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.