Transformers

Hi FMEler, I got stuck with my FME workspace in the FME Cloud. Maybe @david_r can help me :-) Starting position: We got a Worskpace developed in 2014, upgraded to version 2016. Source is an INTERLIS1 file with a CSV file and some text parameters. The workspace is calculating, sorting, blending areas and so on. The ouput is an INTERLIS2 file (*.xtf) and a text file with some logs. Within the desktop environment everything is working fine. Stopover: We published this workspace to an FME Server instance which we host together with another company. Here, everything is working fine as well. The results are the same. Breakpoint: Now I want to try out the FME Cloud. I launched an instance with a 2016 version, published and ran the workspace. The results are different. The amount of objects are the same. But there are at least some coordinates and TIDs (a primary key for INTERLIS files) missing. I didn't check the log files in detail yet, but I guess it's a reader/writer-problem. My questions:

Hi I'm using FME WorkBench 2017 and I want to use the pythoncaller to replace the cell values of multiple raster features with list values of an equivalent size. The input raster features are: 1. different-sized clips of a larger raster 2. in ASCII format, 3. and have a background value of zero. For each raster, I want to replace raster cell values greater than zero with values from an associated list, where this list is the same size as all the non-zero values of each raster. I'm new to FME and the python caller, but I would use the following code in a regular python console to perform the task: my_raster[numpy.nonzero(my_raster)] = my_list My confusion lies in correctly using the Template Function and Class Interface so I call the input raster features into the pythoncaller and manipulate them. I am always receiving errors saying that 'my_raster' is being recognised as a string, causing me to think i am not calling it correctly. Is there also an FME function that has the same functio

I'm finally posting here after much experimenting with various raster transformers and not really getting anywhere. There are too many permutations of things I've tried to list here, so I'll just outline my requirements. I have a set of scanned images of map sheets comprised of JPEGs which are 3 band RED8, GREEN8, BLUE8, no palette and TIFFs which are UINT8, 1 palette. I also have a CSV file with georeferencing and clipping data. I can successfully apply the georeferencing data and clip the images. I want to output the results in 2 ways. Firstly, a set of full colour (3 band RED8, GREEN8, BLUE8 in FME parlance?) TIFFs with TFW world files. Secondly, as a mosaicked image in ESRI format - File Geodatabase Raster and/or ArcSDE raster. When I load the output TIFFs that came from JPEG source images into FGDB rasters and display them in ArcGIS, dark pixels (they aren't pure black i.e. no NoData values so they should display) are shown white. If I convert the JPEG to a TIFF in IrfanView then

I'm trying to use the FindRegEx Feature Function within the Expression Evaluator Transformer. Does anybody know the correct syntax to use ? Documentation on this seemed a little thin on the ground / no specific examples. .......................... I'm trying to do a search in the field: [Category] using the RegEx expression: 0[0-1][0-9] I tried the following - but no luck: @FindRegEx (@Value (Category), 0[0-1][0-9]) ............................ Any ideas - most welcome ............................. Regards Howard L'

In a situation where multiple FME servers are spun up and run standardized workbenches, what's the recommendation for managing helper scripts? We have a set of Python scripts that aid the startup/shutdown of these workbenches. But having multiple servers, it is difficult to ensure the versions of these scripts are the same across the board. Anyone have any recommendations for a code repository? We do have a subscription to Visual Studio Team Service. If anyone has used VSTS with FME server, I am interested to hear about your experenice in that as well.

We are risk averse here at Lizard Inc. and we utilize a a three stage dev/test/prod environment to ensure that no bad code or configurations get into our production system. Production must work!! How can we move a working solution from an FME Server development installation to a testing/staging installation and ultimately to our production install?

I have two datasets that I am currently working on: 1) DBF1 2) DBF2 I need to lookup for Description (in DBF1) in DB2 within the columns I1 to I8 and >> to return the corresponding DMA to Inflow field if a match is found OR >> to display a space if no match found The result would look as follows: Currently, I am using the InlineQuerier with IN statement, but it truncates the result when there is no match. The NOT IN command displayed irrelevant results as well. Please suggest a solution which may be SQL or Non SQL based.

I have two datasets to compare: an original table and a revised table. I want to pass them through the UpdateDetector to track Updates, Inserts, and Deletes. The two tables are linked by a shared primary key attribute, and I want to track changes that may exist in another attribute; however, the original table has an extra attribute, ExtraID, which does not exist in the revised table. For features that exit the Updated port, this ExtraID loses its value. How do I retain the values in ExtraID and prevent them from exiting the UpdateDetector as NULL?

I have a Culvert table with 90K rows. Each culvert belongs to one of 7 size categories. Each category uses a different formula to calculate a culvert's replacement cost. I'm currently using TestFilter to define the size categories. I then route each output to its own ExpressionEvaluator. Is there a way to use a single transformer with a CASE statement to accomplish the same thing?

I have some DTED2 files that I am using to retrieve elevation values from WGS84 coordinates. I would like to modify certain elevation values in the DTED2 file for certain WGS84 coordinates, becuause I have surveyed them with highly accurate GPS equipment and have found certain values to be incorrect. Is this something that FME Desktop is capable of doing.

Hi FME Team I have a MicroStation dgn-File with sewer-manhole drawn by two circles and I would like to first combine these two circles to an block. This works perfectly with the aggregator function in FME. Afterwards I would like to add some attributes to this block (eg. the dimension of the sewer-manhole). I tried the "attribute creator". This works fine within FME - but when I export the block to AutoCAD I have lost the attributes. It would bi great if someone has an idea how to fix the problem. ... and if someone knows a way to change the name of the block (created with the aggregator function) you made my day :-) Kind regards Dominik

I have a polygon feature of almost 700k records with a lot of vertices for each polygon (a lot of coastlines etc) and I need to create a csv with a record for each polygon including a list of coordinate pairs for the vertices of the polygon in the format y1 x1, y2 x2, y3 x3... I was doing this by extracting the coordinates into a list and then creating an attribute of coordinate pairs and aggregating all of those pairs into another attribute by UUID. However, I was only able to do this by generalizing the polygons in order to get this workspace to actually run. If I remove the generalization (preferred), then when the polygons are exploded into lists of vertices the workspace runs out of memory before it can aggregate all back together to get the attribute of coordinate pairs. I think I need to do this without creating a list. I've tried using a geometry extractor instead of the coordinate extractor and creating an XML attribute, but I still cannot figure out how to get the format of y

Hi, I need to download the build 16177 64bit windows version of FME. I can however not find it on the "Past FME Downloads" page (https://www.safe.com/support/support-resources/fme-downloads/archived/). Where would I be able to find the install file for this? PS: The reason I need this specific version is because the client is using this build for his FME Server and I need to modify their models.

Hi all, I've got a question about integrating ArcPy in FME. It would appear that FME won't let me to read in multiple features and process them using ArcPy functions through PythonCaller. This can be easily done outside FME with one line of code such as: arcpy.LocateFeaturesAlongRoutes_lr(feats, rts, rid, tol, tbl, props) What I would hope to achieve with PythonCaller is that it can be used just like one of the transformers like clipper and buffer. Not sure anybody else has experienced the same issue? Thanks!

Does anyone know how you merge lines with the same ID together but hold the attributes from the line with the longest length?

I have a huge ECW-file with not much data. Seen below is a simplification. The black area is "nodata area" and the red area is the actual data (ortophotos following a road). I want to convert this to a BigTIFF (tiled). The issue is that the resulting file is too large to be stored in memory (according to stats, 60 GB of RAM ++ is needed) so it slows down alot. By dividing this area with the RasterTiler I can get approx 20 tiles that does not need that much RAM while processing. However I wonder if it is possible to somehow "not read" the no-data,black,transparent data (as mentioned in the 4th band) - but only only read the relevant pixels. On VECTOR datasets when you use the Tiler - it will only send the tiles containing vector-data, and remove the "empty tiles" - this does not seem to work with rasters. A solution would be to calculate band 4 on data within that raster-tile - and if all values are transparent then skip that tile. Or preferrably it might be a faster solution to this?

I am trying to convert a polyline feature to a polygon by grouping using an attribute. I have around 5,000 distinct values and would expect to produce 5,000 polygons. But for some reason I'm getting 30,000 polygons. I've been using the AreaBuilder. I'm also seeing: 'Duplicate segment detected at location..' Any suggestions? Thanks

Hi guys, I am trying to find a way to get a list of matched and unmatched fields between two datasets. The situation is our agency needs to reguarly download data from external sources and after download we need to check if there is any schema changes on the newly downloaded data. Thank you!

I am attempting to make a spatial relation between a point and a polygon file. The point file holds unit level address information. This is a point feature class that will have a point location for a street address. For example, 234 First Street will have one point representing it. However, in this point file, if there are many Units at a single street address, there will be many points lying on top of each other. Say there are two units at 234 First Street, there will be two points directly on top of each other, say, A-234 First Street and B-234 First Street. The polygon file holds all of the parcel information. This parcel information has the zoning and parcel information attached. Say, Parcel A is zoned R1, Parcel B is zoned R1 and RR2, etc... We want to surface this information in our Web GIS at a unit level. Displaying all pertinent info for each unit address individually. We would like to join each single address point to a single parcel. Essentially creating a many to one relati

I regularely see the following line in my log-window processing [#####] elements with mode CLASSIC Sometimes I stop and wonder about this, so now I thought it time to ask 'the world': What does this mode CLASSIC mean, and are there any other modes? Kind regards, Martin

I have two datasets: 1) DBF1 - It contains demand and patterns corresponding to a particular ID 2) DBF2 - It contains the factor corresponding to each PATTERN I need to create a new column for each type and add the factor corresponding to PATTERN_ID, otherwise the default factor is 0. The output result result would look as follows: I tried using Feature Merger, but I felt that it would require multiple Feature Mergers to achieve the same. I even tried Inline Querier but it does not permit more than one SQL statements. Is there an alternative of doing the same

Hey Everyone, i am trying to read some INSPIRE uk Land Registry data (.GML) i have read this very helpfull doc http://cdn.safe.com/training/course-materials/fmeuc/Complex-GML-manual.pdf in this file, it says i need to load a local Custom .XSD i have downloaded the FMEDATA2014 folder but i cant seem to find the Schema they use as the example. can anyone point me in the right direction to use the .XSD that they use in this example,. cheers, thanks alot for your help For your reference https://www.gov.uk/government/collections/download-inspire-index-polygons

I have data stored across multiple DBF files. DBF1 contains data stored as follows (sample): ID ---------DEMAND-------PATTERN 1123-----------5---------------0.3455 3456-----------3---------------0.3212 2322-----------2---------------0.2112 DBF2 contains data stored as follows (sample): ID----------------ZONE 1123------------ZONE1 3456------------ZONE2 2322------------ZONE1 TOTAL_DEMAND for a particular zone is calculated as the sum of products of the demand and pattern for all the ID that lie within that ZONE. Ex. for ZONE1(which contains 1123 and 2322), TOTAL_DEMAND= 5*0.3455+2*0.2112 I need to create the final results tabulated as follows: ZONE-------------TOTAL_DEMAND ZONE1-----------(calculated as above) ZONE2-----------(calculated as above) The task is easier with VLOOKUP in excel, but I am not able to find suitable transformers to do the same in FME. Please suggest a suitable method. Suggestions regading use of a programming language(such as python) to achieve the same are also w

This is more of a workflow question, but using FME to do so. New to FME, but basically I have a Microsoft SQL Spacial Table that has geometries/polygons in it that I want to display on a Google Map. These polygons represent land ownership, which is basically what Google Maps shows when you fully zoom in. (See the attached image below. i.e. For Crafton Tull you can see the 3d building and then the polygon around it that is the property boundary.) What I want to do is automate the transfer of the Microsoft SQL Spacial Table geometries & associated data into a format that Google Maps can use. The simplest option seems to be to pull it into a Google Fusion Table, but I didn't know if others had recommendations. I found this old FME blog post that talks about using Google Cloud SQL but that seems more complex. (Fusion tables are very easy to use... But the future support for them is unclear.) https://blog.safe.com/2015/01/6-google-maps-engine-alternatives/ Any other / better suggestions? Th

Folks, I have a challenge and I'm not sure if FME has this capacity. I have some Mapinfo co-located points that need to be written as attributed blocks. This I know FME can do and I have done this successfully. Now the challenge has been set to come up with "placement rules" that "move" each block insertion such that it DOES NOT overlap its co-located partners. As far as the logic is concerned what I would want to do is test each input object(point) to see if there are co-located points. Then based on the number of co-located objects loop through the objects placing them at some fixed incrementing\\decrementing Y(North South axis) coordinate. eg var NumPoints = 5 for i = 2 to Numpoints fetch rec(i) insert block X,Y+(i*-10) next Is there any sort of construct that would support this? I'm also aware I'd need a way to ensure I didn't test an already tested point and inserted\\offset block. Any advice appreciated.