Transformers

I have few huge csv files (each has nearly 10 millions rows) that I wanted to process in FME. However, FME can't read them properly. For most of the rows, one of the column's values appear to be "Null". Hence I am not able to read the values and join the values with other files. I have tried FME 2020 and FME 2021 but none of them can read the csv properly. Has anyone ever encounter this issue?

I need to create an annotation feature class in a file geodatabase (FGDB) from input data holding attributes like label alignment and rotation. For some reason, the rotation angle of the text labels is not stored in the FGDB while the other attributes are. According to the documentation (https://docs.safe.com/fme/2020.0/html/FME_Desktop_Documentation/FME_ReadersWriters/geodatabase/Feature_Representation.htm, section "Annotation Attributes"), the attribute "geodb_text_angle" can be used to specify the angle for the label. It should be measured in degrees, so I assume values between 0 and 360 are sensible. However, while a non-zero value is present in the attribute "geodb_text_angle" just before the writer, the "Angle" is then 0 in the FGDB. I have a simple workspace that demonstrates the issue. It just creates one feature, sets some annotation related attributes and then writes an FGDB. The issue is persistent. I am using FME Workbench 2020.0.2.1 (Build 20238)

I have set of lines and a set of points. I need to find the point that is nearest to the start of each line segment and the point that is nearest to the end of each line segment. I want an attribute from those points to transfer to the line segment.

My best result is converting my input building model into a point cloud using "PointCloudCombiner". Then converting the point cloud to a surface using "PointCloudSurfaceBuilder". I used the "Poisson" algorithm, which seems to produce the best result. I'd like to improve the result, as you can see in my picture, the final surface is still quite rounded at some areas. Have you any idea to improve the parameters as the "Poisson" algorithm is quite complicated. Thanks in advance, Frank

I got two different Readers : one is for my different routes (lines) and one is for my different addresses (points). I need to merge them and I want to know which points are within 10 meters of my different routes. Thanks.

I would like to duplicate features based on attribute. See following example. The result I would like to acchive would be a set of new features containing only A, only B and only C. E.g. this would require the geometry1 to be duplicated into one A and one B. To make things more complicated the attributes are dynamic, so matching sets need to be found before duplicating. Any ideas on how to achieve this?

Hi all, I'm trying to set up a change detection workspace, where I have a WFS that is my updated data and a ArcSDE, which is my original data. I have added a Feature Reader, which grabs my WFS and the three relevant layers and used that as my Revised part in the Change Detector Transformer. The Original part comes from my ArcSDE Reader. My problem is this: The WFS service usually has a maximum amount of features it will allow me to retrieve. I have different layers in the WFS which far exceed that maximum. Therefore my reader will only parse half of the features on to the Change Detector. How do I get past this? I tried adding a layer with polygons covering my area, and connecting it to my Feature Reader, setting the Spatial Filter to "Initiator intersects results". This should help the Feature reader, to only read the features within each polygon at a time, and then "ignore" the maximum amount restriction. But this doesn't seem to work, even though I've seen it work in another example

I would like to utilise FME to perform an update on a table a Slowly Changing Dimension (Type 2) . Where historical records are preserved, and you have Start, End dates and a Current flag for each record. While the Change Detector transformer helps, it will still require some tricky manipulation. I did find this article but can't see the detail... It would be great if there was a ETL Transformer that could do this. Any help would be appreciated.

There is nothing in the FME universe that has me pulling my hairs out as much over and over again as DateTime formatting and conversion. I realize I might be be at one extreme end of the FME user spectrum in that In connect to a very small subset of data source/target types. 90% of my work is reading and writing to/from spatial and non-spatial SQL databases. Which means I don't have much use for the full range of date/time manipulation available in FME. But that makes it even more annoying when I read datetime() from SQL and write datetime() to SQL and suddenly find myself puzzling why any formatting or transformation is necessary!? Then, there are just as many occasions when this does not happen and I immediately forget the steps I took to get things to work. As a recent example, I'm reading a number of date fields using: FeatureReader, Type: Microsoft SQL Server Non-Spatial Then I write some of this data back to SQL using: SQL Executor: Microsoft SQL Server Non-Spatial Now why this w

I have records with the same identifier but I would like to select the most recent activity on the record. So for example - 2 records with an ID of "2465100000" but against that ID are 2 different cross references added on different dates. I want to select the most recent one (or the oldest). Please can anyone advise as to the best way to do this so I have only one line remaining based on date. Many thanks

For example, if I have a length of 12356 meters, I would like to have 012+345. Thank you.

Hi, How can I copy the style (Presentation: color, symbol, size, zoom levels) of another shapefile file to my current project. thanks. I'm using Workbench 2020.2

I am trying to configure a FeatureReader to use WMS to request a map in the SVG format (image/svg+xml). I have two options with respect to the output format (jpeg and png) but using the "Open text editor..." functionality I can input the image/svg+xml my self. It fails when I run the workspace and according to the translation log the FeatureReader probably doesn't recognise the format and defaults back to PNG. Even though I have thought of WMS as always returning a raster image, https://en.wikipedia.org/wiki/Web_Map_Service describes it as also being able to return SVG and WebCGM. I haven't browsed through the WMS specification though. I have found this idea https://community.safe.com/s/idea/0874Q000000TlLiQAK/detail which ask for the option to read a plain SVG file so I guess reading SVG is outside the scope of FME so far (even though writing SVG should be available)?

This question is in follow-up to this earlier post, which is, so far, unanswered ... After consulting with some CAD colleagues, I am starting to think that user attributes added to plain features (in my case points), not blocks, by the CAD Writer are invalid for AutoCAD. In fact, a Google search turned up no mention of user attributes outside of blocks ... and opening the output CAD file in FME shows no sign of the User Attributes defined in the Writer. Sigh.

Hello, I am using FTP Caller to call a file with a name like this: A-IPE_810704320_NATH_PM_IPEZMD_V31_@Value(_timestamp)_27.csv My problem is that the last two digits (here 27) are random... So I tried to replace the last two characters, like this: A-IPE_810704320_NATH_PM_IPEZMD_V31_@Value(_timestamp)_??.csv A-IPE_810704320_NATH_PM_IPEZMD_V31_@Value(_timestamp)_* But it doesn't work and it returns an error. I know I can list all the FTP files in an attribute and then search for the right file with "String Seracher" but I thought it might be easier! PS: The @Value(_timestamp) part works correctly and returns the date in the format used in the file naming. Thanks in advance

I am reading CAD point blocks with Explode Blocks unchecked. FME represents these features as points (fme_point), as expected; however, if I then try to write these points back out to a new CAD file, the writer rejects all of them, saying that the blocks are not defined in the CAD file. I don't want blocks written out. I want simple points written out. Now, if I explode blocks on read, only one of the four blocks/feature types in the CAD file produces the insertion points as points. The other three produce all the lines, arcs, etc. but no points. So, how do I go about getting the points for all the blocks and then writing them out to CAD as plain points, i.e. no blocks.

Hello, I have a set of polygons to which I'm trying to attach an image texture (grass polygon + grass jpeg). The image is in pngformat, resolution is 1140x1140 and covers approximately 5x5 meters. I've used the tiler to tile the grass area into 5x5 tiles and used the Polygon texture in the MapnikRasterizer with the Local alignment option. I would expect the image to be fit into the entire polygon tile but it's not. It's instead cut into a smaller image and fit like that. Example workspace and image are attached. Is there something I'm doing wrong? I would like the image to fit the polygon tile and that's it. Any recommendations? Thanks

I am using several FeatureReaders (ArcSDE) and they have a connection file that I paste in. I want this to be a parameter so that I do not have to update several readers when I want to change the connection file. When I create the parameter and try to run it then I get an error that says "Too many recursive macro substitutions". What is the best way to fix this? Thanks.

Steps in my transformation: 1) Translate X,Y 2) Scale around a specific coordinate (Local Coordinate System) 3) Rotate around the same specific coordinate as in step (2) Thanks, Tomer

The plan is to be able to assign floor heights dynamically based on my FLOOR_ID attribute. To be clear, the sheet with the geometry and the sheet with a list of floor heights both have FLOOR_ID as the name of the attribute. Was hoping to use conditional values, but not having any luck. Here are some screenshots for context: Above, is the preview from my Excel Reader showing the FLOOR_ID and height values. This is on a separate sheet from one with all the geometry, FLOOR_ID and other data. Error coming from ListKeyValuePairExtractor. This configuration does not work, but there were no other choices. Was hoping to do something like this in the 3DForcer, but it errored before it got there. Any help is appreciated! Thanks, @larue

I've created a workbench where I simply need to add four columns into multiple features. I've tried a few different ways. The data has metadata in it so I just want to truncate the table or drop and create so it retains the metadata. I used a dynamic writer, the error is random. I tried a more manual way by just exporting "Create if needed" into an empty GDB and importing Metadata afterwards. Still no luck. Weird errors. I tried an even more manual way by pushing one feature at a time through and having a non-dynamic output. This was random, sometimes it would work, but sometimes it wouldn't. I finally got this to work and pushed through 20 features before it decided to stop working and error "Cannot write a non-point feature to a point feature class" but the output is set to polygon! I've made several new writers and readers and workbenches, and used different features and new GDB's and I can not get this to work.

I have run a hadoop job and set multiple reducers in the reduce phase, then I have customize a counter to sum the results of multiple reducers. However, the data type of the result in each reducer is double, while the increment method of conuter only supports the long data type. If the conversion from double to long is forced, the precision will be lost. How can I solve this problem?

I am using Httpcaller to read the catalog. Getting the response body. then using a HTMLExtractor but the links are not coming as a http they are like this: <a href='catalog.html?dataset=xxxx/xxxxx/Archive/name1.nc'><tt>name1.nc</tt></a></td> then using a ListExploder to get just the links like: catalog.html?dataset=xxxx/xxxxx/Archive/name1.nc then I was creating a URL attribute to concatenate the URL( http:////xxxx.yyyyyy.xx:8083/thredds/catalog/xxxxx/xxxxx/Archive/catalog.html? )and the list ( catalog.html?dataset=xxxx/xxxxx/Archive/name1.nc) to have an URL to downlaod the data as: http://xxxx.yyyyyy.xx:8083/thredds/catalog/xxxxx/xxxxx/Archive/catalog.html?dataset=xxxxx/folder/Archive/name1.nc But I donæt manage to download it.I get the following error: HTTP/FTP Transfer: Failed to create file 'R:\\xxxx\\Downloaded\\yyyy\\' for resource download 'http://xxxxxdocker02.dddddd.no:8083/thredds/catalog/xxxxe/xxxxxx/xxxx/catalog.html?dataset=dddddd/dddddd/Archive/name.nc' I have around 65 n

I'm tring to convert some CityGML to b3dm tiles. Source data in EPSG:3857 - center is x=4183074.86, y=7496562.311 but tilles in output get some strange values: x=2855853.53, y=2197566.80. How to save the 3857 coordinates?

Hi, I have a question about how to perform a Multiple LEFT JOIN, because I need to categorize certain ROWs of my TABLE A (all the fields always have information), based on the combination of criteria that I have in TABLE B, the categories are defined in the column RESPONSIBLE TEAM of TABLE B, many of the fields in TABLE B are empty and when this is the case, it is possible to select any value (wildcard), if I do a simple LEFT JOIN it works correctly, but I can't do more than two LEFT JOIN to be able to do the categorization I need. I am using InlineQuerier. this is what I am using: select * from "TABLE A" LEFT JOIN "TABLE B" on "Country" like "_Country" and "State" like "_State" is not null or '%' and "City" like "_City" is not null or '%' and "CODE" like "_CODE" is not null or '%' and "Description" like "_Description" is not null or '%' and "Exp Comment" like "_Exp Comment" is not null or '%' and "Condition" like "_Condition" is not null or '%' and "User" like "_User" is not null or '