Using transformers to modify data.
Recently active
@takashiHi I have a DESIGN_DATETIME field in SQL Server and an example of its value is 23/06/2019 11:21:01I am trying to use TestFilter to return only records with timestample in the last 48 hours (i.e. 2 days)The following doesn't seem to work. I am using FME 2018DESIGN_DATETIME >= @DateTimeAdd(@DateTimeNow(),-P2D)Any suggestion?
Hi All,I'm new to translating rasters and i'm looking at doing a simple translation from GeoTiff to ASCII grid data. The Geotiff is a simple single band DSM with REAL32 datatype. I've created a workbench that has the Geotiff as the reader and ASCII as the writer. I am also clipping the original Geotiff, so I've got a clipper in there as well. However, when I run this I get an error 'ESRIASCIIGRID writer: Failed to obtain raster from feature. Only features with raster geometry are expected'. I was kind of expecting something along these lines, because I suspected you need to extract the height info from the band before converting it to ASCII. How do you do this please?Thanks Dave
I have a predicament where I need to read a .txt file containing a list of reference numbers (example attached) .The file is dropped by a supplier onto our SFTP.The file usually contains customer information and therefore I don't want to store that file in a different format (e.g. csv) and read from it.I figured that I could just use the ListBuilder to create a List from the Attribute that the file contents is stored in. However, this does not appear to work - I'm still getting a single attribute value containing the contents in the inspector.Can anybody think of anything or am I just going to have to temporarily store, re-read and then delete the file?
Hi all,Does anyone know of an easy method to create a polygon around part of a LiDAR tile where the LiDAR tile does not have a complete set of values or is not complete?So in the example below I would like to create a polygon around the colored sections (crudely drawn in red), not the whole tile.I have tried the RasterExtentsCoercer, but that just creates a polygon over the whole tile.Thanks all.
Hello,I have two polygon layers:Layer 1 contains approx 2500 polygons some of which overlap with each other.Layer 2 contains approx 150,000 polygons which have been clipped so that all features are inside at least one Layer 1 polygon.I would like to intersect the Layer 2 features so that they are given the attributes (essentially a polygon ID) of the Layer 1 polygon that they fall within, and if a polygon falls within a Layer 1 overlap then two new polygons are created, one for each Layer 1 polygon it fell within.I thought that AreaOnAreaOverlayer would achieve this but when two Layer 1 polygons overlap it only outputs a single Layer 2 polygon (I don't know how it decides which attribute to give it). Perhaps Intersector would be a more appropriate Transformer to use (and it is the equivalent tool that I would use in ArcMap). I don't know. Although I'm getting an error when trying that Transformer which would need to be addressed outside the focus of this question.Both layer
Hello, I would like to know if the "Lambert Mexico WGS84 (cm)" coordinate system exists in FME. Attachment definition If it does not exist in FME, how can I create the system and add it to FME? Thanks so much
I have a MapInfo file representing annotation from Cad data. When I open up the file MapInfo reads it the layer as line feature. Is there a way to convert this line object layer to texte (annotation) using FME? Thanks,
I created a space in revit.Then using FMEWorkbench I translate my model into citygml and then convert it to Geodatabase and use it on Arcgis. I used the model proposed here: BIM to GIS (Intermediate) | IFC LOD 300 to LOD 4 CityGML. The result is that I have the Room class as a table and I do not have the space displayed on Arcgis. The space is represented as a Table, not as a geometry. how should I do to have space as a result.
Dear all,I'm quite new with FME and I'm facing my first issue on my workspace.I would like to retrieve a BLOB from an Oracle DB.This BLOB contains a ZIP file of a DXF file.I would like to read this DXF file with autocad_extended attributes. Currently, I'm stuck at this point: I read the BLOB, I create an attribute (for future transformations), write the file on the file system and extract the zip file.Now, how can I read the DXF file extracted from ZIP with autocad_extended attributes? Thank you for the support!Best Regards,Michele
Hello, I'm relatively new to FME so apologies if this is a simple question.My data includes dates with the earliest being 2006 and the latest being 2019. My aim is to filter this to only include the oldest 6 years worth of dates (however, this is subject to change as the data is updated so it needs to be a fluid filter). I would like to further split this data into each separate year. I have tried using the fanout expression but I'm not entirely sure how to format this. When I tried this it also didn't seem to output all the dates per year. Is there a transformer that would be best for this task?Thanks very much
Hello, I'm new at FME and I can't the way to solve this problem. I have a dataset like this:OONNNEEEESSSSOVALUE123123456431678845221SS445765976455566678763NE I want to get, for each row, the column name where there is maximum value. Thanks.
Hi!I have some singles lines and I would like to create a line to bound them. My lines are not topological and I cannot change the geometry. I need to have 1 line for a group of lines define by an ID or a distance.I tried with hullaccumulator+geometrycoercer+deaggregator.I tried also with Intersector/NetworkTopologyCalculator to have an ID, and then with hullaccumulator, etc. but the results are not very goods because of the topology.On the picture, you can see on the left the lines and on the right that I would like to have. FME create the yellow shape. I need to have the exact same points of building than the original shape.Do you have any idea?
My ultimate goal is to remove as many vertices along the polylines while maintaining the shape of the line. My data is coming from a GDB and consists of complex line segments containing straight lines and curves (i.e. one line can have a curve and a straight segment). I've used the generalizer transformer to remove as excess vertices but it is not working well around the curved line segments. I want to turn these curved segments into true arcs to remove all the excess vertices. Please see my workflow below:The output from this workflow is not working, see below: Based on the pre and post coordinate count, vertices are not being removed. I have added my template with the workflow and test data. Any help would be appreciated @nathanatsafe
Hello FME Gurus, I am trying to create a HTML report that shows both text results and the spatial data, either next to the table or under it.As an example, I have a CAD text label that I am doing a spatial query against a polygon layer to ensure the label is in the correct polygon. I can get the table below to show which ones have failed or succeeded but I would love to include a map showing the two layers, highlighting the failed and or successful features. I don't need a base map, just want to call on the actual spatial data.
Hi all, I have one dataset containing a set of features with attributes like ID, Name, Date, Location. While none of the individual attributes are unique, the combination of all of them are. (Record) I have another dataset of features with one attribute containing freeform multiline text. (Text) Each Text feature contains ALL of the values of ONE feature of the Record dataset, but not in any order, and generally not an exact match on a line. I need to identify which Text feature corresponds to which Record feature. Each Record should have a zero or one match with a Text feature. I am assuming that python and regex is the way to go, but I'm not sure as to the most efficient way to process the data. Record FeaturesIDNameDateLocation24AAA23 MAY 2019X32AAA07 JUN 2019Y24BBB07 JUN 2019Z A sample text feature could contain something like:SEE 242926m7000'Search shelter X32500 2000 2500800 32 200AAA/ABC07 JUN 2019YThe correct record in this case is 32-AAA.
Howdy,Are there known errors/solutions related to the FileNamePartExtractor transformer's handling of 'DateTimeFormat' functions in a file name? I am experiencing this issue in both FME 2018.1.1.2 & FME 2019.0I have a workspace that reads in information from FME Server on scheduled jobs (http://fme:8080/fmerest/v3/schedules?limit=1000&offset=0) and writes details about each scheduled Job and its destination tables to an Excel workbook.I believe this workspace was working fine a few months back, however now I am encountering an error with a FileNamePartExtractor transformer's "Full File Name Attribute" parameter. The error is triggered where a Job has a parameter for the destination file name that includes @DateTimeFormat or @DateTimeNow . For example processing a destination file name like this triggers an error:\RC Metrics_DailyUpdate_@DateTimeFormat(@DateTimeNow(),%Y%m%d).xlsxThe error message received is below:2019-06-18 12:11:24| 0.7| 0.1|ERROR |FilenamePartExtractor_2 (
I have a number of ESRI shape files that need Sqlising. Each shape file goes into a SQL Server Database table as a single row. How do I achieve this in one workflow? Doing these one by one is not practical as there are hundreds of shape files and I can easily make a mistake plus not repeatable.
Howdy,Are there known errors/solutions related to the JSONfragmenter transformer's handling of attributes with no value? For some reason instead of sending those records out through the Rejected port the translation ends with an error message.Here is the full warning/ error message:2019-06-18 12:43:35| 0.6| 0.0|WARN |JSONFragmenter_14 (JSONQueryFactory): A feature was passed to the JSONQueryFactory with no value in the 'JSON_text_HTTPCaller_ws' attribute. Features with no 'JSON_text_HTTPCaller_ws' value will be ignored2019-06-18 12:43:35| 0.6| 0.0|STATS |Storing feature(s) to FME feature store file `D:\AppData\Local\wb-cache--EeQqMH\Main_JSONFragmenter_14 -1 10 fo 1 _lt_REJECTED_gt_ 0 6d87df4aecc2d633e5a7711702c99e6532a5683f.ffsupdating'2019-06-18 12:43:35| 0.6| 0.0|WARN |JSONFragmenter_14 (JSONQueryFactory): No JSON data was found. Make sure the 'JSON Document' parameter has a valueError running translation.I am having this issue with both FME Desktop 2018.1.1.2 &
We often get data with invalid dates in date fields. What is the best way to find invalid dates and replace the invalid dates with a common valid date. There are multiple date fields and there could be invalid dates for multiple date fields for the same record. This is what we need to accomplish:1. find the invalid dates (could be multiple fields for the same record)2. update the invalid dates with a generic valid date (for instance, all the invalid dates would become 1/1/2001)3. combine all the updated records with updated invalid dates with all the records that did not have invalid dates so that the outcome is a table with all the original records with just the updated invalid dates Thanks,David
I need to set the tiling for an orthophoto made on Zephyr. I want to conduct object based image analysis on the mosaics made in eCognition software. I am hoping to classify broad tropical marine habitat types, e.g. coral, sand, seagrass etc. Can anyone recommend how to go about deciding on the best grid resolution?… Read more
When reprojecting a spatial Autocad DXF file with labels, I'm finding that the geometries all get reprojected correctly, but the labels are wildly wrong. I've reprojected a variety of attributes such as autocad_alignment_x and autocad_alignment_y but haven't been able to get a solution. When manually setting fme_text_size, the overall bounding box of the data does change, but the labels themselves don't seem to behave correctly. Has anybody run into similar issues in the past?
HEllo,I would like to build a line from polyygon center points. The coherent polygons have an id (ivv) on which a I want to create a single line.First I am using a centerPointReplacer to get the centre point of the polygons. After that I am using aggregator, to group the poins by (ivv). Now I want to build the lines, but it gives back rejected even if I set the connection break output to ivv or not. What should be the correct order or parameter setting to get lines from the aggregated points?
I'm new to FME, and most of the time I work with ArcGIS Pro. I have a few building polygons, and a few points containing additional information. Now, in ArcGIS Pro I can spatially join these two, creating one layer with the polygon "look" but added with the point information. This then needs to be exported to a new shapefile.How can I recreate this in FME? I now used the SpatialRelater, with a tester, but when I export 'passed', it still only contains the attributes from the input area, and the attributes from the points are not added. When I look at the passed data with the inspector, it does show an attribute table wit the combined data, but when writing this to a new file, it does not.Can someone help me out?
I have a set of polyline features and a set of point features in a ShapeFile. Each set of features has a RID field. The RID for a polyline record corresponds to an RID field for the points. As expected, one line has many points that comprise it. There are 10-20 lines in the input dataset and ~1500 points. I just want to show each unique RID value as a different color in my output KML file. The workbench goes something like this:1) Read the Lines and the Points2) Read a SQLite DB containing a table listing a RID, and a Color (both RGB 100,100,100 and KMLColor FF00987F format (http://www.zonums.com/gmaps/kml_color/)3) FEature Merger moves the attributes from the SQL Lite DB to the Shapefiles, the reprojector, 3dforcer, KMLPropertySetter then the KMLStyler where the colors for all symbology is set using the fields containing the colors merged from the SQL lite databases.4) The resulting data is written out to the KMZ. The issue is that neither the RGB or the KML Color values are applied t
I need to get the closest distance between points and lines calculated. The points and lines have matching attributes.I only need distance calculated between point A and Line A, Point B and Line B.. Is it possible?