Using transformers to modify data.
Recently active
I'm posting a new question since part of my question was answered. The workbench uses published parameters for selecting the files to input $(SourceDataset_DGN or DWG). There is a feature reader for dwg and a feature reader for dgn, each pointing to the correct dataset. In both feature readers, the <Generic> port attributes to expose are: $(SourceDataset_DGN or DWG), $(Project) typed in as a parameter, fme_feature_type, fme_basename_, fme_text_string, fme_dataset, and fme_geometry. All seven attribute fields are created but only fme_feature_type and fme_text_string are populated with data, all of the other fields (except geometry which I get) show "missing". I am getting the fme_dataset for the DGN reader but not anything else. Takashi recommended a FileNamePartExtractor transformer after the DWG reader but still nothing. I think nothing else is populating because there is a problem with converting the parameter information since not even the $SourceDataset has any
we have 12 tables with about 400,000 records so i want to know if I can create 4 new fields; Lat, Long, and both Spatial SQL fields from the current UTM zone 13 Nad83 data.New user, so the help posts I have ready don't directly answer this question and I am still trying to learn how to create the new fields.Can I do this in one project, or does this become a multi project for each table?If not to much to ask, can you give me the functions in order for this? I can supply data if that will help also.
I've got some .KAP files which are missing spatial data and as such, I cannot convert them into something more useful like a .TIF image. I've been using FME which errors on these files with "Failed to specify the feature index as constraints on the reader". Has anyone come across this and found a solution? At this point, i'm happy just to convert to a non-spatial image format.
I have flattened some JSON and it now shows as a separate feature for each object. This is the JSONAnd this is it flattened from the JSONFlattenerI want to get the json_index to be the attribute header and the _response_body to be the feature attribute. These are the settings I currently have for the JSONFlattener. Any assistance on this would be great. I am in unfamiliar territory with JSON. Thanks
I have an attribute containing multiline text where an arbitrary block of lines are repeated near the end of the data. I can't just remove duplicate lines, as an individual line might be have legitimate duplicates. In the below example lines 2 and 15 are identical, but are correct, whereas the block of lines 17-23 are a repetition of lines 10-16, and need to be removed. The number of lines that are repeated varies, but there will always be at least one, and will include the last REV line before the footer. The footer data varies in length and content, but will never include a line beginning with REV.SITE 1REV 10-1PREV 10-3DSITE 2REV 20-3V3REV 20-3V4REV 20-3V5REV 20-3V6REV 20-3WREV 20-3XREV 20-3X4REV 20-3X5REV 20-3X6SITE 3REV 10-1PREV 10-1P1REV 20-3XREV 20-3X4REV 20-3X5REV 20-3X6SITE 3REV 10-1PREV 10-1P1Footer Data HereThe data is not in a text file that can be read bottom up, though I suppose if required it could be written to one and read back in
Hi!First question up here for me :)I have a Dataset with 137k timestamped points (over 1000 trajectories belonging to 160 individuals). Now I want to figure out, what percentage of each path is unique (I define unique as >80m away from any other path).So first i created lines from my csv-file with the coordinates of the trips, then i used Linebuilder to create a line for each trip and added a buffer of 80m. Now I wanted to use this geometry as the filter in SpatialFilter, with the point dataset as Candidates. The Problem is though, that I want to compare each point ONLY with the Trips(buffered lines) of the same Individual, except the Trip with the same TripID, because otherwise they woul all intersect.Can anyone of you help with an idea to create these conditions before feeding the data into SpatialFilter?Here is my workspace so far.
Hello FME users, I have a set of lines that make up a polygon. I need to determine which side(left or right) of the line is "looking" outside of the polygon. Lines are not oriented the same, end point of one is not always a start point of next line and so on. LeftRightSpatialCalculator can't do the job because I don't have anything to Candidate. Thank you in advance. Milos
Hello all,I am looking for some suggestions on the best way to create a summary table that can be used in the HTML Report Generator. The overall scenario is that we have an AutoCAD file coming into FME and various parts of the data are being validated and reported on. What I am trying to get it something like the following:Object Passed Failed TotalRoads 10 3 13Distance 15 1 16Area 5 2 7 Thanks Dean
Hi Team,I have a folder structure with thousands of DWG files in multiple sub folders. Excuse the naming convention, its purely indicative.Currently as below, all the DWG files reside inside the DWG folder. I am trying to create the following, In the current workspace I have a Directory and File and Pathnames reader to FileCopy WriterThe reader reads the "TESTIN" Folder with "Recurse into subfolders" as the checked option, running a path filter of "*.dwg"I have an Attribute Manager translator to assign 'Path_windows' and "Path_filename" to the writer. Currently the writer output location is set to the same Root level "TESTIN" folder using the "SourceDataset_PATH" parameter (which is default), with the fanout expression of "_PLANS\\DWG"This result obviously searches all the folders for the .dwg extension and then copies them all to the TESTIN\\_PLANS\\DWG folder that is created by the fan out expression.My qu
Hi allI am quite new to FME workbench and I am temporarily working for LOD2 process. I have already made LOD1 containing footprints and heights and I converted the models found in 3D warehouse into GML files. So the what should I do to use the gml models to take the place to cubs of LOD1 with matched ID? Thank you in advance.
Can anyone show me how I can calculate the number of unique values within the list of each record using Python?For example, what is the count of "Primary" or "Repair"?I know that I can do this easily by exploding the list and go from there. But since I have over 1mil lists, I think the best way to do it is to take advantage of Python to improve performance. Thanks in advance!
@takashiHi I have a DESIGN_DATETIME field in SQL Server and an example of its value is 23/06/2019 11:21:01I am trying to use TestFilter to return only records with timestample in the last 48 hours (i.e. 2 days)The following doesn't seem to work. I am using FME 2018DESIGN_DATETIME >= @DateTimeAdd(@DateTimeNow(),-P2D)Any suggestion?
Hi All,I'm new to translating rasters and i'm looking at doing a simple translation from GeoTiff to ASCII grid data. The Geotiff is a simple single band DSM with REAL32 datatype. I've created a workbench that has the Geotiff as the reader and ASCII as the writer. I am also clipping the original Geotiff, so I've got a clipper in there as well. However, when I run this I get an error 'ESRIASCIIGRID writer: Failed to obtain raster from feature. Only features with raster geometry are expected'. I was kind of expecting something along these lines, because I suspected you need to extract the height info from the band before converting it to ASCII. How do you do this please?Thanks Dave
I have a predicament where I need to read a .txt file containing a list of reference numbers (example attached) .The file is dropped by a supplier onto our SFTP.The file usually contains customer information and therefore I don't want to store that file in a different format (e.g. csv) and read from it.I figured that I could just use the ListBuilder to create a List from the Attribute that the file contents is stored in. However, this does not appear to work - I'm still getting a single attribute value containing the contents in the inspector.Can anybody think of anything or am I just going to have to temporarily store, re-read and then delete the file?
Hi all,Does anyone know of an easy method to create a polygon around part of a LiDAR tile where the LiDAR tile does not have a complete set of values or is not complete?So in the example below I would like to create a polygon around the colored sections (crudely drawn in red), not the whole tile.I have tried the RasterExtentsCoercer, but that just creates a polygon over the whole tile.Thanks all.
Hello,I have two polygon layers:Layer 1 contains approx 2500 polygons some of which overlap with each other.Layer 2 contains approx 150,000 polygons which have been clipped so that all features are inside at least one Layer 1 polygon.I would like to intersect the Layer 2 features so that they are given the attributes (essentially a polygon ID) of the Layer 1 polygon that they fall within, and if a polygon falls within a Layer 1 overlap then two new polygons are created, one for each Layer 1 polygon it fell within.I thought that AreaOnAreaOverlayer would achieve this but when two Layer 1 polygons overlap it only outputs a single Layer 2 polygon (I don't know how it decides which attribute to give it). Perhaps Intersector would be a more appropriate Transformer to use (and it is the equivalent tool that I would use in ArcMap). I don't know. Although I'm getting an error when trying that Transformer which would need to be addressed outside the focus of this question.Both layer
Hello, I would like to know if the "Lambert Mexico WGS84 (cm)" coordinate system exists in FME. Attachment definition If it does not exist in FME, how can I create the system and add it to FME? Thanks so much
I have a MapInfo file representing annotation from Cad data. When I open up the file MapInfo reads it the layer as line feature. Is there a way to convert this line object layer to texte (annotation) using FME? Thanks,
I created a space in revit.Then using FMEWorkbench I translate my model into citygml and then convert it to Geodatabase and use it on Arcgis. I used the model proposed here: BIM to GIS (Intermediate) | IFC LOD 300 to LOD 4 CityGML. The result is that I have the Room class as a table and I do not have the space displayed on Arcgis. The space is represented as a Table, not as a geometry. how should I do to have space as a result.
Dear all,I'm quite new with FME and I'm facing my first issue on my workspace.I would like to retrieve a BLOB from an Oracle DB.This BLOB contains a ZIP file of a DXF file.I would like to read this DXF file with autocad_extended attributes. Currently, I'm stuck at this point: I read the BLOB, I create an attribute (for future transformations), write the file on the file system and extract the zip file.Now, how can I read the DXF file extracted from ZIP with autocad_extended attributes? Thank you for the support!Best Regards,Michele
Hello, I'm relatively new to FME so apologies if this is a simple question.My data includes dates with the earliest being 2006 and the latest being 2019. My aim is to filter this to only include the oldest 6 years worth of dates (however, this is subject to change as the data is updated so it needs to be a fluid filter). I would like to further split this data into each separate year. I have tried using the fanout expression but I'm not entirely sure how to format this. When I tried this it also didn't seem to output all the dates per year. Is there a transformer that would be best for this task?Thanks very much
Hello, I'm new at FME and I can't the way to solve this problem. I have a dataset like this:OONNNEEEESSSSOVALUE123123456431678845221SS445765976455566678763NE I want to get, for each row, the column name where there is maximum value. Thanks.
Hi!I have some singles lines and I would like to create a line to bound them. My lines are not topological and I cannot change the geometry. I need to have 1 line for a group of lines define by an ID or a distance.I tried with hullaccumulator+geometrycoercer+deaggregator.I tried also with Intersector/NetworkTopologyCalculator to have an ID, and then with hullaccumulator, etc. but the results are not very goods because of the topology.On the picture, you can see on the left the lines and on the right that I would like to have. FME create the yellow shape. I need to have the exact same points of building than the original shape.Do you have any idea?
My ultimate goal is to remove as many vertices along the polylines while maintaining the shape of the line. My data is coming from a GDB and consists of complex line segments containing straight lines and curves (i.e. one line can have a curve and a straight segment). I've used the generalizer transformer to remove as excess vertices but it is not working well around the curved line segments. I want to turn these curved segments into true arcs to remove all the excess vertices. Please see my workflow below:The output from this workflow is not working, see below: Based on the pre and post coordinate count, vertices are not being removed. I have added my template with the workflow and test data. Any help would be appreciated @nathanatsafe
Hello FME Gurus, I am trying to create a HTML report that shows both text results and the spatial data, either next to the table or under it.As an example, I have a CAD text label that I am doing a spatial query against a polygon layer to ensure the label is in the correct polygon. I can get the table below to show which ones have failed or succeeded but I would love to include a map showing the two layers, highlighting the failed and or successful features. I don't need a base map, just want to call on the actual spatial data.