Using transformers to modify data.
Recently active
Hi Team,I have a folder structure with thousands of DWG files in multiple sub folders. Excuse the naming convention, its purely indicative.Currently as below, all the DWG files reside inside the DWG folder. I am trying to create the following, In the current workspace I have a Directory and File and Pathnames reader to FileCopy WriterThe reader reads the "TESTIN" Folder with "Recurse into subfolders" as the checked option, running a path filter of "*.dwg"I have an Attribute Manager translator to assign 'Path_windows' and "Path_filename" to the writer. Currently the writer output location is set to the same Root level "TESTIN" folder using the "SourceDataset_PATH" parameter (which is default), with the fanout expression of "_PLANS\\DWG"This result obviously searches all the folders for the .dwg extension and then copies them all to the TESTIN\\_PLANS\\DWG folder that is created by the fan out expression.My qu
Hi allI am quite new to FME workbench and I am temporarily working for LOD2 process. I have already made LOD1 containing footprints and heights and I converted the models found in 3D warehouse into GML files. So the what should I do to use the gml models to take the place to cubs of LOD1 with matched ID? Thank you in advance.
Can anyone show me how I can calculate the number of unique values within the list of each record using Python?For example, what is the count of "Primary" or "Repair"?I know that I can do this easily by exploding the list and go from there. But since I have over 1mil lists, I think the best way to do it is to take advantage of Python to improve performance. Thanks in advance!
@takashiHi I have a DESIGN_DATETIME field in SQL Server and an example of its value is 23/06/2019 11:21:01I am trying to use TestFilter to return only records with timestample in the last 48 hours (i.e. 2 days)The following doesn't seem to work. I am using FME 2018DESIGN_DATETIME >= @DateTimeAdd(@DateTimeNow(),-P2D)Any suggestion?
Hi All,I'm new to translating rasters and i'm looking at doing a simple translation from GeoTiff to ASCII grid data. The Geotiff is a simple single band DSM with REAL32 datatype. I've created a workbench that has the Geotiff as the reader and ASCII as the writer. I am also clipping the original Geotiff, so I've got a clipper in there as well. However, when I run this I get an error 'ESRIASCIIGRID writer: Failed to obtain raster from feature. Only features with raster geometry are expected'. I was kind of expecting something along these lines, because I suspected you need to extract the height info from the band before converting it to ASCII. How do you do this please?Thanks Dave
I have a predicament where I need to read a .txt file containing a list of reference numbers (example attached) .The file is dropped by a supplier onto our SFTP.The file usually contains customer information and therefore I don't want to store that file in a different format (e.g. csv) and read from it.I figured that I could just use the ListBuilder to create a List from the Attribute that the file contents is stored in. However, this does not appear to work - I'm still getting a single attribute value containing the contents in the inspector.Can anybody think of anything or am I just going to have to temporarily store, re-read and then delete the file?
Hi all,Does anyone know of an easy method to create a polygon around part of a LiDAR tile where the LiDAR tile does not have a complete set of values or is not complete?So in the example below I would like to create a polygon around the colored sections (crudely drawn in red), not the whole tile.I have tried the RasterExtentsCoercer, but that just creates a polygon over the whole tile.Thanks all.
Hello,I have two polygon layers:Layer 1 contains approx 2500 polygons some of which overlap with each other.Layer 2 contains approx 150,000 polygons which have been clipped so that all features are inside at least one Layer 1 polygon.I would like to intersect the Layer 2 features so that they are given the attributes (essentially a polygon ID) of the Layer 1 polygon that they fall within, and if a polygon falls within a Layer 1 overlap then two new polygons are created, one for each Layer 1 polygon it fell within.I thought that AreaOnAreaOverlayer would achieve this but when two Layer 1 polygons overlap it only outputs a single Layer 2 polygon (I don't know how it decides which attribute to give it). Perhaps Intersector would be a more appropriate Transformer to use (and it is the equivalent tool that I would use in ArcMap). I don't know. Although I'm getting an error when trying that Transformer which would need to be addressed outside the focus of this question.Both layer
Hello, I would like to know if the "Lambert Mexico WGS84 (cm)" coordinate system exists in FME. Attachment definition If it does not exist in FME, how can I create the system and add it to FME? Thanks so much
I have a MapInfo file representing annotation from Cad data. When I open up the file MapInfo reads it the layer as line feature. Is there a way to convert this line object layer to texte (annotation) using FME? Thanks,
I created a space in revit.Then using FMEWorkbench I translate my model into citygml and then convert it to Geodatabase and use it on Arcgis. I used the model proposed here: BIM to GIS (Intermediate) | IFC LOD 300 to LOD 4 CityGML. The result is that I have the Room class as a table and I do not have the space displayed on Arcgis. The space is represented as a Table, not as a geometry. how should I do to have space as a result.
Dear all,I'm quite new with FME and I'm facing my first issue on my workspace.I would like to retrieve a BLOB from an Oracle DB.This BLOB contains a ZIP file of a DXF file.I would like to read this DXF file with autocad_extended attributes. Currently, I'm stuck at this point: I read the BLOB, I create an attribute (for future transformations), write the file on the file system and extract the zip file.Now, how can I read the DXF file extracted from ZIP with autocad_extended attributes? Thank you for the support!Best Regards,Michele
Hello, I'm relatively new to FME so apologies if this is a simple question.My data includes dates with the earliest being 2006 and the latest being 2019. My aim is to filter this to only include the oldest 6 years worth of dates (however, this is subject to change as the data is updated so it needs to be a fluid filter). I would like to further split this data into each separate year. I have tried using the fanout expression but I'm not entirely sure how to format this. When I tried this it also didn't seem to output all the dates per year. Is there a transformer that would be best for this task?Thanks very much
Hello, I'm new at FME and I can't the way to solve this problem. I have a dataset like this:OONNNEEEESSSSOVALUE123123456431678845221SS445765976455566678763NE I want to get, for each row, the column name where there is maximum value. Thanks.
Hi!I have some singles lines and I would like to create a line to bound them. My lines are not topological and I cannot change the geometry. I need to have 1 line for a group of lines define by an ID or a distance.I tried with hullaccumulator+geometrycoercer+deaggregator.I tried also with Intersector/NetworkTopologyCalculator to have an ID, and then with hullaccumulator, etc. but the results are not very goods because of the topology.On the picture, you can see on the left the lines and on the right that I would like to have. FME create the yellow shape. I need to have the exact same points of building than the original shape.Do you have any idea?
My ultimate goal is to remove as many vertices along the polylines while maintaining the shape of the line. My data is coming from a GDB and consists of complex line segments containing straight lines and curves (i.e. one line can have a curve and a straight segment). I've used the generalizer transformer to remove as excess vertices but it is not working well around the curved line segments. I want to turn these curved segments into true arcs to remove all the excess vertices. Please see my workflow below:The output from this workflow is not working, see below: Based on the pre and post coordinate count, vertices are not being removed. I have added my template with the workflow and test data. Any help would be appreciated @nathanatsafe
Hello FME Gurus, I am trying to create a HTML report that shows both text results and the spatial data, either next to the table or under it.As an example, I have a CAD text label that I am doing a spatial query against a polygon layer to ensure the label is in the correct polygon. I can get the table below to show which ones have failed or succeeded but I would love to include a map showing the two layers, highlighting the failed and or successful features. I don't need a base map, just want to call on the actual spatial data.
Hi all, I have one dataset containing a set of features with attributes like ID, Name, Date, Location. While none of the individual attributes are unique, the combination of all of them are. (Record) I have another dataset of features with one attribute containing freeform multiline text. (Text) Each Text feature contains ALL of the values of ONE feature of the Record dataset, but not in any order, and generally not an exact match on a line. I need to identify which Text feature corresponds to which Record feature. Each Record should have a zero or one match with a Text feature. I am assuming that python and regex is the way to go, but I'm not sure as to the most efficient way to process the data. Record FeaturesIDNameDateLocation24AAA23 MAY 2019X32AAA07 JUN 2019Y24BBB07 JUN 2019Z A sample text feature could contain something like:SEE 242926m7000'Search shelter X32500 2000 2500800 32 200AAA/ABC07 JUN 2019YThe correct record in this case is 32-AAA.
Howdy,Are there known errors/solutions related to the FileNamePartExtractor transformer's handling of 'DateTimeFormat' functions in a file name? I am experiencing this issue in both FME 2018.1.1.2 & FME 2019.0I have a workspace that reads in information from FME Server on scheduled jobs (http://fme:8080/fmerest/v3/schedules?limit=1000&offset=0) and writes details about each scheduled Job and its destination tables to an Excel workbook.I believe this workspace was working fine a few months back, however now I am encountering an error with a FileNamePartExtractor transformer's "Full File Name Attribute" parameter. The error is triggered where a Job has a parameter for the destination file name that includes @DateTimeFormat or @DateTimeNow . For example processing a destination file name like this triggers an error:\RC Metrics_DailyUpdate_@DateTimeFormat(@DateTimeNow(),%Y%m%d).xlsxThe error message received is below:2019-06-18 12:11:24| 0.7| 0.1|ERROR |FilenamePartExtractor_2 (
I have a number of ESRI shape files that need Sqlising. Each shape file goes into a SQL Server Database table as a single row. How do I achieve this in one workflow? Doing these one by one is not practical as there are hundreds of shape files and I can easily make a mistake plus not repeatable.
Howdy,Are there known errors/solutions related to the JSONfragmenter transformer's handling of attributes with no value? For some reason instead of sending those records out through the Rejected port the translation ends with an error message.Here is the full warning/ error message:2019-06-18 12:43:35| 0.6| 0.0|WARN |JSONFragmenter_14 (JSONQueryFactory): A feature was passed to the JSONQueryFactory with no value in the 'JSON_text_HTTPCaller_ws' attribute. Features with no 'JSON_text_HTTPCaller_ws' value will be ignored2019-06-18 12:43:35| 0.6| 0.0|STATS |Storing feature(s) to FME feature store file `D:\AppData\Local\wb-cache--EeQqMH\Main_JSONFragmenter_14 -1 10 fo 1 _lt_REJECTED_gt_ 0 6d87df4aecc2d633e5a7711702c99e6532a5683f.ffsupdating'2019-06-18 12:43:35| 0.6| 0.0|WARN |JSONFragmenter_14 (JSONQueryFactory): No JSON data was found. Make sure the 'JSON Document' parameter has a valueError running translation.I am having this issue with both FME Desktop 2018.1.1.2 &
We often get data with invalid dates in date fields. What is the best way to find invalid dates and replace the invalid dates with a common valid date. There are multiple date fields and there could be invalid dates for multiple date fields for the same record. This is what we need to accomplish:1. find the invalid dates (could be multiple fields for the same record)2. update the invalid dates with a generic valid date (for instance, all the invalid dates would become 1/1/2001)3. combine all the updated records with updated invalid dates with all the records that did not have invalid dates so that the outcome is a table with all the original records with just the updated invalid dates Thanks,David
I need to set the tiling for an orthophoto made on Zephyr. I want to conduct object based image analysis on the mosaics made in eCognition software. I am hoping to classify broad tropical marine habitat types, e.g. coral, sand, seagrass etc. Can anyone recommend how to go about deciding on the best grid resolution?… Read more
When reprojecting a spatial Autocad DXF file with labels, I'm finding that the geometries all get reprojected correctly, but the labels are wildly wrong. I've reprojected a variety of attributes such as autocad_alignment_x and autocad_alignment_y but haven't been able to get a solution. When manually setting fme_text_size, the overall bounding box of the data does change, but the labels themselves don't seem to behave correctly. Has anybody run into similar issues in the past?
HEllo,I would like to build a line from polyygon center points. The coherent polygons have an id (ivv) on which a I want to create a single line.First I am using a centerPointReplacer to get the centre point of the polygons. After that I am using aggregator, to group the poins by (ivv). Now I want to build the lines, but it gives back rejected even if I set the connection break output to ivv or not. What should be the correct order or parameter setting to get lines from the aggregated points?