Transformers

Hey FME powerusers - Been working through how to scrape websites with the HTTPCaller and HTML Table Reader which are very powerful! Trying to parse and store data into a table format has been challenging. Eventually, the goal is to scrape or direct read the website, store data in a table for updates, and then update or build the website.From the information provided below, I’m having difficulty being able to associate each column between the COMM (col2) and associated PRODUCT_NAME (col1) to create the relationship. I wasn’t trying to get it elegant….just trying to walk through the process of how to parse strings effectively as well as using best practices from the FME community experience. Here’s a snapshot of using the HTML Table Reader parsed to get to this far:My goal is to create a table that will have the following data in this form - from the above table snapshot:ALPHA_CODECOMMPRODUCT_NAMEHAZ_RATINGAALFALFAROUNDUP POWERMAX HERBICIDE(1 1 1)AALFALFABRANDT ONSITE(X X X)AALFALFAP

Hello everybody,please, has anybody idea how to create from multilines polygon with holes (donut)?Feature below is composed by many lines, but I need to convert them to single donut.I also attached data sample of this feature.Thank You so much!Lubo

Hello everyone,This is just a short post to alert you to a couple of recent updates.Firstly, the DateTimes and FME tutorial has been revised for use with FME 2019. You can find it here: https://knowledge.safe.com/content/kbentry/715/working-with-date-and-time-attributes-tutorial.htmlThere's quite a lengthy section on using the newer transformers that explains how to handle datetimes with time zones, daylight savings, leap years, and more. Plus there's a new article that answers questions in general about datetimes, with links to documentation, knowledgebase ideas, and hub transformers. Plus, all the old content that relied on using TCL has been removed!Secondly, both the FME Desktop training courses have been updated to 2019.1. As usual, the content still works with 2019.0, but where there are differences or updates in .1, additional info boxes have been added to convey that information. All workspaces in FMEData are still 2019.0 compatible.The main changes relate to the Tester

Hi there, I have a shapefile layer containing 1500 points. I want to create a shapefile layer of 5 polygons in which all 5 polygons contain the same number of points for some data analysis work. I did try using the 'Cluster' transformer (which I could have then digitised around by hand) but each cluster contained a random number of points. Does anyone know how I could do this please?

Hello, can anyone help with this? I have a polyline dataset and need to create an output all multi-part features but only where there are gaps between the individual parts within a feature, i.e. at least one of the feature parts is not intersecting any of the other feature parts in any way. Thanks in advance.

I have 600+ bus lines that I need to make a single network from containing just the lines/roads the buses uses. The problem is that mostly the bus lines are made following a road network making all lines on most roads 100% parallel. But on not so few places the road network is missing so on those places the bus lines are hand plotted making them not parallel at all. Lines changes and this should therefor be updated two to three times annually. How can I use FME to automatically create those missing roads not in the road network out of the different hand plotted lines? Sometimes just one, but mostly 5-10 closely dotted line.

I have a directory containing several hundred raster images in geotiff formatI would like to convert them to ecw formatAs file space is limited, I would prefer to;- iterate through the geotiffs one by one- convert a geotiff into an ecw, saved in the same directory- delete the original geotiff- move onto the next geotiffCan anyone outline the structure of a workbench that does this?Thanks

I have a job that takes a polyline feature and dynamically segments it based on begin/end measure values provided by a merged table. This tool is built to work as a custom transformer that loops through multiple tables, utilizing the snipper tool, and outputs a heavily segmented line. Example of the measures below:  ROUTE_IDBEGIN_MEASUREEND_MEASURE1010110201253013040 This all works fine, except when gaps exist in the sequence of begin/end measures (see the gap between the end measure and begin measure of row 2-3). The snipper will only pass the snipped segment through the output. I need to keep the segments of the line that are not snipped. The remnants are useless as I would need to run a line on line overlay on all the remnants which is slow and not practical when I have 5000+ lines and hundreds of segments for each line. Unless someone can suggest another way of using remnants to find gaps, and overlaps if possible, but I've largely abandoned this approach. I've also attempt

I'm using the PointOnLineOverlayer to extract route/segment information including measures. However, when multiple routes are stacked on top of each other and I get a list of routes like this: When I scroll down to look at the measures, I only see 1 measure: Which line segment/route is this measure tied to? Is there a way to extract the measure from the route/segment of my choosing? I don't understand why the coordinates, including measures, couldn't be included in the list that is generated by the PointOnLineOverlayer. Thanks,Mark 

Im working with this original template(https://knowledge.safe.com/articles/59335/autocad-dwg-block-attribute-extraction.html). Same reader, but now the Writer is a Geotable. I have added additional transformers for coordinates and to extract attributes in multiple fields instead of one field with all attributes as a list. This is where my question takes place, If I am for example exposing 10 elements(from the AttributeSplitter) but only 6 elements have attribute data, How can I set it up to automatically remove/delete the 4 elements from the Writer that have null values? Attached is the file I am working with, which has the example I mentioned above.

I want to take a small data set like the one below and calculate the difference between each feature as either a matrix or as a 1:1 readoutInputMatrix outputPaired outputthe goal would be then to use this data to evaluate a matrix of points to determine their proximity in relationship of the nodes for the given point

i'm not looking to write out rasters to view this. I simply want to see the table of the information associated with the rasters. Is there anyway to write out a list or something?

Hello,I'm new with FME, and can't manage to solve an issue which seems simple. I would like to merge several rows in one, based on same values for 2 attributes. I've obtained a list of unique name/date combinations with the matcher transformer.Moreover, I'd like to create a unique feature for each match, using other attributes. I tried to explain it with the example below :I have the following data :IDNameDatePlace_APlace_BPlace_C1Tom26-07HouseMarketSchool2Tom26-07MarketSchoolShop 3Jerry26-07House Market School 4Jerry03-08Market School Shop   Since the Name and Date are unique for rows 1 and 2, I want to merge them in a unique feature (which would be chain_1-2.Then, I want to recreate a chaining House - Market - School - Shop, by comparing :- Place_B (1) with Place_A (2)- Place_B (2) with Place_A (3)- and so on. I'd like to obtain this kind of result :IDNameDateChain_link_1Chain_link_2Chain_link_3Chain_link_4chain_1-2 Tom 26-07 House Market School Shop 3 Jerry 26-

Hi! I have 3500+ 1:1000 topographic CAD files/tiles, each with thousands of features that I want to, ultimately, convert to shapefile and merge the tiles into 10*10 grid/mask that to reduce the number of folders.Here is what I have attempted so far:1. Convert CAD tiles into shapefiles (I accomplished this, see pictures below) 2. I have attempted to bulk load the folders (mulitple folder selction) into FME to convert to a File Geodatabase so that I can easily work with the large dataset in ArcGIS Pro- I'm missing something as the conversion is not working completely, only part of the dataset is getting converted3. I attempted converting the CAD tiles to Geodatabase and it failed.4. I've attempted both of all of these in QuickTranslator and in WorkbenchMaybe someone can offer up a good workflow (with pictures!) to convert 3500 CAD tiles with millions of features? I'm super new to FME and attempting to teach myself FME but I really want to accomplish this and cross it off my

In reader we have below cvs with one field.=================================Translation was SUCCESSFUL9.4 seconds. (CPU: 4.2s user, 2.7s system)================================== How I can get this in text like this: "Translation was SUCCESSFUL - 9.4 seconds."May be regex or something else

I have a need to check for data changes between two datasets (oracle tables). I initially configured the ChangeDetector comparing all of the attributes. The results were, all of the data from the “revised” port were identified as records to be added (some 300K plus records) and the data from the “original” port are identified as records to be deleted (som 300K plus records).There’s no unique key in this data. If I limit the number of attributes to check to 7 specific attributes, the “added” and “deleted” ports reflect more reasonable results. In other words, from a basic math perspective, the difference between the number of revised and original records calculate correctly (in the sense of finding “changes”).Essentially, all of the attribute values can change so I need to check for all of the attributes. I don’t understand why in configuring the ChangeDetector to check for all attributes, why the transformer behaves as if all of the records “changed”. I’m fairly new to using this parti

Hi, I've got a polygon feature as clipper, which has several polygons with no gaps and overlaps. After 500 meter buffering operation, there're some overlaps, and I'd like to use each buffered polygon to clip source data. But it seems that Clipper transformer couldn't perform such operation, in the help document it said "A feature can be clipped multiple times, but not iteratively (for example, if a line passes through two overlapping polygons, you don’t get a separate clipped line for the overlap - just one per polygon)."So I'm asking is there any way to perform a iterative clip?BTW, I use dynamic writer to output data, can I change output feature type name? I tried @jdh 's method, it worked but somehow, all fields of all features are same, but the original feature schema isn't that way. Is there a alterative method?Please help me out, much thanks!@takashi @mark2atsafe @markatsafe @jdh @david_r @erik_jan 

I have a curb line represented as one object. However, I would like to split it at its "corners" (marked with the black circles). Apart from the curb line, I also have the street centerline.. Any idea, how I could get a satisfying result? Thanks!

Hi there!I'm using Workbench 2018. After a few weeks, out of the sudden the font of the 'Parameter Editor' and the menu of each transformer (the one you get by double click in the transformer box itself) got so tiny that I am barely able to read those texts.I would appreciate any help to get those fields back to their usual font size. I've tried with the 'FME options' in the 'Tools' menu, but it makes no difference at all.

Dear FME community,  I have a question regarding trees along a road (alley trees).  In the following example, the green points represent trees at the roadside, i.e. left or right side of the road. The red points are felled trees and can be ignored.  We want the length of the road where there are trees in one row at only one side (example 1) and trees in an alley (examples 2 and 3). An alley is where there are trees on both sides of the road, but only if it is more than 50 metres long and if there are more than 8 trees per row. Perhaps there is an attribute way: we also have the measures on the road in addition to the coordinates, for example:Tree 1 at road segment XYZ has the station 50 and is located left. That means it is 50 metres away from the beginning of the road. Tree 2 at the same road segment XYZ with station 52 is located right side. If there are more than 50 metres of these "couples", then it is an alley which we want to identify. The total length is also stored in

I have set of polygons representing streets like in the image below. I want to merge small polygons like the selected orange polygon to their bigger container polygon.I do not know how to do this with FME. What would be a good approach?Thanks for any help!

I am reading the source file from an SFTP folder and storing it into an attribute for the purposes of later downloading the right file (as the folder read may contain various files).I use a StringSearcher transformer twice, once to identify that the files that are an xlslx and again to try and identify the date that is contained in the filename. I'll later discard the older files and only read in and store data from the newest file.The filenames are formatted like Test_Test_240519.xlslx but the logger/inspector suggests that only the first number is being returned in the destination attribute.The regex is a simple /d. I have also tried [0-9].We're currently on FME 2017.0.1.1 but will be upgrading shortly - maybe this is an old bug but it seems odd that I can't find anything about it online?

I need help creating two workbenches that convert DGN to a GDB, and separately a DWG to GDB?I have a huge workbench someone previous to my role has created, but it doesn't seem to work for all of the data. It is set to create a spreadsheet to show those that didn't work. Can anyone shed any light? I feel starting back to basics is better than tackling the giant workbench I already have, it's too confusing for me to crack, and it is sensitive information so I'm unable to share it.  

Hello Team,I could able to zip a text file when i created separate workbench to zip the text file,But same thing when i did with my master workspace which contains different readers and arcSDE write at that time it is not giving output as .ZIP.What could be the reason for this unexpected results? and is there any other way around to fix the issue?I cannot use WorkspaceRunner as my master workspace run through server job.Following are the screenshots of my workspaces, Below workspace Zipping the downloaded file through HTTPCaller, Same incorporated with master workspace, Which was not giving expected results,

I have tried using the BREpSolidBoundaryCreator Custom Transformer that has been very kindly created by Takashi.I'm using FME 2019 (Build 19238)Log suggests some issues with Python libraries (see attached image).Has anyone else come across this ???Is this Transformer Compatible with FME 2019 ???.................Any help much appreciatedRegardsHoward L'@takashi