Transformers

Hello, I have an Timestamp attribute in UTC time (e.g. 20180311013252.000). I would like to create a new attribute converting the UTC Timestamp to EST/EDT Time. After that both attributes should be transformed to %Y%m%d. In this example the output should be 20180311 for UTC and 20180310 for EDT/EST.

Has anyone ever used FME to undertake a Least Squares Adjustment on survey data?

I have a geotiff file which I want to convert to an ecw file. Of course, I want the preserve the correct coordinate system during the transformation.The geotiff file is supplied with a MapInfo .tab file, of the same name, sitting in the same folder.I have found that the the existence of the .tab file means that FME does not read the correct coordinate system from the geotiff file. I have tested this by using a tif reader connected to a coordinateSystemExtractor transformer. The output coordinate system is "_MI_0" which results in an ecw with a datum of "RAW" which is wrong.But, if I delete the .tab file and then run my transformation, it goes correctly. I have tested this by using the same tif reader connected to a coordinateSystemExtractor. The output coordinate system is "MGA94-56" which is correct. The resulting ecw has a datum of "GDA94" and a projection of "SUTM56".Why does the presence of the .tab file disrupt the geotiff reader&#

Hello, I am trying to solve the problem with dangling roads in the network. Given the input of the roads, I simply ran it like this:  I assumed that the topologyBuilder would give me _node_angle{}, _node_angle{}.fme_arc_id and everything else, as per the docs,as the edges are perfect, but it seems that there is a challenge somewhere, as only _node_number is shown.  

Hi I have a question about writing French Characters (such as é).Here are my steps (an example)1. read (FeatureReader) xml file from an API (https://www.arcgis.com/sharing/rest/content/items/05e9d3d5adb64d4cb1447e0ed63e6a43/info/metadata/metadata.xml)2. here is the mxl file (not a whole file, just from begun to the line with French Character (É)) (see the last 2 lines)<?xml version="1.0" encoding="UTF-16"?><metadata><Esri><CreaDate>20181024</CreaDate><CreaTime>10205300</CreaTime><ArcGISFormat>1.0</ArcGISFormat></Esri><mdFileID>08d57ccf-ab9c-4006-948c-a458503a057b</mdFileID><mdLang><languageCode value="fre"></languageCode></mdLang><mdChar><CharSetCd value="004"></CharSetCd></mdChar><mdHrLv><ScopeCd value="005"></ScopeCd></mdHrLv><mdContact><rpIndName>Firstname Lastname</rpIndName&g

Hi, I am using FME Desktop 2015.1.I am running a process which includes a LineOnAreaOverlayer which I suspect is the source of the message, within the log window I get a message' Hit data-shattering case as 6463 new nodes were created after phase 2, compared to 1 nodes created after phase 1.' What does Data-Shattering mean within the context of the calculation factory process? In essence I am interested to know if this is something I need to worry about and attempt to mitigate somehow? If any given feature which has experienced data shattering within a transformer, is the output result from that tramsformer correct? Or has some sort of calculation collapse occurred and the result may be incorrect?I realise that data shattering may occur at a feature level and not necessarily to all feature which enter a transformer. Thanks in advance, Rob 

Hello, I am struggling to create nodes where lines intersect polygons. Basically, I have some points on a network and I need to create new points on the network that are 1 m away from that point. I thought I could buffer the original points by 1 m and then find where it intersects with the line (and then address the cases where it might intersect with other nearby line etc. later). However in the end results I got several additional points from the vertexes of the lines. How should I eliminate them? At the moment I use Bufferer -> GeometryCoercer to create line features, then do LineonLineOverlayer to intersect the network line and the buffer line.

This is the email format I am using as email notification for datadownload:<fmeblock type="optional">Thank you for using the ABC Portal. Your requested download of the dataset is now available under the following link:  {downloadUrl} #### (here I need to list down all the dataset title / name) ####  Please note that the link is only valid for 24 hours. After this time period you have to request the download of your selected dataset in the ABC Portal again.  With kind regards,  The team of the ABC Portal  -- ABC Data Portal www: https://ABCportal/index.html?lang=en e-mail: info@abc.com </fmeblock> ---------- i have a published parameter names 'FEATURE_TYPES' and this can contain all the dataset name but how I can use it here inside DataDownload_Email_JobSuccess Email Template? Kind RegardsMuqit Zoarder

Hey FME powerusers - Been working through how to scrape websites with the HTTPCaller and HTML Table Reader which are very powerful! Trying to parse and store data into a table format has been challenging. Eventually, the goal is to scrape or direct read the website, store data in a table for updates, and then update or build the website.From the information provided below, I’m having difficulty being able to associate each column between the COMM (col2) and associated PRODUCT_NAME (col1) to create the relationship. I wasn’t trying to get it elegant….just trying to walk through the process of how to parse strings effectively as well as using best practices from the FME community experience. Here’s a snapshot of using the HTML Table Reader parsed to get to this far:My goal is to create a table that will have the following data in this form - from the above table snapshot:ALPHA_CODECOMMPRODUCT_NAMEHAZ_RATINGAALFALFAROUNDUP POWERMAX HERBICIDE(1 1 1)AALFALFABRANDT ONSITE(X X X)AALFALFAP

Hello everybody,please, has anybody idea how to create from multilines polygon with holes (donut)?Feature below is composed by many lines, but I need to convert them to single donut.I also attached data sample of this feature.Thank You so much!Lubo

Hello everyone,This is just a short post to alert you to a couple of recent updates.Firstly, the DateTimes and FME tutorial has been revised for use with FME 2019. You can find it here: https://knowledge.safe.com/content/kbentry/715/working-with-date-and-time-attributes-tutorial.htmlThere's quite a lengthy section on using the newer transformers that explains how to handle datetimes with time zones, daylight savings, leap years, and more. Plus there's a new article that answers questions in general about datetimes, with links to documentation, knowledgebase ideas, and hub transformers. Plus, all the old content that relied on using TCL has been removed!Secondly, both the FME Desktop training courses have been updated to 2019.1. As usual, the content still works with 2019.0, but where there are differences or updates in .1, additional info boxes have been added to convey that information. All workspaces in FMEData are still 2019.0 compatible.The main changes relate to the Tester

Hi there, I have a shapefile layer containing 1500 points. I want to create a shapefile layer of 5 polygons in which all 5 polygons contain the same number of points for some data analysis work. I did try using the 'Cluster' transformer (which I could have then digitised around by hand) but each cluster contained a random number of points. Does anyone know how I could do this please?

Hello, can anyone help with this? I have a polyline dataset and need to create an output all multi-part features but only where there are gaps between the individual parts within a feature, i.e. at least one of the feature parts is not intersecting any of the other feature parts in any way. Thanks in advance.

I have 600+ bus lines that I need to make a single network from containing just the lines/roads the buses uses. The problem is that mostly the bus lines are made following a road network making all lines on most roads 100% parallel. But on not so few places the road network is missing so on those places the bus lines are hand plotted making them not parallel at all. Lines changes and this should therefor be updated two to three times annually. How can I use FME to automatically create those missing roads not in the road network out of the different hand plotted lines? Sometimes just one, but mostly 5-10 closely dotted line.

I have a directory containing several hundred raster images in geotiff formatI would like to convert them to ecw formatAs file space is limited, I would prefer to;- iterate through the geotiffs one by one- convert a geotiff into an ecw, saved in the same directory- delete the original geotiff- move onto the next geotiffCan anyone outline the structure of a workbench that does this?Thanks

I have a job that takes a polyline feature and dynamically segments it based on begin/end measure values provided by a merged table. This tool is built to work as a custom transformer that loops through multiple tables, utilizing the snipper tool, and outputs a heavily segmented line. Example of the measures below:  ROUTE_IDBEGIN_MEASUREEND_MEASURE1010110201253013040 This all works fine, except when gaps exist in the sequence of begin/end measures (see the gap between the end measure and begin measure of row 2-3). The snipper will only pass the snipped segment through the output. I need to keep the segments of the line that are not snipped. The remnants are useless as I would need to run a line on line overlay on all the remnants which is slow and not practical when I have 5000+ lines and hundreds of segments for each line. Unless someone can suggest another way of using remnants to find gaps, and overlaps if possible, but I've largely abandoned this approach. I've also attempt

I'm using the PointOnLineOverlayer to extract route/segment information including measures. However, when multiple routes are stacked on top of each other and I get a list of routes like this: When I scroll down to look at the measures, I only see 1 measure: Which line segment/route is this measure tied to? Is there a way to extract the measure from the route/segment of my choosing? I don't understand why the coordinates, including measures, couldn't be included in the list that is generated by the PointOnLineOverlayer. Thanks,Mark 

Im working with this original template(https://knowledge.safe.com/articles/59335/autocad-dwg-block-attribute-extraction.html). Same reader, but now the Writer is a Geotable. I have added additional transformers for coordinates and to extract attributes in multiple fields instead of one field with all attributes as a list. This is where my question takes place, If I am for example exposing 10 elements(from the AttributeSplitter) but only 6 elements have attribute data, How can I set it up to automatically remove/delete the 4 elements from the Writer that have null values? Attached is the file I am working with, which has the example I mentioned above.

I want to take a small data set like the one below and calculate the difference between each feature as either a matrix or as a 1:1 readoutInputMatrix outputPaired outputthe goal would be then to use this data to evaluate a matrix of points to determine their proximity in relationship of the nodes for the given point

i'm not looking to write out rasters to view this. I simply want to see the table of the information associated with the rasters. Is there anyway to write out a list or something?

Hello,I'm new with FME, and can't manage to solve an issue which seems simple. I would like to merge several rows in one, based on same values for 2 attributes. I've obtained a list of unique name/date combinations with the matcher transformer.Moreover, I'd like to create a unique feature for each match, using other attributes. I tried to explain it with the example below :I have the following data :IDNameDatePlace_APlace_BPlace_C1Tom26-07HouseMarketSchool2Tom26-07MarketSchoolShop 3Jerry26-07House Market School 4Jerry03-08Market School Shop   Since the Name and Date are unique for rows 1 and 2, I want to merge them in a unique feature (which would be chain_1-2.Then, I want to recreate a chaining House - Market - School - Shop, by comparing :- Place_B (1) with Place_A (2)- Place_B (2) with Place_A (3)- and so on. I'd like to obtain this kind of result :IDNameDateChain_link_1Chain_link_2Chain_link_3Chain_link_4chain_1-2 Tom 26-07 House Market School Shop 3 Jerry 26-

Hi! I have 3500+ 1:1000 topographic CAD files/tiles, each with thousands of features that I want to, ultimately, convert to shapefile and merge the tiles into 10*10 grid/mask that to reduce the number of folders.Here is what I have attempted so far:1. Convert CAD tiles into shapefiles (I accomplished this, see pictures below) 2. I have attempted to bulk load the folders (mulitple folder selction) into FME to convert to a File Geodatabase so that I can easily work with the large dataset in ArcGIS Pro- I'm missing something as the conversion is not working completely, only part of the dataset is getting converted3. I attempted converting the CAD tiles to Geodatabase and it failed.4. I've attempted both of all of these in QuickTranslator and in WorkbenchMaybe someone can offer up a good workflow (with pictures!) to convert 3500 CAD tiles with millions of features? I'm super new to FME and attempting to teach myself FME but I really want to accomplish this and cross it off my

In reader we have below cvs with one field.=================================Translation was SUCCESSFUL9.4 seconds. (CPU: 4.2s user, 2.7s system)================================== How I can get this in text like this: "Translation was SUCCESSFUL - 9.4 seconds."May be regex or something else

I have a need to check for data changes between two datasets (oracle tables). I initially configured the ChangeDetector comparing all of the attributes. The results were, all of the data from the “revised” port were identified as records to be added (some 300K plus records) and the data from the “original” port are identified as records to be deleted (som 300K plus records).There’s no unique key in this data. If I limit the number of attributes to check to 7 specific attributes, the “added” and “deleted” ports reflect more reasonable results. In other words, from a basic math perspective, the difference between the number of revised and original records calculate correctly (in the sense of finding “changes”).Essentially, all of the attribute values can change so I need to check for all of the attributes. I don’t understand why in configuring the ChangeDetector to check for all attributes, why the transformer behaves as if all of the records “changed”. I’m fairly new to using this parti

Hi, I've got a polygon feature as clipper, which has several polygons with no gaps and overlaps. After 500 meter buffering operation, there're some overlaps, and I'd like to use each buffered polygon to clip source data. But it seems that Clipper transformer couldn't perform such operation, in the help document it said "A feature can be clipped multiple times, but not iteratively (for example, if a line passes through two overlapping polygons, you don’t get a separate clipped line for the overlap - just one per polygon)."So I'm asking is there any way to perform a iterative clip?BTW, I use dynamic writer to output data, can I change output feature type name? I tried @jdh 's method, it worked but somehow, all fields of all features are same, but the original feature schema isn't that way. Is there a alterative method?Please help me out, much thanks!@takashi @mark2atsafe @markatsafe @jdh @david_r @erik_jan