Using transformers to modify data.
Recently active
Hello!I have SHP file with the bunch of streets. There are many streets with the same name which is ok - streets with the same name can exist. But also there are some streets with the same name which are actually one street but entered as two different features instead of the one feature. So those streets have two geometries and the same name and are actually one street. I want to isolate (select) such streets. Is there any suggestion how can it be done in FME?So, for example, street with the name "Oak street" can have splitted geometry in one location but also there can be many other "Oak streets" in other locations (some of them regular with only one geometry, but also maybe other with also splitted geometries).So, the idea is to select streets with the same name which are in the neighborhood of 100m (for example 100m - the assumption is that those are most likely streets with the splitted geometry).I would appreciate any help and thanks in advanced!
When I execute the query in TOAD there are 1.6 million records are fetching. But when i used the same query inside fme it fetched only 138000(138 thousand records), And i Am using http caller in this fmw file. Is the http caller culprit here?fmw screen shot attached.toad shows 1.47 millon because already 138 k records written to destination and we changed the flag field nax match status to yes. and in this query we take only nax match status is NULLexplanation : I used this statement inside fme using executornext i am creating text string to ingest to HTTP CallerHttpcaller takes approx 1 second to get the responseeverything worked good, fme said successful, No error msg. But only 138 thousand came to destination table. i am really surprised.how can we fix this issue?
Does anyone know how best to use the 'LogMessageStreamer' transformer in FME to capture all logging errors. I know it has to run at the end of the Workspace to do this but as it has no input it is difficult to do this even when you set the run order to be last. I have also tried to make sure it is the last transformer I add to the Workspace but when I look at the log file after a run it has not been executed last, so if an error occurs after this it will not pick up the errors or failures from the Workspace run. I need to do this because these Workspaces are scheduled on FME Server and we need to know if something is failing over the weekend and keep a record of the errors or failures without going through lots of log files on the Server. This transformer is the perfect one to use for my purpose if it could pick up all the errors during a Workspace run as some of these errors do not necessarily terminate the Workspace. I am trying to be a bit more sophisticated with the capturi
I have some vehicle GPS tracking lines. The lines have gaps in them. I want to join the lines.The data is ordered and categorised so I can use a Chopper to chop the lines into vertices and then a LineBuilder with "Group By" set to the vehicle Type and "Group By Mode" set to "Process When Group Changes" to rebuild the lines with gaps joined.However, in the source, consecutive lines may be a different vehicle of the same Type (I can see they are different vehicles but there is nothing in the data to differentiate individual vehicles), so I get unwanted connections.There are two methods I could use to prevent most of these unwanted connections:if the distance to the next line is too far do not create a connectionthe source data contains start and finish times for each track, so if the finish time of the current line is after the start time of the next one, do not create a connectionBut I'm not sure how to do either of these - can anyone help?
Hi,Can any one help me how to use crossing in spatial relations like spatial realtor or spatial filter or any similar.I have seen in LinkPratap
When I run exercise 1.1 (intro to desktop) I get the following error message: "During translation, some features were read that did not match a reader feature type in the workspace. This can happen if the reader dataset is changed, or a reader feature type removed or renamed."My main canvas appears different to the one in displayed in the video. The "clean up attributes" and "fix inconsistent local area names" sections are both blank. As a result the "311-requests" writer is not linked to anything, and has no output. I have wasted a lot of time trying to figure out why this is happening. The video is no help at all. Thanks in advance.
I am trying to connect to AWS for one of my workbenches. when adding a new database connection, it succeeds, but if I try to use the same connection as 'embedded database connection' in joiner, this fails. error says FME edition does not support this reader. FME version 2017.1 being used
Summary:I need assistance applying a header (a feature that only contains field names) to a large dataset that is formatted without field names.Data:I have a massive dataset (~17 million records) that has been split into 17 chunks, each one containing ~1 million records. In each of these files there are ~150 unique fields, none of which have a proper name. So when loading a chunk of 1 million records, the field names default to col0, col1, col2 etc. Then I have a separate header file, which has the correct ordering of field names that needs to be applied over the default values.Problem:Applying the header to a large number of attributes stored in different datasets, without typing them individually.Bad solutions: Attribute manager / attribute renamer would work, however its tedious and not a good use of time to type out the field names of all 150 attributes. Bulk Attribute Renamer has a cool import button that can be used. Unfortunately the import option only works on one half (input o
I need to create a UAV mission route based off a grid of points within a polygon. Any tips, suggestions? I'm new to UAV mission planning. How can I get the points in the correct order?
I am looking at valve turning data from a hand held device which is stored in an access database.The database has torque charts stored as an attribute in one of the tables ,It is an encoded (UTF-16LE)My intention is to split this into separate columns and make an histogram chart from it.Any direction on how to get at it will be very much appreciated.
Hi, can anyone assist?I have thousands of .tif images and reprojected them (esriReprojector (custom transformation)), however they now all have black lines around them and that comes up in the mosaicked image. I found a couple suggestions that I tried; first I tried using the already mosaicked image and then reproject - while the blank mosaic is projected, once I get to the writer and add the rasters back, the data reverts to the original coordinates. Next I tried using the RasterBandNoDataSetter option but that gave me large white blotches all over my images... I am out of options now BUT I need to get this solved as the on-the-fly projection is not an option for our current project.
I'm building a flow that uses the MapnikRasterizer for building a legend but getting some unexpected results. The flow below creates a object in creator 4 and the AC adds a URL/path of the SVG to this object. The MapnikRasterizer replaces this point with the SVG using the symbolizer marker and the URL created with the AC in the file parameter under the marker parameters. See the fmwt file below for the flow and the files.The hello.svg and hello2.svg works fine with this but getting some weird results when using the hatch.svg.<?xml version="1.0"?><svg xmlns="http://www.w3.org/2000/svg" version="1.1" baseProfile="full" width="122" height="122"> <g transform="translate(0 0)"></g> <g transform="translate(0 0)"> <rect x="0.5" y="0.5" width="21" height="21" fill="#ffff40" fill-opacity="1" stroke="#000000" stroke-width="1" stroke-dasharray=""/> <pattern id="D3B19CBA-2005-7FB3-52A547FFC3CD3D34" patternUnits="userSpaceOnUse" width="115" height="18"
Hi guys, I have a speed limit dataset with over 3,000 line features which represents road segments that have been chunked up into several bits.I'd like to optimize the dataset by linking road segments that are related. The related road segments have a common road name, and speed limit. However, there are two more attributes for each road segment: from_ufi and to_ufi. As an example, segment 1 will have 222 and 242 for from_ufi and to_ufi attributes respectively. Segment 2 will have 195 and 222 for from_ufi and to_ufi attributes respectively.The challenge is connecting segment 1 and segment 2 using the from_ufi attribute for segment 1 and to_ufi for segment 2.I'm new to FME so the easier, most efficient solution would be appreciated. Is there a way to do this in FME? What transformers can be used for this task?Appreciate your help in advance. Regards, Dennis
HelloI am trying to use Area Gap and Overlap cleaner to clean up data after dissolve transformer. but it is not keeping the boundary intact for polygon that are inside another polygon but part of different group.see attached. how can I fix this? this should not be selecting inside but boundary of inner polygon. i attached pic of settings for Area Gap cleaner.Thanks!
When viewing in FME Data inspector it shows the bands as Band 0 (RED16), Band 1 (GREEN16), Band 2 (BLUE16), and Band 3 (UINT16) but the image in the viewer is black. I am able to view it in ArcMAP fine (although it is mainly red because ArcMAP is interpretting the NIR as the red band, the Red band as blue, and the Blue band as green.
Is there a way that FME can "bypass" the native format of .img Garmin (or intermediate format?) so I can create a transparent map to add on top of an official Trackmaps in both BaseCamp and GPS?
Hello FME Community, I need some help for some topics for a FME talk. Next week I'm gonna hold a talk for some coders which have not heard about FME, or is well know to the world of GIS, but they were interested letting me talk about FME. These guys are very familiar to docker, fullstack js, databases and so on.Have anyone had a talk about what FME can do to a bunch of coders? I was thinking in the direction of how to make all your databases and files related? But, I got a amnesia when it comes to thinking creative. Have anyone done something similar and want to share their presentation with the community? Best RegardsPaal
I have two polygons, one of parcels and one of building footprints. I am trying to merge the attributes of the parcels to the buildings. A Spatial Relator or Filter would be the obvious answer, but some of the building footprints overlap more than one parcel. I want to merge the attributes of the parcel the building is found MOSTLY within. In the case of the below picture, the red building is adopting the parcel attributes of #2. Is there a way I can prioritize the amount of overlap determining which attributes are joined, therefore adopting parcel 1?
I'm pretty sure that when using an IN clause in the tester, a comma separated list of values could be used as long as there were no spaces, there was no need for additional quotes. However, it looks like there is an issue with the tester - if i send a list with no quotes, everything passes! If the quotes are required due to the presence of the hyphen, then surely the middle option should fail everything rather than pass everything?FME 2019.1.0.0 (Build 19608 WIN32)
I try to drape a high resolution orthophoto (12'000x12'000pix) to a TIN with the AppearanceSetter. But I only get an black surface. When I resize my orthophoto to 3'000x3'000 Pixel everything works fine. Is this a limitation in the AppearanceSetter? Is there an other solution to keep the high resolution? Thank you very in advance! Dominik
Hi! I have a set of 2D polylines, where I want to assign different z-values on the start and end node coordinates. The values I want to set are stored as attributes (let's call them "z_start" and "z_end"). Is there an easy way to achieve that?
Hi, I have data coming on on a daily basis to a table with no ID field. The data is a volume recorded by a meter every 15 minutes. A user on here called @Takashi kindly helped to put the workspace together, which creates a volume every 15 minutes even if the data is missing (it adds a 0). However, I did this on an INSERT statement and am now finding that new files are coming in that update the previous values. I didn't account for this. I need to alter my workspace to:find if a record already existsif the record exists and is not zero don't update the fieldif the record doesn't exist add the data.Any idea how I do this? I'm not sure whether to use a ChangeDetector, FeatureMerger or FeatureJoiner and so am a bit confused! ThanksNeil
Hello, Not sure if I have phrased the question correctly, but this is what I need to do:I'm processing signal data from text files. The data has attributes on each of the 7 rows, then the actual signal values in rows underneath. I'm using a VariableSetter and VariableRetriever successfully to process the data as each file has a different meter id or signal date.I now need to process the data into 15 minutes intervals which I have done. However, these 15 minutes intervals (96 in one day) need to be aligned to a master table to fill in the blank rows where no signal data was received for the missing 15 minute intervals.I can use a FeatureMerger / FeatureJoiner to join my two datasets by the 15 minute datetime, but this doesn't transpose the actual meter data (meter id, other ids, date of data) into the empty fields, and I need to do this to build the 96 interval profile for each text file.Any ideas how I can fill in these missing values when I join the tables together? Apolog
how to write recap with intensity info from E57The color value and intensity are not saved in the Recap
I'm trying to figure out how to create the table (Output) from a single column table below.In R, the function pair.matrix does what I need https://www.rdocumentation.org/packages/cape/versions/2.0.2/topics/pair.matrix How can I replicate this? Input Output idname idnameid2name21apple 1apple1apple2banana 1apple2banana3carrot 1apple3carrot 2banana1apple 2banana2banana 2banana3carrot 3carrot1apple 3carrot2banana 3carrot3carrot