Using transformers to modify data.
Recently active
I have a csv file that is stored in a secure location that I cannot save locally for processing. I am accessing the file through the FTP caller and downloading it as an attribute. When I view what is returned the entire contents of the csv file are returned in a single cell of the resulting table. How do I parse the cell to turn it back into rows and columns of data? The processing of the data must be handled in memory with the data never being stored at rest without encryption. Thanks!
Hi there,I'm trying to get grid locations from a polygon fgdb feature class attribute for the start and end of a fgdb line feature class. The attribute I need to put into the line data is a GRID ID (shown below). I've created two different scripts that seem to work, although all the writers have null values in both GRID_ID columns. I've attached a screenshot of the data in arc, and my workspace. In the second attempt of the workspace, the clipper doesn't output any features inside it.
Currently trying to add a distance field in my shp file that will state the distance from 1 polyline to its closest neighbor polyline in the same shp file and after running the neighbourfinder as seen below (for candidate only) There were matched and also unmatched data. There were also addition fields seen below which stated the closest distance for the matched data however when I exported this data to a writer it did not include these additional fields. I'm unsure if this is the correct methodology to obtain the results I desire.
So i have a vessel dataset of points that has a position time and mmsi field that i want to create a line for each mmsi using the time field.
I'm starting to create 3D modeling with FME and I can't find the way to create flat 3D surfaces from 2D geometry.With the Bufferer everything is rounded. How can I create a cube from a point? Or a building from a squared polygon?For example, how can I create this building from a 2D polygon?Thanks
I try to create an Erdas Imagine (.img) with Mapnikrasterizer in RGB24. In this transformer, I set a transparent background, but when I open it in Google Earth, there is no more transparency. Background is all black. What can I do to keep my transparent backgroung?
Hi, I have a workspace that snaps my "From-To"-line to the end-point, which is working fine.However, I have some adresses which I want to route to the nearest object. So therefore I would want to start the line from the nearest position possible in the network, not from end-point (because the distances can vary very much between them).I´ve tried the "LineDivider" to create more lines and therefore get more end-points, which works, but seems to be a little bit over-worked.Is it possible to snap the "From-To"-line to a vertex of the network (instead of the end-point) in any other way, run the "ShortestPathFinder" and get a result? (I´ve tried the "AnchoredSnapper" with "Vertex snapping", but that only generates a "NoPath").It seems odd only to be able to find the shortest path from end-point to end-point.
Hi there,I have a text file containing 1 line with a length of ca. 40 billion characters. I need to parse the line into seperate lines, each 256 characters long.I have tried multiple configurations looping with the AttributeSplitter (to parse the lines into a list and write it ) in conjunction with the StringReplacer (to erase the characters parsed) but I keep hitting resources limitations, mainly memory.I am running it on a 64bit OS machine with 16Gb RAM, but apparently that is not enough.Has anybody done something similar and can share some insights on how to keep the memory eating capacity of FME down to the minimum?Is there a better way to parse the file, than standard FME transformers?Any help is appreciated.Itay
Hi I have used SQLCreator to query multiple tables in SDE using various criteria and end up with a list of IDs.I would now like to pass the list of IDs to a FeatureReader, so that I can reduce the number of records to read.Any idea how I can build the whereclause to pass to the featurereader? I would like to build single sql as ID=any(1,2,3,4...2000)
Hi,How can I split a large dataset into multiple CSV datasets?I have to split them so that each record contains max 5 million datas (rows).I have about 25 mils of data. So need to have about 5 separated CSVs.How can I set the writer (or reader) or maybe which transformer ta add to splitt them after writing 5 mils of them?Thanks a lot!
Hi FME'ers,You might have noticed I've been a bit slack about awarding site badges recently. Apologies for that, but I'm concentrating on the community more now (lot's of exciting things to come) and so here are some badge awards.100,000th PostYes, it's a big one! We officially reached 100,000 posts to the community sometime earlier today. The person who made that post.... @tono with a question on writing charts in Excel (look at the ID number in the URL).Tono (whose profile page tells me is Antonio from Trondheim, Norway) wins the prestigious 100K badge on the site, the only person who ever has, or ever will, win this award.Congratulations. I'm also checking with our marketing team to see if we can send you a choice and rare item of treasure from our swag cupboard.And speaking of treasure...Talk Like a Pirate DayAaargh, ye knoe this badge of olde. It be for posting a question on Talk Like a Pirate Day. This year there be seventeen (17!) winners o' this awar
Hello I am looking to perform the following operation : - transform the value of my column into a column attribute. table A ==> table B colA val1 val2 val3 (that's my new columns) val1 val2 val3 How to do it simply? With which transformer ? (actually to my mind I guess it's the opposite of transpose transformer)I know the AttributeCreator but these parameters are static (I dont want to fill all the fields) thank you
So, FME has this fabulous transformer, the "Center Line Replacer." But when you're trying to get the centerline of a lake, sometimes it doesn't work so well:Now, I'm a reasonably smart dude, but I have yet been able to figure out how to get a single, longest distance line out of this net.Does anyone know how?Many thanks in advance!Johnny
Hello,I am curious of there is a setting or ability to ignore "insert errors" related to primary key constraints in a SQL Database. The workspace writer is doings its job by not allowing duplicate keys to be created but I would like to override/ignore these errors to allow the workspace to continue and finish successfully.I know I could use an UpdateDetector or reader from the destination to prevent these inserts from hitting the writer but this will really slow down the process to read all existing records to perform this compare. I was hoping to set a SQL writer or workspace property to allow the workspace to continue when a duplicate key is encoutered. Any tips or techniques for this situation without actually reading the destination and comparing the input records?Thanks Ronnie
I have one feature layer with lines that are not topologically cleaned. There are many lines that are partly duplicated with shorter lines. Except FID, other attributes are the same.Any suggestions how to identify duplicate polylines (short lines)? LineOnLineOverlayer dont work for me.
I have several MapInfo map layers that I want to generate and send to my client as an image. I see that https://community.safe.com/s/article/creating-pdf-cartographic-output offers a way to render as PDF, but is there a similar method to render multiple layers to a PDF? Ideally I would want render a report with several pieces:An underlying map layer with streets, parks, terrain etc.Highway layers for the major roads in the areaCustom elements layer, with labelsSparse color-thematic grid overlayLegend for the color thematicAdditional footer for some standard text information.And some alpha transparency to a couple of the layers.
Hello.. I was wondering if it is even possible to create a time lapse map scene for construction happening across BC over time. Please have a look at the snapshot of the video. This is something i am looking for. Any ideas folks?Thanks in advance
Hello.. I have a bunch of properties across BC stored as a table in SQL studio where the address fields are null. I don't know how to find the address. I have gdb files of the parcels and have latitude longitude information as well but i do not know to use these to extract the address. Is there any way to be able to do this without any cost. Is there a way to create own geocoder? Any suggestion.?These are the tables I have. Basically I am looking in to populate these fields.[PA_ApartSuite] ,[PA_StreetFrom] ,[PA_StreetTo] ,[PA_StreetDir] ,[PA_StreetName] ,[PA_City]I have around 100K properties to be reverse geocoded. Also the lat long information was extracted using the Assesment Fabric Gdb file shown below.I also have geodatabase file for all the parcels across BC.. Don't know if it can be put to use in anyway..Also, I do have QGIS but not ArcGIS.Any help will be much appreciated. Thanks in advance
i have group of values with different color codes. When I run the transformer, it considers only first row color for all bars. Actually Bar colors should vary based on color attribute , Really appreciable if anyone can help on this ?
I used the clipper transformer to clip my dwg, (a shapefile being the clipper). The transformation worked with no errors, but when I go to inspect the output it has lost it's crs. Have looked around and there doesn't appear to be any information our there on this, any help would be great. Thanks
Hello,I am trying to read WMS imagery data via a FeatureReader, but the resulting output (using a Bufferer transformer) is just a single coloured box with no image. Can anyone tell me where I'm going wrong? Snapshots of the FeatureReader are as follows:
Hi,I have a folder full of las files from a big area, but I want to find out which las files exactly are inside my zone if interest (.shp) . I have tried a hullaccumulator to get a hull from each point cloud, to then compare these with my .shp file using a SpatialRelator, but it doesn't seem to work or I did something wrong in the options. My goal is to obtain a list of these las files.Cheers
HiDoes anybody know how to solve this? Is it only in the twentieth file or are all the files troublesome?
Hi all,I am trying to create PDF maps which show points and areas from a Geodatabase, overlaid on imagery from a WMS connection. Each image in the PDF needs to show the point from the GeoDB at its centre, and be zoomed to a uniform distance so that the areas from the GeoDB and WMS imagery are visible. Can anyone tell me where I need to start? I've made several attempts with a few different transformers, and I'm getting nowhere.Thanks in advance!
Hi there,I've been using the adjacent feature functionality and I'm really impressed with how useful it is once I wrapped my head around it. However, I'm a little stuck now.Here's an example of what my data looks like:WeekPlaceLength% Difference1Village1298938.438-2Village1299198.1190.023Village130032.0970.091Forest11038.854-99.152Forest11036.975-0.023Forest11140.5470.94 So the "% Difference" I'm calculating via adjacent features in an AttributeCreator (Just to get the % difference of length based on the length of the previous entry:New AttributeAttribute Value% Difference@round(@mult(@div(@sub(@Value(Length),@Value(feature[-1].Length)),@Value(feature[-1].Length)),100),2) This all works perfectly and exactly as I hoped for, except the issue of having "99.15 % Difference" when going from Village to Forest. That number is huge and not actually something I'm interested in, as I want it to "Start over" once it gets to a new "Place