Using transformers to modify data.
Recently active
I have a set of lines which need to be combined. For that I use the LineCombiner. Some of the resulting lines are self-intersecting. That causes problems later in my workspace. A GeometryValidator can correct self-intersections, but is there a way to prevent self-intersections from occurring?In the attached file are some lines which result in self-intersections.
Hi all.This is occuring on FME Workbench 2019.1.I'm using an HTMLReportGenerator to create a table that should have 10 rows. However, I get the 10 expected rows, plus many more that simply say "None." (see attached photo). The 10 features come from a SQLExecutor and I've checked the output with an inspector and have confirmed that there are only 10 rows. The HTMLReportGenerator output isn't very telling, but here's a snippet of where the "None" values begin: <tr> <td>Point Loma</td> <td>108</td> </tr> <tr> <td>None</td> <td>None</td> </tr>I've tried replacing all instances of<tr> <td>None</td> <td>None</td> </tr>with empty space but that didn't change anything. How can I completely remove these rows from the table? Example photo:
Hate to be vague with my question. It's quite possible the solution lies outside of FME, too.I have inherited a large workspace with multiple SQL Creators that use ODBC connections. There is a database name listed, and under 'Parameters' there are credentials. There is a SQL statement. Neither tables nor dataset sound familiar.So I have no idea what this actually connects to. There is no way for me to find that through FME, is there? I'm thinking this was either setup through DSN but I haven't located a file, or another way. Any insights would be helpful.
Have data in a non-spatial SQL database stored in a field titled "WKTPolygon" with geometry structured as shown below:MULTIPOLYGON (((257187.77487182617 252016.49029541016, 257197.35565185547 252041.80303955078, 257216.97064208984, etc etcTried all the suggestions from google searching and Geometry Replacer creates lots of individual vertex points for the polygon geometry, but not actual polygons, and all the others error on the first record. Cheers. M
Hi,I am trying to copy a selection of dwg's from one folder to another. I am using the filecopy writer to achieve this. I am having a problem however, with the original dwg's the units are set to metric, but when I copy them to the new destination using filecopy they switch to imperial. I can't see any settings to change this, would anyone know how to keep these as metric?ThanksBedit. I have uploaded the workspace also. Thanks for the help..
Hello,I want to resize an image. Per example 1000*1000 pixels to 200*200 pixels.I tried RasterResampler, but I only get a degradation of the image, with the same size.Is there a way to do that?This is not my family : legacy from Google Images. In M$Paint I would use this.
I have just updated some older workspaces that use dissolver transformes. Hoping for a performance boost, I upgraded all dissolvers to the current version (within FME 2019.1.3). For some reason, this has lead to the workspaces crashing. The error message being displayed is "Insufficient memory available". I am trying to dissolve a dataset of ~8.000 features read from a shapefile which should yield ~100 features after dissolving. Looking at the windows task manager I can see the fme process using all my physical memory (16GB). The swap file generated by windows is about 16gb as well. Before upgrading the transformers, this workspace used to run without any issues in FME 2018.X.Since the features are ordered, I have also tried using group by mode "process when group changes" but the result ist the same.Do you have any ideas on how to work around this?
Is this behavior correct? I receive the data but looks to be a certain length tweet will show some info then truncate the rest into a url to the tweet? e.g - Library. There will be… https://t.co/DvNRaQifFE
I have a dwg file (AutoCad) with apparently no coordinates system. It looks like it is using a sort of arbitrary coordinates.I am looking for a way to Aling that drawing on a CanQ-M8 coordinates system.I know that I will probably need to offset the coordinates, rotate the map and maybe strech or shrink the drawing to make it fit.Is there any tools to do it ?Attached is the dwg drawing that I want to align on the base map (also attached)I only need the layer 41 of the dwg map.Thank youMathieu.
Hi,I tried to convert kml into dwg, but the schema of attributes is empty.How can I get all the attributes from KML into the dwg? thanks
Howdy,I am reading with an AutoCAD .dwg and I need FME to generate a bounding polygon around annotation text as the text it appears in Inspector.I used the BoundingBoxReplacer to generate a polygon for the extents of the text, however as you can see in the screen capture below the bounding box output is significantly smaller than the text as the text appears in the Inspector. Can someone please help me understand how FME is deciding the size/extents of the bounding box? What do I need to do get a bounding box output that matches up with the actual text extents?? Please see the attached data if needed: Thank you!
Hi,I try to use the Rcaller in FME to perform zonal statistics. My input is a shapefile and a Geotiff, however i read that the Rcaller reads it as a dataframe when imported into R. I tried to convert it in the Rcaller back to a shapefile and raster (with rasterFromXYZ('dataframe) and SpatialPointsDataFrame() ), but i got a error that the X and Y coordinates are missing and I cannot figure out how to include them?In R would normaly perform a zonal statistics in the following way:setwd('location\\files) library(raster) library(rgdal) shape <- readOGR(dsn = "Shapefile.shp") DEM <- raster("Elevation")#extract raster cell count (sum) within each polygon area ex <- extract(DEM, shape, fun=sum, na.rm=TRUE, df=TRUE) My FME canvas looks at following:Can somebody help me with an example or url reference to one? Thanks for considering my request!
I have a csv file that is stored in a secure location that I cannot save locally for processing. I am accessing the file through the FTP caller and downloading it as an attribute. When I view what is returned the entire contents of the csv file are returned in a single cell of the resulting table. How do I parse the cell to turn it back into rows and columns of data? The processing of the data must be handled in memory with the data never being stored at rest without encryption. Thanks!
Hi there,I'm trying to get grid locations from a polygon fgdb feature class attribute for the start and end of a fgdb line feature class. The attribute I need to put into the line data is a GRID ID (shown below). I've created two different scripts that seem to work, although all the writers have null values in both GRID_ID columns. I've attached a screenshot of the data in arc, and my workspace. In the second attempt of the workspace, the clipper doesn't output any features inside it.
Currently trying to add a distance field in my shp file that will state the distance from 1 polyline to its closest neighbor polyline in the same shp file and after running the neighbourfinder as seen below (for candidate only) There were matched and also unmatched data. There were also addition fields seen below which stated the closest distance for the matched data however when I exported this data to a writer it did not include these additional fields. I'm unsure if this is the correct methodology to obtain the results I desire.
So i have a vessel dataset of points that has a position time and mmsi field that i want to create a line for each mmsi using the time field.
I'm starting to create 3D modeling with FME and I can't find the way to create flat 3D surfaces from 2D geometry.With the Bufferer everything is rounded. How can I create a cube from a point? Or a building from a squared polygon?For example, how can I create this building from a 2D polygon?Thanks
I try to create an Erdas Imagine (.img) with Mapnikrasterizer in RGB24. In this transformer, I set a transparent background, but when I open it in Google Earth, there is no more transparency. Background is all black. What can I do to keep my transparent backgroung?
Hi, I have a workspace that snaps my "From-To"-line to the end-point, which is working fine.However, I have some adresses which I want to route to the nearest object. So therefore I would want to start the line from the nearest position possible in the network, not from end-point (because the distances can vary very much between them).I´ve tried the "LineDivider" to create more lines and therefore get more end-points, which works, but seems to be a little bit over-worked.Is it possible to snap the "From-To"-line to a vertex of the network (instead of the end-point) in any other way, run the "ShortestPathFinder" and get a result? (I´ve tried the "AnchoredSnapper" with "Vertex snapping", but that only generates a "NoPath").It seems odd only to be able to find the shortest path from end-point to end-point.
Hi there,I have a text file containing 1 line with a length of ca. 40 billion characters. I need to parse the line into seperate lines, each 256 characters long.I have tried multiple configurations looping with the AttributeSplitter (to parse the lines into a list and write it ) in conjunction with the StringReplacer (to erase the characters parsed) but I keep hitting resources limitations, mainly memory.I am running it on a 64bit OS machine with 16Gb RAM, but apparently that is not enough.Has anybody done something similar and can share some insights on how to keep the memory eating capacity of FME down to the minimum?Is there a better way to parse the file, than standard FME transformers?Any help is appreciated.Itay
Hi I have used SQLCreator to query multiple tables in SDE using various criteria and end up with a list of IDs.I would now like to pass the list of IDs to a FeatureReader, so that I can reduce the number of records to read.Any idea how I can build the whereclause to pass to the featurereader? I would like to build single sql as ID=any(1,2,3,4...2000)
Hi,How can I split a large dataset into multiple CSV datasets?I have to split them so that each record contains max 5 million datas (rows).I have about 25 mils of data. So need to have about 5 separated CSVs.How can I set the writer (or reader) or maybe which transformer ta add to splitt them after writing 5 mils of them?Thanks a lot!
Hi FME'ers,You might have noticed I've been a bit slack about awarding site badges recently. Apologies for that, but I'm concentrating on the community more now (lot's of exciting things to come) and so here are some badge awards.100,000th PostYes, it's a big one! We officially reached 100,000 posts to the community sometime earlier today. The person who made that post.... @tono with a question on writing charts in Excel (look at the ID number in the URL).Tono (whose profile page tells me is Antonio from Trondheim, Norway) wins the prestigious 100K badge on the site, the only person who ever has, or ever will, win this award.Congratulations. I'm also checking with our marketing team to see if we can send you a choice and rare item of treasure from our swag cupboard.And speaking of treasure...Talk Like a Pirate DayAaargh, ye knoe this badge of olde. It be for posting a question on Talk Like a Pirate Day. This year there be seventeen (17!) winners o' this awar
Hello I am looking to perform the following operation : - transform the value of my column into a column attribute. table A ==> table B colA val1 val2 val3 (that's my new columns) val1 val2 val3 How to do it simply? With which transformer ? (actually to my mind I guess it's the opposite of transpose transformer)I know the AttributeCreator but these parameters are static (I dont want to fill all the fields) thank you
So, FME has this fabulous transformer, the "Center Line Replacer." But when you're trying to get the centerline of a lake, sometimes it doesn't work so well:Now, I'm a reasonably smart dude, but I have yet been able to figure out how to get a single, longest distance line out of this net.Does anyone know how?Many thanks in advance!Johnny