Using transformers to modify data.
Recently active
I have developed some scripts to massage data from one SQL db, spatialize features, then write to SDE db. They have been running for 2 yrs on FME Server (2017.1) fine for about a year. Then suddenly, all of them started to run real slow. There are about 20 scripts running serially (a master script kicks them off using fmeserverjobsubmitter). It used to run from 10pm until 1:30am, but now it has climbed from 3am (when the issue was first spotted) to 5am (latest run).We've looked at resources and saw that the memory was hitting the ceiling (we have 16GB on the virtual server). 8GB more were added 2 days ago and the memory was no longer hitting the ceiling, but scripts are still running until 5am.So now, we want to maybe check the connection to the database to see maybe if the read or the write is the issue. This is where I need help. I'm not sure how to go about that via fme workbench or even if it's possible? I created a workspace that only has the reader and a logger. But I
Hello,please, I have question about line merging. I have got data of furniture in buidling, but e.g. chest of drawers in 2D is chopped into 29 lines (check my pic below). What I need - merge all lines into one line feature. Unfortunately, there is no attribute what can define ID or unit of chest of drawers, so the geometry aggregation must be based on spatial touch. In drawing, there are lot of chests of drawers, not just one.Any tips please?Thank You so much!Lubo
Hi, I have 2 AGOL layers a polygon layer and a point layer were i need to snap the polygons to the points based on a unique asset ID. The points are in the right location and i have 4000 of the polygons grouped over 1 of the points but need them to move to their corresponding point.
Hi FME community I try to count the number of points (from *.las point cloud) in a solid. The solid comes from an extruded polygon. The goal of it is to figure out if the point cloud matches an existing 2D CAD Plan. To do this I take the polyline of the walls and extrude them. Afterwards I would like to count the number of point inside the extruded solid (wall). If this results in many points I can assume that the wall is correct - if not the wall must be incorrect. It would be great if someone has any idea and can help me. I only struggle with the count of the points in the solid. Thanks in advance and kind regards form Switzerland Dominik
Hi I have lots of features that have a datetime and some attributes, I need to group all the ones that happen in the same day on a single line. I need attributes A, B, C from the earliest item that day then I need to add attributes B and C from the other occurrences that day to the same text line.I have split the date time up so I can see the year day month and time as separate attributes if needed.If I have 4 attributes in a day then I would want them all grouped up into the same output text line exept the type needs tom come from the attribute with the earliest time type(A) datetime(B) height(C)90 2001-01-01T02:24:00 1091 2001-01-01T08:28:00 1590 2001-01-01T12:40:00 991 2001-01-01T23:24:00 1490 2001-02-01T02:24:00 891 2001-02-01T08:28:00 1690 2001-02-01T12:40:00 991 2001-02-01T23:24:00 12 so for the data above the 2 str
I used this transformer, and I need to create a value consecutive to could identify the parts consecutive, if you see the picture there ara a attribute "Loop to DistanceChopper_LOOP_Entrance1543350805 Input Splitter.BranchingFactory.Count (32 bit integer):" and each parts have a different vale and are consecutive but if i coul use this attribute. i can´t used it, if i create a new attribue and use this value but no apear. What can i do to use this vale.thank a lot whats happend with chat online??????? i see some days offline... :(
Hi, My question might be more of a bug report. Anyway, I noticed that my workflow didn't register a specific testfilter as 'incomplete', whereas other transformers usually do so. If I open the testfilter and have a look at the testclauses, then I do indeed see the 'old'/ 'non-available' attributes marked in red... Any others experiencing issues with this? Kind regards, Thijs
Hi,I'm using a JSONfragmenter to create a polygon from an attribute containing a geojson polygon.Everything goes fine, but if I add a reprojector the geometry become out of control: Here is a minimal example of my problem:
@takashiI am looking to clip each clipper ( circle ) against the clippee ( polygon), what I am getting from the transformer is 1 st the polygon will clip the first circle then the balance of the polygon will be clipped with the second circle from the transformer we should get 2 inside and 2 outside features
Is it possible to aggregate polygons with barriers (another layers)? Something like Aggregate Polygon in ArcGIS. I have to aggregate buildings (is specified distance 20 meters) with respect to layers of water, forests and roads.
We are trying to set up an AWS SQS and are hitting an issue when trying to send a message to the queue. The following warning is being displayed "The request must contain the parameter MessageGroupId". We have tried adding this in to the message attributes along with the value we have but still no luck. We can manually create a message using the AWS console and can also get a response in FME using the SQS Message Counter so credentials etc. are correct. Has anyone hit this issue before? Any help would be appreciated.@olivermorris
I've never used the ListBasedFeatureMerger before, the documentation suggests it might be what I want but it isn't working as I thoughtI'd assumed that if the Requestor had a list that looked likelist{0} = applelist{1} = bananalist{2} = cherryand the supplier had an attribute with value banana there would be an output via the merged port. Is this not correct?
What am I missing here?I'm using FME 20180926 - build 18552 if that matters.I want to merge two data streams in the Feature Merger and I know that there are duplicate suppliers so I've marked the "Process duplicate suppliers" option. Still the complete merged data isn't output on the "Merged" port as it should be. Here's an example script.Here's my example data:Here's a screenshot of the script after I've run it once:Here's a screenshot of the transformer settings:What exactly am I missing here? I've tried both with my regular data that I want to handle and this example data and I just can't get it to work as I expect. As far as I can tell none of the settings under "Process duplicate suppliers" matter when you're only using data and no geometry.
I have been using the pointonlineoverlayer to split lines when they are at the endpoint of another line. I use the coordinateextractor and vertexcreator transformers to create the points. While this works in general, I’ve noticed that in some cases the break in the split line is not at the same location as the enpoint of the other line. I am using snapper before this process, and plan on using snapper after it hoping it will put the points together. I am wondering if my pointonlineoverlayer settings are the cause. The settings are:
I'm building a flow that needs the total amount of (external) parts in a geometry feature. I need the total amount of parts from a single (thus 1) or multi-part (2+) feature for further statistical analysis. To get this i used the PartCounter that would give me the _part_count which returns the number of parts in the geometry. For multis and aggregates, this is the number of parts, and for paths, this is the number of segments. Otherwise, it is one.I would expect that, when using this on a single feature (donut). It would return the value 1 but in the attached example, and all other donuts that i tried, it returns the total amount of donuts + total amount of external parts. Would it be possible to get the partcount without the inner boundaries with another transformer without needing to fill the donutsholes with a DonuHoleFilter? or just get the outer boundary part count?Filling the donuts is quite time and CPU consuming (example for 10k objects but sets with x million could also b
Hi,Is it possible to set RasterReplacer raster format from attribute value ?Raster format has already been detected and saved in an csv file with raster filename.i want to read this csv file resample raster and save it.thanks in advance
Has anyone done any scheduled routing using GTFS data? I've been tasked with determining the length of time it takes to get to a specific location using public transport, from about 5 thousand starting points.
Hi, I am trying to apply texture for the building , it looks fine in FME inspector . If I try to open in FZK Viewer texture is not applied to the building. I also set the texture property in FZK viewer to "Entity".Please find the relative snapshots.
Hello there II have an attribute with the values like this (24 16 17.2) or this ( 25 7 17.2) we need to replace the first space with a letter A and second space with letter B and add letter W at the end we should get a result like this (24A16B17.2W) and this ( 25A7B17.2W) for the second caseAny idea, please Thanks
Hello, I have an entrance like this. I would like an exit like this. How to do it ? with the transform AttributeSplitter ? Thank you
I am reading a CSV file and need to change the values of one of the attributes according to the count of these values. The values are typically in the range of whole numbers 1 - 6 (might be more) with various total counts. I need to change these values so the most frequent gets a value of 1, the second gets 2, third gets 3 and the rest is deleted. In the example below: 6 is changed to 1, 4 is changed to 2, 1 to 3 and 2 is deleted. If the counts of any values are equal I should get an error. Attribute name6666444112 Thank you for your help.
Hi, I try to repeat this sample of LRS-Tasks on my data:Probably a beginner-question: How can I set/transfer the attribute 'von_km_l' as startvalue in my MeasureGenerator? After the five line segments are joined in one NLE(network linear element), I got the attribute on the treats: As you see, the needed value is avaliable within the trait-attribute. But how to set it as startvalue in the MeasureGenerator?Thanks and best regards from Berlin,Christoph
Hi,Is it possible to use FME functions like @DateTimeFormat in SQL Editors ?I would like to use the "SQL to run before write" field in my writer to create a backup of the destination table whose name contains the current date as suffix.Example:create table myschema.mytable_@DateTimeFormat(@DateTimeNow(), %Y%m%d)) as select * from myschema.mytable; But this doesn't work, even with single or double quotes around the FME functions... Thanks for any help,Christian
Hello.I have two entries : a rectangle and a numeric raster. The bounding box of the raster is included in the rectangle.I wouldlike to create a new raster with a bounding box corresponding to the rectangle (area outside the initial raster filled with nodata).The clipper can be used for such operations when the raster is wider than the rectangle but in my case, the clipper result bounding box is an intersection of the inputs.Do you know another way to proceed ?Thank you in advance.Paul
I have a problem with geting the backupConfiguration.fmw to work and have now looked into this problem alot. The error message I get is: HTTPCaller(HTTPFactory): HTTP/FTP Transfer: Failed to create file 'C:\\ProgramData\\Safe Software\\FME Server\\resources\\backups\\' for resource download ''url'' The below feature caused the translation to be terminated Storing feature(s) to FME feature store file `C:\\ProgramData\\Safe Software\\FME Server\\resources\\logs\\engine\\current\\jobs\\229000\\job_229856_log.ffs' (This logfile does not say anything more than the info above) There seams to be a problem accessing resources\\backups, but the user have this access and fmesuperuser role .If I use the url and token in a browser I get the backupfile. Anyone knows about this? Best/Johan