Using transformers to modify data.
Recently active
Can anyone suggest a way to use FME to find gaps in a daily time series?I'm looking to generate a report for missing days of data in an effort to QC a dataset and know there must be a way to do this, right?
Hello FME users, I need to trim parts of a string and have been using the Attribute Trimmer's ReplaceRegEx function. I noticed however that while some fields are trimmed correctly while other's aren't. I have not be able to find a patter or correlation between the length or type of string that isn't trimmed perfectly vs. the ones that are. It looks like this:@ReplaceRegEx(<|| Toronto>,<|| Scarborough>,<|| Scarborough|| Toronto>,<|| East York>,<|| North York>,<|| York>,<|| Etobicoke>)The result:Notice how || Etobicoke is still there. I have tried different Attribute trimmer functions like ReplaceString or TrimLeft and the part I want to keep is sometimes trimmed off.Would you have any suggestions for a more effective method or this just a bug?Thanks in advance,
I'm trying to edit my workspace to handle the ovevrlapped polygons on the boundaries.How can I remove overlaps?Here I isolated a location. Dues to overlaps this location is falling under both the polygons. The boundaries on both sides of location are opposite boundaries of overlapped polygons. In other words, boundary shown on right would also be part of left polygon.Please note that this happens only when I write to Netezza.
Thoughts on the most efficient way to get a single raster with the max value from 50+ rasters with the caveat that the top 10% for each pixel need to be discarded. ex. if a pixel had the following values [0,7,3,7,2,6,8,2,3,1] then the result would be 7.If it has [4,6,8,2,4,9,5,4,9,2] it would be 9.Because of the percent clip, I cannot simply use a RasterMosaicker with Overlapping Values set to Max.The inputs are over 10GB of data, so I would prefer not to coerce to individual points if possible.
Hi,I use the LandXML template to create a LandXMLI would like to insert all the vertex in cgpointwith the template i can export 1 coordinate with Name and Code but i when i try to process my files (multiples points) its not working
I have the following string in an attribute: "Jan 1 1960; Jan 1 1900; Jan 1 1960; 01/05/1890; Jan 1 1960; Jan 1 1960; Jan 1 1960; Jan 1 1960; Jan 1 1960; Jan 1 1960; " I need to extract the earliest year from the attribute, since this is input from a reader the attribute will have different values, but the year will always be in a 4 digit format. I want to use a regular expression to extract the earliest year, in this case it would be 1890. Is this possible?
I like to rename all my attribute names using a list in Excel For example:- Current attributesAaaa | Bbbb | Cccc- Renaming listAaaa | Address Bbbb | Basenumber Cccc | ContactID- New attributes:Address | Basenumber | ContactID What are my options?
Hello, I have a problem with some transformers. I have two shapefile with TERYT number, one shapefile contains TERYT number for communes - e.g. 0201032 and second one TERYT number for country - e.g. 0201. As You see four first characters are the same. I have to trim from right side communes TERYT number to look like as country TERYT number. Secondly, I have to find this trimmed number in a list to say which communes are in the country. I used AttributeCreator to copy TERYT number, SubstringExtractor to trim commune TERYT number. Now, I would like to use TESTER to check if my new number is in the list and if it passed I would like to create new attriute with contains the name of country. Everything failed on TESTER. Could anyone help me?
Can we do location search based on lat/long in data inspector.I'm trying to locate few points on the polygons.
I have a csv file looking as below ATT1 ATT2 ATT3 New Attribute Fri Jun 24 08:01:00 2016 1.46676E+12 A Sat Jun 25 08:01:00 2016 1.46684E+12 A Thu Jul 07 08:01:00 2016 1.46788E+12 A Fri Jul 08 08:01:00 2016 1.46796E+12 A Sat Jul 09 08:01:00 2016 1.46805E+12 A Sun Jul 10 08:01:00 2016 1.46814E+12 B Mon Jul 11 08:01:00 2016 1.46822E+12 B Sat Sep 24 08:01:00 2016 1.4747E+12 B Sun Sep 25 08:01:00 2016 1.47479E+12 B I want to set the "New Attribute" to 'Yes' based on the "ATT3" value of the last row. Or i want to filter the records based on the ATT3 value of the last row.
<?xml version="1.0" encoding="utf-8"?><SDDOT> <item>...</item> <item> <id>497751</id> <status>active</status> <categories> <category> <name>conditions</name> </category> </categories> <descriptions> <description> <phrase>dry</phrase> </description> </descriptions> <locations> <location> <route>US-212</route> <direction>Both Directions</direction> <start> <lat>45.0056</lat> <lon>-102.8765</lon> <milepost>71.713</milepost> <landmark> <place>Mud Butte</place> </landmark> </start> <end> <lat>45.0231</lat> <lon>-102.0451</lon> <milepost>112.715</
For any users who aren't on Twitter, we are on the lookout for any users who have used FME to create maps, or prep data for maps. This is for an upcoming webinar, so we're looking for customer examples and experiences to share. If you've used FME to create some PNG or PDF outputs or used it to prepare data for a map we want to know what your workflow looked like. What transformers did you use? Did you face any challenges? If you've got something you're interested in sharing, let me know below!
Can somebody please help me understand how to use the python caller? I have looked at tutorials, older code and even help for the error i get which is - Python Exception <NameError>: global name '_file_contents' is not definedI am unable to resolve this. I need to match the coordinates in my shapefile to the coordinates in my point cloud file and extract the point cloud classification data. I have a number of unresolved issues with my logic but my important question is the followingHow do I import and manipulate attribute values in a python caller in fme?In my workspace, I have a shapefile with 12 points. I am extracting the coordinates of it and storing it as a string in the _file_contents variable [in format (x,y),(x,y), ]. I need to perform a lot of manipulations on this but to understand if I am using the transformer correctly, I am performing this first basic function of removing the last comma from my string. However, I keep getting the error I have posted above.I h
Hi FME'ers,It's that time to celebrate the top reputation-winning knowledgebase member for October.This - you'll remember - is the person who earned most reputation during a calendar month (and you had to be in the top ten with at least 100 points, and haven't won this before!)The winner for October is @cartoscro with a score of 410 reputation. It wasn't a high-scoring month, but he scored enough points to achieve the top-ten in most months so far. He joins the list of previous winners:@takashi@david_r@jeroenstiers@jdh@itay@gisinnovations@erik_jan@redgeographics@danilo_inovacaoThe top ten for October:david_r: 2153takashi: 1755erik_jan: 1195redgeographics: 955danilo_inovacao: 572cartoscro: 410jdh: 330larry: 310sander: 3051spatialdave: 288Congratulations to you all, but particularly to @cartoscro, and to @david_r and @takashi for being top of the list again and for so many months in a row. I know everyone here appreciates all your efforts highly.Mark
I have a dataset with a name field and an index field which is in order. I want to output a shapefile that orders the FID numbers like so in order but I can't figure out how to output the file without it randomnly assigning any number as the FID. It needs to be ordered correctly so any help with this one would be appreciated.FID Id Name0 1 Northland1 2 Auckland
I am having issues dissolving large sets of data, the Dissolver works fine and achieves the results I would expect but when I increase the number of data going in the process becomes painfully slow and often results in a crash because of memory.
Why can't ListExploder see result{} from a reader that reads json with the output of result type array?? I have tried jsonFragmenter but listExploder still does not see result{}.
Hi,I've tried to facilitate using the SpatialRelator with the "Input Ordered" set to "By group". And set the "Group By" value to a common attribute.I sorted both my Requester and Supplier inputs by the same value. But even though the log file shows the expected groups, all groups have no matches (typically "0 BASE(s)").Please advise as to how this functionality is supposed to work.I got the process running by setting "Input Ordered" to "no" (keeping the "Group By"), but I think that this is not as efficient.Cheers.
I tried looking for similar queries but I need some help with this asap. To explain my question further, I have a point cloud with x, y, z and the fourth column is a componentID (after having done connected components) I have a text file which consists of a string of component ID values.I am trying to filter the point cloud based on the number of component ID values in my text file. So, I have a couple of questions.1. I am trying the basic method by filtering the point cloud based on the value of the component but I keep getting the following error PointCloudFilter(PointCloudEvaluationFactory): Attribute 'C1' is specified in an expression but is not present on the feature. Please ensure the feature has all referenced attributesI am not really sure how to solve this. Because if I use an attribute creator to assign values to C1 independent of the values from text file, it works fine. But when I integrate it with text file it goes into error.2. My text file will not always contai
I have HTTPCaller connect to JSONFragmenter connected to JSONExtractor. Are these list that have to be converted?
Hi,I wonder how can I call @Http function with the FunctionCaller transformer?The reason is that HTTPCaller does not support specifying proxy server directly, but the @Http function seems like it supports custom proxy setting.Thanks,
Is there a way to tell an SDE reader to forget the spatial? I can read as SQL Server Non Spatial, but I lose the SDE ST.Area attribute, which I need. However, I don't need the actual geometry and reading it wastes 30 minutes.---- Hoping for an "opposite of Geometry Only".Thanks,Jake
Hi,Faced with having to handle multiple large datasets (5M+ features), I'm looking into whether I can improve performance. I just had one of these dataset crash after 12 hours !The task is matching any source data set (only) spatially with a data set of buffered municipalities, and so there are no common attributes. I.e., no possible values for "Group By". Any source feature could possibly end of in any number of municipalities.Is it possible to get a performance boost under these circumstances ? And if so, how ?Cheers
When using the GridInquest11Reprojector to project data from irish grid to ETRS89 Geodetic the following fatal error occurs "Source coordinate system 'Irish Grid' cannot reproject to destination coordinate system 'ETRS89 Geodetic', either 'Out of Area' coordinates or invalid coordinate system parameters Reprojector: Reprojection failed" This doesn't happen when reprojecting the same data set using the GridInquestReprojector. Only the first pair of co-ordinates appears to be projected when using the GridInquest11Reprojector as per the extract from the error log below.Geometry Type: IFMELine Number of Coordinates: 78 -- Coordinate Dimension: 2 (-6.5027536642668426,53.275450616997503)(299914.2325,226047.6043)(299912.3574,226060.10490000062)(299909.2323,226072.6055)(299909.8573,226083.8561) (299911.1074,226098.23169999942)(299920.4828,226106.9821000006)(300232.9973,226190.1109)(300303.6255,226166.9849)(300321.7513,226161.9846) ...Skipping coor