Using transformers to modify data.
Recently active
I am looking to merge into a list selected attributes from nearby points and output a single feature for each group of nearby points. PointOnPointOverlayer perfectly finds the nearby points and generates the list I want, but outputs all the input features with a list of all the other features. Thus for say 4 nearby features it will output 4 features each with a list which identifies the other 3 features in the group, but without anything like a group ID with which you could select just the first in each group with a DuplicateFilter.This is almost exactly the example given in the PointOnPointOverlayer manual page which creates lists of crimes at common locations... but doesn't explain how to not have multiple copies of the same list at the same location. Am I missing something obvious? It seems that PointOnPointOverlayer has done all the hard work!The closest I could get to generating a group ID is to give all my input points a unique ID field, then set "Merge attributes"
Hello all, I need some help performing a spatial operation. What I haveA set of coordinates (sample enclosed) What I wantRemove / dissolve coordinate pairs if the are within 2 km radius of each other so that only coordinate pairs remain that have no overlap. What I've triedA Bufferer transformer with a radius of 2km connected to a PointOnAreaOverlayer.The result is a bunch of overlaps but I don't know how to further process these. Cheers,Eduard
Hello,I am a researcher from Slovenia. I'm having huge trouble working with Slovenian datasets, as they are in EPSG:3912 or EPSG:3794. These two systems are not supported by FME. I solved this for shapefiles by using ESRIReprojector. But it does not seem to work with las datasets. I am trying to extrude footprints using LIDAR data and convert that to KML, which needs WGS84 data.Is there a sollution? I am quite surprised that FME does not support all EPSG projections.I even tried to add custom coordinate system and was not successful.Regards!Jernej
Hello, I'm passing a load of lines through an FME workbench and eachline has a project name as an an attribute. I want to add an attribute that counts how many lines are in the project (share the project name). Does anyone know how to do this? I've tried playing around with the counter but have had no luck. what I need is it to separate out into all the different projects, use the counter, then chuck everything back together. I would use a filter but there are hundreds of projects. Any ideas? Thanks
I have fed it into a NullAttributeMapper to make sure all Nulls, Missing and Empty fields are uniform. That's fine, and so is the Date transformation when inspected. However it still rejects any of the Null fields, and when it outputs to the AttributeManager, all of the fields are then Null. Even the ones with a date value. I've checked the "Passthrough Nulls, Empty and Missing" values to "Yes", but still no luck. It seems to apply the null to everything in the DateTimeConverter.I've tried with a new Transformer/rebuilding that section, and have also restarted the workspace, as well as clearing any temp files. Any help? Thanks
The statistics Calculator gives this error when trying to count the sum of an attribute: 2020-08-11 12:49:59|2233.8| 2.3|ERROR |Python Exception <MemoryError>: 2020-08-11 12:49:59|2233.8| 0.0|FATAL |@Python failed to execute function `StatisticsCalculator.recordFeature'2020-08-11 12:49:59|2233.8| 0.0|ERROR |StatisticsCalculator_2_InputProcessor (TeeFactory): StatisticsCalculator_2_InputProcessor: @Python execution failed2020-08-11 12:49:59|2233.9| 0.1|ERROR |StatisticsCalculator_2_InputProcessor: @Python execution failed There was approx 2.5M features passing through each one having a value of 1. So the sum operation should not be exhaustive. What could cause this? A bug?
I use a custom transformer with two inputs, 1 per table.In my custom transformer i have 2 published parameters to get the attribute of:table A - Fieldtable B - Field But both parameters return globales listes of fieldsIt's possible to isolate the fields list for each table on it specific parameter
I have a simple workbench that read data from a table and produce a number of Excel files. Depending on the config, the output can be 2, 3 or more Excel files (via FeatureWriter). At the end, I want to send the result by email. If I use Emailer and put my attachment manually, it works perfecly, but if I want it to be more flexible, I want as many attachment as my workbench produce. Is it possible to concatenate the output dataset produced ? I tried but failed... any Idea ? No zip please!
Hi there, I am defining a data frame at Python caller on __init__ function like below: class FeatureProcessor(object): def __init__(self): df2 = pandas.DataFrame(columns= ['INCIDENT_DATE',INCIDENT_MINS','INCIDENT_VALUE']) later in the program at input function I am storing feature attribute value in data frame something like that: def input(self,feature): self.pyoutput(feature) df2['INCIDENT_DATE'] = feature.getAttribute('DATE') df2['INCIDENT_MINS'] = feature.getAttribute('MINS') df2['INCIDENT_VALUE'] = feature.getAttribute('VALUE_LOST') However, when I ran the Python caller block, it throws an error message that df2 is not defined at the input block. Could anyone point out where am I making the mistake?
I change FME Proxy Settings from "Use system proxy settings" to "No Proxy". But FME is still using the system's settings. So I edited the systems's settings and disabled proxy, and removed proxy settings from environment variables. FME still uses proxy settings. I restarted FME, and it still uses proxy settings. I can't connect to the proxy right now, so the transformation crashes. Snapshot below. How can I get FME to not use any proxy? FME 2020 here. Thanks in advance, Mike
I am not getting the right info when I use the rightleft transformer for the position of the point to the road I check the segment and is has the same direction all Point are getting RIGHT position valueany thought please
Hi,So after lots of testing, it's looks like when I export shapefiles using the FeatureWriter and include the .sbn Spatial Index, the shapefiles do not function properly. When first loading them in ArcMap, they appear to be ok, but when zooming, selecting, panning the map, I get very odd results with certain features suddenly dissapearing, not being selectable, etc. If I modify my FeatureWriter to not include any spatial index, then the shapefiles work fine. I only have this problem when I include the spatial index. I would like to include the spatial index. Is there a fix for this?? Thanks,
Hi - I'm trying to create individual records with attributes from a JSON response from an API. I've been able to call the API using the HTTP Caller and have tried using a JSON Fragmenter to extract attributes. I don't seem able to get attributes from this but as shown in the attached there are a number of attributes in one of the returned rows. This looks as if it is a list called 'array' (there are 49 members in the 'list' which is as expected). I'd have thought I could use a List Exploder but this transformer doesn't pick up any list attributes. I'd really appreciate any advice on how I might explode this structure in to individual rows with attributes. Thanks and all the best. Matt
Is it possible to read the coordinate system from the input features and use it as source for the ESRI reprojector? Background is, that I don't want to define a transformer for each UTM zone as the destination coordinate system and the geographic transformation will be identical for all, so it would make sense to read the source coordinate system from the input files. Unfortunately I have no idea how to realize this. I've tried a User parameter, but I have no idea how to dynamically populate this value with the source coordinate system.
Hello All,I have two datasets. The first dataset is excel files that show citizens' residence the second dataset is GTFS. I want to find the number of residents who live within 400 meters from the existing bus stops. I would appreciate the help or advice. Thanks
Hi,I want to cut a raster with shp file, and the result raster will have the extent of the clipper's instead of the clippee's. (consider null or nodata as filled up)
I just want to create a line from below table in screen. To do it may be needs to create list as below but I do not know how it manage. Please help Sample of list below. Facility Name | Request User | X | Y |========================================Line | MEKK | x1 | y1 |Line | MEKK | x2 | y2 |Line | MEKK | x3 | y3 | Line | MEKK | x* | y* |
I'm trying to calculate a 7-days moving average in FME 2017.Using "DateTimeConverter" and the "Cumulative" option in "StatisticCalculator" I've managed to calculate a moving average on a weekly basis. However, the calcul of the average re-intializes at the start of each week with the value of the first day of the week.Is there a way to implemente a moving average with a known frequency (7 days in this case, 365 in another I'm working on)?Thanks
@takashiHi !Any hints how to align label with the line direction ? I'm using a 2DVectorCalculator, Featuremerger, offsetter and vertex creator. But I'm not always having the right orientation of my labels with the line direction. See below attached images. Thank you in advance.
FME has disabled truncating a Spatialite table, so I need a hack to do it anyway. I want it to exist so that other applications can read it after it is updated.I need to truncate rather than drop_and_create to refresh the table with an insert because I have another transformer right afterwards doing an SQLExecutor that does a selection from a large table in the same sqlite database. It seems that a lock is added that prevents the drop/create.So you might think that I could hack the truncate using SQLExecutor, but no! All database operators are disabled in FME for spatialite so the "DELETE FROM table" is not allowed.Never mind I will use Python. Ah, but now that I am using FME 64 bit I need to use Python3.6 and that is now from Anaconda which does not have sqlite as a standard module for ArcGISPro, so my python hack also fails.Well then, I will just shell out to sqlite.exe. But wait, FME implements it as sqlite_fme.dll, not a EXE.I can truncate the table if I use a filegeodata
I have a workspace that is generating a couple of shape files returned in a zip file through datastreaming. It works as expected in dev, test and production environment but not in education. In education it only returns one of the files unzipped. I have confirmed that it returns several files and I have resubmitted the exact same workspace that works in the other environments. What other parameters can cause this? Some set up on the education fme server?
How can I include null values in the list of acceptable values (Validation Rule = In)?Also, if an attribute is null, how does that impact the Type (Validation Rule = Type)?
I am trying to clip a point cloud using building footprints from CityGML file. Pretty much like in this tutorial. However the Clipper transformation marks the whole cloud as Outside and none of the points as Inside. Details:I have FME version 2020.1According to FME Data Inspector the building footprints and the point cloud are alignedBoth clipper and clippee have same coordinate system (EPSG:3301)LAS file I'm using can be downloaded from here and CityGML from hereThere is a similar issue from 7 years ago that was no helpThis sequence worked with 2020.0 version What could be causing this? Are there any alternatives to using clipper?
With older MongoDB Reader, there was no problem on using regex for the JSON Filter parameter, such as:{"insee_code": /^06004/}I can't find how to use regex in the Mongo query with the MongoDB3 Reader, and I have this type of error :MONGODB3 reader: SetAttributeFilter(): Got parse error at "/", position 61: "SPECIAL_EXPECTED": could not parse JSON documentI also notice that the Mongo keys always require to be between quotes, while with MongoDB Reader version we could use "un quoted" keys for filter. Are there any other changes with this new driver? Thanks for the info ! I use FME Desktop 2019.2.1.0 (20191202 - Build 19813 - WIN64)Mongo version is 4.0.13
I have to define 3 custom coordinate system ( HDKS-5, HDKS-6, HTRS96 or epsg codes: 3907, 3908, 3765 ) and parameters for transformations between them. I tried this: https://demos-safe-software.fmecloud.com/fmedatastreaming/Coordsys/Start.fmw? I copy esri wkt from https://epsg.io/3765 and paste to previous link but I get wrong results when I transform from HDKS-5 to HTRS96.Thanks in advance.