Using transformers to modify data.
Recently active
I have a number of GPS tracking records that contain straight line segments i.e. noise arisen from loss of signal. I would like to remove lines > 1 km to improve visualising the data. The workbench would need to:Find straight line segments within each dataset > 1kmBreak/Split the line on the vertexDelete the line > 1kmThe lines that have been split at either end can remain as they are i.e. do not need to be merged or joined Please can someone briefly describe the workflow that I would need to create to achieve this?
I have a workspace that extracts users and attributes from Active Directory, at the OU level. I want to take this workspace and create a custom transformer as part of a larger workflow. Last time I copied these LDAP readers it completely broke everything and I had to fix them one-by-one. Is there any way to import a workspace as a custom transformer? This is just reading a bunch of LDAP data and spitting out a CSV. *Edited to reflect I'm trying to export/reuse connections, rather than transformers.
I'm making a custom transformer and the users will select multiple choices from a published parameter list that contains a value with text that includes a parsable field name with other info. I've been working to parse that out into a comma delimited attribute, which I now have. In my reading of other questions surrounding this, it seems like this is not possible with truly dynamic transformers/workspaces, but in my case I have a known list of the names. What is the best way to expose attributes that are known in this way in a custom transformer or in general?Thanks!
Hello all. I'm trying to determine the best way to read the schema of an SDE geodatabase. My end goal is to read each table/feature class' attributes and properties (name, data type, length/precision) from a File Geodatabase and compare them to tables/feature classes from an SDE geodatabase. Most are the same but can differ slightly for a quarterly data load of 300+ tables/feature classes. I've managed to use the Schema (Any Format) Reader for the File Geodatabase, but if I use the same reader on the SDE geodatabase, it gives me an error: "An error occurred while attempting to retrieve the connection parameters from the connection file ''". It sort of looks like it can't find the connection file, even though a working .sde connection file is in the "Source Dataset" parameter, and there aren't many other parameter options available. Does anyone have thoughts on how to configure the Schema (Any Format) Reader for an SDE geodatabase, or is t
I have an idea of how I would write this in Python but being new to FME not quiet sure where I start here with the transformations.. For example: the Column will have an A, B, or C. If the column for any row has a "C" I want to to delete this full row. While it seems simple enough Python I'm not quite sure where to start with FME. Any help or helpful tips to point me in the right direction that would be great.
I am implementing a custom reprojector plugin which needs to access a parameter or attribute that an earlier transformer has created. I am writing the plugin using the C++ SDK, but am having difficulty seeing how to access this information from the ReprojectEngineManager class to use it. Any tips to how to do this are appreciated!
Hi, I have a CSV file with 20 spatial points & I was able to convert the points into a line (using LineBuilder) but the line which is created is having a single feature to it. I have used Chopper Transformer to cut the line. It does the job for cutting the lines but all features get same as the first one feature.How I can separate the feature as well with the lines Please Help ..!
Hi,I've got a text file that has dates as parameters for a data pull that I would like to add to the actual data that was pulled after it has been manipulated to have only the items we are interested in.In this case, start and end dates for the ranges. I want to add those to two columns in the data that is being updated/appended to in an EGDB.I thought maybe global variables, but they can be SO finicky. Is there another way to attach these dates to each row in the table as it is being updated/appended?Thanks,Lorinda
Creating reader for format: GeoTIFF (Geo-referenced Tagged Image File Format)Trying to find a DYNAMIC plugin for reader named `GEOTIFF'Loaded module 'GEOTIFF' from file 'C:\\Program Files\\FME_2018\\plugins/gdal/GDAL.dll'FME API version of module 'GEOTIFF' matches current internal version (3.8 20180604)GEOTIFF reader: Opening file '//client/F$/DEM_LIDAR_2012-2020_1m/citywide/DEM_LIDAR_2012-2020_1m_citywide.tif'GEOTIFF reader: TIFFFetchDirectory://client/F$/DEM_LIDAR_2012-2020_1m/citywide/DEM_LIDAR_2012-2020_1m_citywide.tif: Can not read TIFF directory countGEOTIFF reader: TIFFReadDirectory:Failed to read directory at offset 8081121040GEOTIFF reader: Failed to open the dataset '//client/F$/DEM_LIDAR_2012-2020_1m/citywide/DEM_LIDAR_2012-2020_1m_citywide.tif'. Please ensure source data is valid and correct reader is selectedA fatal error has occurred. Check the logfile above for detailsFailed to obtain any schemas from reader 'GEOTIFF' f
Add one field with values from existing attribute table to another existing attribute table. Can any one help me with this problem.
I have workbenchs published to FME server that lets an end user upload a file (KML, SHP, DWG, TAB) that will convert to (KML, SHP, DWG, TAB) plus re-project if the output coordinate is set.If the input file has a coordinate system everything works fine, but if a uploaded file is missing a coordinate system the workbench fails and the end user doesn't know why as they can't see the error logs.This is where I had the idea to give them a txt file saying, add an Input coordinate system. I don't want to make the input coordinate system required as the end user might not know or might enter it incorrectly (I'm trying to make it idiot proof as much as possible 😀 ). Now comes my issue. How do I test for all three conditions; Has coordinates = Converts dataHas no coordinates = Txt FileHas coordinates and no coordinates = Converts data and doesn't send txt file.So far I can only do the first two. There is possibly a better way than what I have come up with. Any sugges
Sample figure shows the 36 points within a MAIN Polygon (purple color). Each have its respective the data point value and summing up comes to 666. With the sub-polygon it crosses these points and have its own total of the data points within it. Need to take of the sum of the sub-polygon from the overall total (main polygon - 666) and get the % of each result with respect to overall total of main polygon. See table
Hi, I am trying to merge two datasets, one being the primary dataset that has Levels and the second dataset that has Zones. Each level has all the zones associated to that the level. I would like to achieve a dataset that displays this merged dataset. I have created a small sample of the actual larger dataset below. I think the solution involves some sort of list handling but I have tried out several list transformers but so far haven’t been successful, I would like the desired outcome in columns as shown above and not in rows as I think can be achieved by exploding attributes. If this cannot be achieved using transformers, I am happy to use a python script inside the pythoncaller if someone doesn’t mind sharing a script. Appreciate any advice either way. Thanks in advance.
I have a workbench which has a complex custom transformer added in which a python caller is present. I wanted to check what is happening in that python caller so I used some print statements. But I cannot find those print statements in logs that is being generated. How to get the log of a custom transformer in FME Desktop 2019.
Please refer this above two snapshots for better understanding. Hello,I have 20 shapefiles with no unique attributes in them.This all shapefiles are Line features. I want to generate the output with ovelapping part with exact overlap, and lines which are not overlapping but are parallel to each other at 3 meters distance.for example see below image output seen and generated in ArcGIS for 2 shapefiles. Need to generate same result for 20 shapefile in FME. Need help or solution for this problem.
Both transformers allow using schema mapping defined in an external file (csv, etc). The AttributeRenamers output gives me the desired results, the original values in a new schema. The SchemaMapper, however, requires the addition of an attribute exposer to show the new attributes, and an attribute renamed to remove the old attributes. I assumed the SchemaMapper would be easier to use than the AttributeRenamer but it seems much more cumbersome, especially having to manually expose and remove the old schema attributes. Is it possible I am doing something incorrectly? Is there a benefit to the SchemaMapper I am overlooking?
Which transformer can we use for finding Dangled Nodes from a Road Network ? (:
Hi FME team, I've tried to find an answer on the community on this and whilst there are definitely similar ones, none quite solve my issue.I'm trying to find the angle of intersection between lines, specifically using a many-to-one relationship. So I have a base line that I want to identify angles of intersection with multiple other lines. So I end up with something like this:Base Line ID Intersecting Line ID Angle1 A 341 B 1341 C 2651 D 70For the exercise I am doing, the closer the angle to 0 or 180 the better.Is this doable? Thanks
i would like to read the name of all excel files in folder and subfolders but i found it takes long time , any ideas please .
I was wondering if anyone here can help me out with an FME expression that is part of a larger FME puzzle. Skip ahead for the FME expression I'm trying to write, or read the whole thing for background information. As most of us know, there is probably more than one solution to the overall puzzle. Background information about the FME puzzle:I have a Table1 with a column called USERNAME that is a list of names, and a column called called USERPHONE that is a list of associated phone numbers. I have a different Table2 with a column called BLDG_INSP with a list of names, and an empty column called BLDG_INSP_PHONE. Based on the information in Table1, I want to populate BLDG_INSP_PHONE. Initially I tried various Joins and conditional statements in AttributeManager, but no luck. So, I combined USERNAME and USERPHONE into a single column called USERNAMEUSERPHONE, separated by a comma, to use as a bridge. Ex: <Anthony Stokes,123-456-789> The idea is that I can write a conditional state
As mentioned in the title, I am trying to rotate faces to conform to their corresponding surface normals. I got the surface normals by calculating them from 3D points (turned to convex polygons, grouped by ID) and extracted the normals as attributes. Then I merged these attributes with flat surfaces (using common IDs) and applied these measures to the surfaces using GeometryPropertySetter. I assumed that would do the trick in rotating the surfaces, but the faces remain completely flat, even with the surface normals applied. Is there something that I am missing, or some other way to do what I am aiming for?I appreciate any help on this. Thanks a bunch!
I'm using the AttributeExploder to prepare a two line table for an HTML report, the header as 'name' column and the value line has another. How to avoid unwanted 'values' or hide them? It adds those two:fme_geometry fme_undefinedfme_type fme_no_geom Or is there a way to filter out value before using in the HTML report transformer?
I have a linear input file from a survey depicting the edge of roads, that requires writing to a polygon feature class. The problem is the source data lines are not closed and very fragmented. I have tried combinations of areabuilder/linecloser/donutbuilder/geometrycoercer and neighborfinder/vertexcreators/geometrycoercer to join these lines together unsucessfully, Please see screenshot of sample data, anyone have any ideas?
I have a application that is calling FME server by sending ESRI JSON as a parameter and returning a zipped shapefile download url. This is working fine as a job submitter but failing as a data download. The succeeding json cmd line arguements in the job log are structured like : `--JSON_Text' `<opencurly><quote>displayFieldName<quote>:The failing json like:`--JSON_Text' `{"displayFieldName":The error is:The clause '@EvaluateExpression(FDIV,STRING_ENCODED,{displayFieldName:agn_name...,JSONFlattener) READ_FROM_FILE NO FILEPATH_OR_URL <Unused> EXPLODE_QUERY json RECURSIVE_FLATTEN NO ERROR_LIST_ATTR _json_error OUTPUT EXPLODED FEATURE_TYPE JSONFlattener_OUTPUT OUTPUT REJECTED FEATURE_TYPE JSONFlattener_<REJECTED>' is incorrect. The parameter to JSON_DOCUMENT must be a constant value, a value-of (&) attribute, or an FME function call Is it possible to handle this problem on the FME end? More info here https://github.com/geocortex/workflow-activities-fme/iss
What is the best way to calculate the most efficient way for a garbage truck to travel on a road network in such a way that it covers both sides of the road. So it needs to travel each road in both directions and cul-de-sacs just once (around). Is there an example of someone having done this? The standard way calculates from point a to b but doesn't take into account street sides. Thanks