Using transformers to modify data.
Recently active
Hi, I am trying to merge two datasets, one being the primary dataset that has Levels and the second dataset that has Zones. Each level has all the zones associated to that the level. I would like to achieve a dataset that displays this merged dataset. I have created a small sample of the actual larger dataset below. I think the solution involves some sort of list handling but I have tried out several list transformers but so far haven’t been successful, I would like the desired outcome in columns as shown above and not in rows as I think can be achieved by exploding attributes. If this cannot be achieved using transformers, I am happy to use a python script inside the pythoncaller if someone doesn’t mind sharing a script. Appreciate any advice either way. Thanks in advance.
I have a workbench which has a complex custom transformer added in which a python caller is present. I wanted to check what is happening in that python caller so I used some print statements. But I cannot find those print statements in logs that is being generated. How to get the log of a custom transformer in FME Desktop 2019.
Please refer this above two snapshots for better understanding. Hello,I have 20 shapefiles with no unique attributes in them.This all shapefiles are Line features. I want to generate the output with ovelapping part with exact overlap, and lines which are not overlapping but are parallel to each other at 3 meters distance.for example see below image output seen and generated in ArcGIS for 2 shapefiles. Need to generate same result for 20 shapefile in FME. Need help or solution for this problem.
Both transformers allow using schema mapping defined in an external file (csv, etc). The AttributeRenamers output gives me the desired results, the original values in a new schema. The SchemaMapper, however, requires the addition of an attribute exposer to show the new attributes, and an attribute renamed to remove the old attributes. I assumed the SchemaMapper would be easier to use than the AttributeRenamer but it seems much more cumbersome, especially having to manually expose and remove the old schema attributes. Is it possible I am doing something incorrectly? Is there a benefit to the SchemaMapper I am overlooking?
Which transformer can we use for finding Dangled Nodes from a Road Network ? (:
Hi FME team, I've tried to find an answer on the community on this and whilst there are definitely similar ones, none quite solve my issue.I'm trying to find the angle of intersection between lines, specifically using a many-to-one relationship. So I have a base line that I want to identify angles of intersection with multiple other lines. So I end up with something like this:Base Line ID Intersecting Line ID Angle1 A 341 B 1341 C 2651 D 70For the exercise I am doing, the closer the angle to 0 or 180 the better.Is this doable? Thanks
i would like to read the name of all excel files in folder and subfolders but i found it takes long time , any ideas please .
I was wondering if anyone here can help me out with an FME expression that is part of a larger FME puzzle. Skip ahead for the FME expression I'm trying to write, or read the whole thing for background information. As most of us know, there is probably more than one solution to the overall puzzle. Background information about the FME puzzle:I have a Table1 with a column called USERNAME that is a list of names, and a column called called USERPHONE that is a list of associated phone numbers. I have a different Table2 with a column called BLDG_INSP with a list of names, and an empty column called BLDG_INSP_PHONE. Based on the information in Table1, I want to populate BLDG_INSP_PHONE. Initially I tried various Joins and conditional statements in AttributeManager, but no luck. So, I combined USERNAME and USERPHONE into a single column called USERNAMEUSERPHONE, separated by a comma, to use as a bridge. Ex: <Anthony Stokes,123-456-789> The idea is that I can write a conditional state
As mentioned in the title, I am trying to rotate faces to conform to their corresponding surface normals. I got the surface normals by calculating them from 3D points (turned to convex polygons, grouped by ID) and extracted the normals as attributes. Then I merged these attributes with flat surfaces (using common IDs) and applied these measures to the surfaces using GeometryPropertySetter. I assumed that would do the trick in rotating the surfaces, but the faces remain completely flat, even with the surface normals applied. Is there something that I am missing, or some other way to do what I am aiming for?I appreciate any help on this. Thanks a bunch!
I'm using the AttributeExploder to prepare a two line table for an HTML report, the header as 'name' column and the value line has another. How to avoid unwanted 'values' or hide them? It adds those two:fme_geometry fme_undefinedfme_type fme_no_geom Or is there a way to filter out value before using in the HTML report transformer?
I have a linear input file from a survey depicting the edge of roads, that requires writing to a polygon feature class. The problem is the source data lines are not closed and very fragmented. I have tried combinations of areabuilder/linecloser/donutbuilder/geometrycoercer and neighborfinder/vertexcreators/geometrycoercer to join these lines together unsucessfully, Please see screenshot of sample data, anyone have any ideas?
I have a application that is calling FME server by sending ESRI JSON as a parameter and returning a zipped shapefile download url. This is working fine as a job submitter but failing as a data download. The succeeding json cmd line arguements in the job log are structured like : `--JSON_Text' `<opencurly><quote>displayFieldName<quote>:The failing json like:`--JSON_Text' `{"displayFieldName":The error is:The clause '@EvaluateExpression(FDIV,STRING_ENCODED,{displayFieldName:agn_name...,JSONFlattener) READ_FROM_FILE NO FILEPATH_OR_URL <Unused> EXPLODE_QUERY json RECURSIVE_FLATTEN NO ERROR_LIST_ATTR _json_error OUTPUT EXPLODED FEATURE_TYPE JSONFlattener_OUTPUT OUTPUT REJECTED FEATURE_TYPE JSONFlattener_<REJECTED>' is incorrect. The parameter to JSON_DOCUMENT must be a constant value, a value-of (&) attribute, or an FME function call Is it possible to handle this problem on the FME end? More info here https://github.com/geocortex/workflow-activities-fme/iss
What is the best way to calculate the most efficient way for a garbage truck to travel on a road network in such a way that it covers both sides of the road. So it needs to travel each road in both directions and cul-de-sacs just once (around). Is there an example of someone having done this? The standard way calculates from point a to b but doesn't take into account street sides. Thanks
Hi,I would like to know how I can extract the Coordinate System information contained in the header of several ecw files, using as a writer a xlsx or txt file. Thanks!
I'm wondering if it's possible in FME to perform a dynamic segmentation on an LRS event with an offset to the output line geometry. What I mean by this is I'd like the result geometry to be beside the base geometry, parallel to it and a distance away. For example, here's my base LRS geometry, going from 0 to 10 meters. Here's the event I'd like to perform the dynamic segmentation on, with a start measure of 0 and and end measure of 5. This is what I'd to have. A line going from 0 to 5 meters, located to the left of the base LRS geometry. Is it possible to do something similar to this in FME?
I think this has crept in since the first release of FME 2018.I have a SQLCreator with a perfectly valid MS SQL query, however when I run the workspace (either in Workbench or in FME Server) it reports warnings in the log file: "Query failed possibly due to a malformed statement", which is not true. So here is the SQLCreator with the query. If I press the Run button to check syntax it reports Successful.And here is the same query in SQL Server Management Studio, it also reports successful.However if I run the workspace I always get a warning that the query failed due to being malformed.You will also notice in the log, FME injects its additional SQL around my original SQL statement (perhaps this the the cause of the failure warning)? The last line in the screenshots reports that the data read was successful. So the issue I have is this: even though the workspace runs OK, when examining log files I'm never really sure if there is indeed a genuine syntax error with the SQ
The problem:I have two lists which are related to each other by way of index so lets say we have the following format - List 1 (contains 4 Elements)List 2 (contains 4 Elements) The Elements in each list relate to one another so Element 0 in List 1 is directly relatable to Element 0 in List 2. Element 1 in List 1 is directly relatable to Element 1 in List 2 and so on and so forth for the rest of the Elements. What I'd like to Achieve:If any Element stored in List 1 = "foo" -- I would like to remove it as well as the related Element in List 2. I think this is easily achieved if it is possible to extract not just the attribute of the Element in the lists, but the Element Index as well. How do I do this? I am able to extract the attribute name of each Element easily by using:my_list = feature.getAttribute('my_list{}) Thanks in Advance.
I am using the HTTPCaller transformer to perform a GET. How do I take the response and pull out specific attributes and their values? For example, I pass in a list of 5 asset numbers to the HTTPCaller. It performs the GET to return all associated information for each of those assets. I need to pull out, from the response body, only the assetnum and status.
Hi everyone. I'm using the FGDB Open API writer in 64-bit FME 2020.1 (build 20624) to write an FGDB table (no geom). I have 2 "double" type fields in the FGDB table which are set to allow NULL values (I've checked in ArcCatalog). When I run my Workspace, FME refuses to write features to the FGDB table which have NULL values for the "double" fields. I have tried ensuring the values are NULL using a NullAttributeMapper before the Writer, but it hasn't made any difference. I have also tried using the other FGDB Writer - the one that uses ArcGIS Desktop, which seems better - I just need to fix some features which have "null" instead of NULL to complete the testing. Has anyone else experienced this difference between the FGDB writers?
Is it possible to create one dynamic reader for DGN files, which will use different schemasfrom input DGN files? I do not want to lost any kind of data from next readen DGN file schemas using this reader. As usual I read DGN files and sometimes this reader can not load some data from them. I only change the path of the next DGN file to process.
Hi, I have a workspace that downloads two different files (1 geopackage, 1 textfile), renames them and stores them in a ZIP file. Said ZIP should contain the current date in its filename. Normally I use the date/time functions in the filepath paramters to create the current date on the fly but the options in "Destination Fanout Directory" do not offer these functions. As a workaround a created a Text Parameter where the user enters the current date manually but if possible I would like to do this automatically. Can this be done somehow?
Hello, I'm looking for a method that will allow me to extract a summary from a JSON, but due to the size of each JSON, fragmenting the data first would be extremely time consuming. For a bit of background, I want to extract daily data from the WebTRIS traffic counter API, with the aim of creating a summary of average traffic speed for the sites in question. The API allows for the download of multiple report styles, however only the daily report allows for the extraction of average speed. The report provides data at 15 minute intervals for each counter for the periods of time that the counter is active. If I wanted to extract the average traffic speed over a year, assuming the counter was active for the whole year, this might mean summarising 35,040 records, per site. I've looked at using the JSON fragmentor, but due to the potential size of the data that would require summarising, this would create an excessive number of records per site. What I would ideally like to do is to
Hello, I want to develop FME page to check the CAD layer names if it's match the layer standard name! and then give a result "approved" or "Reject"If "Approved" then convert CAD to GIS and add the data automatically to the GDB. IF "Reject" shows the layer names that should be fixed.How we can do this in FME? Thanks,
Is there a trick on how to read and count points with a classification flag? This link (http://docs.safe.com/fme/2016.1/html/FME_Desktop_Documentation/FME_ReadersWriters/las/quick_facts_las.htm) seem to indicate that there is but I can't find any transformer that does. Classification_flag is not part of the different field available in PointCloudPropertyExtractor. Writing "classification_flags" manually does seem to output a few things, but it only seems to be a 0 (there's no flags) or 1 (there's flags) kind of thing. ==1, ==2. ==3 doesn't output anything. How to count flags like in LASinfo?
I am currently working with a number of 3D models that I need converting from CityGMLs to SLPKs (ESRI Scene layer packages) to be brought into ArcPro. I have found two ways to do this:1) firstly I can write to a File Geodatabase in FME before importing the file into ArcPro and performing the conversion to an SLPK there using the 'Create 3D Object Scene Layer Package' tool.or2) I can write directly to an SPLK in FME using the 'Esri Indexed 3D Scene Layer' writer. Ideally I would like to use the latter of the methods as it removes a step from the process however I have noticed that there are differences between the datasets being produced from each method. When both files are loaded into ArcPro, the SLPK created in ArcPro renders very nicely with all elements being displayed, while the SLPK created in FME sees alot fo the elements appear and re-appear at diferent zoom levels - I am just wondering why this might be?