Using transformers to modify data.
Recently active
Got a situation where I would like the store attribute values, @Value(attribute_name), in some HTML code which itself is stored in a SQL table. The idea is that the @Value(attribute_name) will be different for each of our clients, sending them a personalised email based on their own data. Currently FME reads the table in and keeps everything as plain text, @Value(attribute_name) does not get replaced with the appropiate attribute value. Is there a way to get FME to recognise the attribute names in the HTML code and replace it with the appropiate attribute values? if I copy and paste the HTML code into atttributecreator then it works as expected, however we would like to manage all this in SQL server - saving us having to update the workbench everytime there is a change required to the HTML Thanks
Hi, i have a problem where most of a large number of point clouds are missing the first number of the gps_time attribute, so "367091181.0231084" should be "1367091181.0231084". It is always a 1 that is missing at the start.What would be the best way to go about changing this attribute for every point in every pointcloud?The context for this is that the point clouds are data from lidar mobile mapping and need to be matched using the gps_time with trajectories in another software.Any help would be much appreciated.
FME(R) 2023.1.1.1 (20231011 - Build 23636 - WIN64) Hello As stated in the subject line, the Feature Caching icons can be seen in the "Main" tab but not showing in the "Custom Transformer" Tab at all. However the features are cached. So I think they are just missing. ThanksSameer
Hello, I would like to prioritize a layer using the AreaOnAreaOverlayer transformer, is it possible ?Thanks
Dear All, I am experencing the following problem on FME (FME Desktop 2022.1.0.0 - Build 22618 - WIN64) : when I work with PythonCaller, my workspaces randomly crash. For example, starting from empty workspace, I add a Creator followed by a PythonCaller ; run to the PythonCaller -> it works fine ; I add "import arcpy" in the PythonCaller and run -> it works ; I add "print("hello")" in any function of the FeatureProcessor class -> it crashes. Also, the crashes happen in an unpredictable way : sometimes, it crashes after having inserted "import arcpy" ; sometimes I can add 2-3 five more lines in the function of the FeatureProcessor and it works and then after 1 more line it crashes. By crashing, I mean the following : after clicking "run", the mouse cursor takes the form of a blue waiting circle during a few seconds and the window suddenly closes -> when it crashes, it seems that the translation never really starts (nothing ha
Hi, I want to amalgamate polygons from a map of natural environments to distribute it on a larger scale (1:5000 to 1:25000). For this I used the AreaAmalgamator tool with the settings that can be seen in the photo. I have 12193 objet in total. However, the software has been running for 10 hours and nothing is happening. Has anyone ever had this situation?
For instance, one 58 unit apartment results in 17 rows with variously 1-24 units added together. We can't explain why this is happening but need to fix it. Have also tried adding a dupliate filter and another aggregator but this didn't work. Any suggestions are appreciated.
I have used @PadLeft(@Format(%.3f,@Value(FLOW)), 8) in an earlier attribute manager in the workspace to format the values to three decimal places and pad left. My output data and workspace are as shown below:
I have polyline data representing roads and point data representing mile markers. The points are on the line, so PointOnLineOverlayer does segment the line as expected. The point data has a Measure value that I want to use on the line, how do I set the measure value of the points to the lines?
Now that LDAP/Active Directory reader have been put on the deprecation list in FME 2023, I'm trying to find an out of the box solution in FME to update my workbenches and continue using it.
I am writing a shutdown script to logg a workbench result to a postgres database.To log the output location of a gpkg file I am fetching a public parameter like so fme.macroValues['dest_path']But i get some weird formatting where backslash etc ar written as verbose text instead of the actual path? How can I get the actual path? C:<backslash>Users<backslash>User<backslash>Documents<backslash>FME_proj<backslash>20230913_FME<backslash>WIP<solidus>output<backslash>myoutput.gpkg
My input attributes have numeric or string values, with possible empty string values.I would like to replace empty string values with Null. When I use the option "Substitute Missing, Null and Empty by: Default Value", and set "Default Value: <null>", nothing happens. The values remain unchanged (with empty string values). I can get the desired result with the help of "Action:Set Value" and Value: Conditional Value -> If ATTRIBUTE IS EMPTY -> Value <null>". I know I can use the Null Attribute Mapper transformer, and the Set Conditional Value method above, but using the"Substitute Missing, Null and Empty by: Default Value" option seems the most elegant to me. Have I misunderstood the purpose of "Substitute Missing, Null and Empty by: Default Value" or am I using it the wrong way?
I am using the attribute validator to test a list of pavement marking line marking types coming from a AutoDesk SDF. The validator is throwing false errors when I use the "In" ValidationThe list of values in the rule configuration are: Broken 1-1,Broken 1-8,Broken 3-3,Broken 3-6,Broken 3-9,Double Solid,Simultaneous Solid/Brkn-1,Simultaneous Solid/Brkn-2,SolidEverytime I run my workbench Broken 3-3 is reported as an error even though I've verified that the spelling is correct.I've also tried subbing out the commas with double quotes and it doesn't seem to work either.
Hello all, I frequently used the FeatureMerger or FeatureJoiner transformers. However, none of them seem to offer a join based on an expression, such as checking if a value from one table contains a value from another table. How can this be achieved? Thanks for any assistance.
I have a polygon layer that was digitized manually and as a result, has some issues with overlaps and gaps. However, the first issue I would like to solve is making the polygons have right angles. They are all square or rectangle-type shapes so each vertex should have a 90 degree angle. Is there a way to manipultate the polgyons so that they are all at right angles? At this point, I would be able to check for snapping and other issues. Thanks!
I am trying to reproject a wms from the Environment Agency (https://environment.data.gov.uk/spatialdata/risk-of-flooding-from-surface-water-extent-0-1-percent-annual-chance/wms) from WGS 1984 to British National Grid. I need to know the cell size so I can provide a degree of accuracy of the data and have confidence in my areas of intersect calculations with some polygons. However, when I use the Reprojector, the spacing seems completely off. If I view it in ArcGIS Pro, the cell size appears to be 2m, which seems sensible. I have tweaked the parameters in the Reprojector but this doesn't give me the correct cell size. Any ideas what I'm doing wrong?
I have an Esri ArcGIS Binary Grid and a line shapefile. The shapefile was produced by the Surface Draper transformer, so it is 3D and has Z values at the verticies from the same Grid. The Z values that I would like to generate at a 10m interval can be output to a csv, instead of being applied to the shapefile: that is, I do not require verticies to be created in the shapefile at a 10m interval. Just need the interpolated Z values every `10m down the line. Thanks!
To ensure our database's data integrity, which is periodically enriched with measurement data governed by users, we use FME to create data validation reports in Excel. With these reports, users can correct their data iteratively. To make this work, we use SQL statements stored as attributes in a table. Depending on the report to be generated, SQL statements are fed into a SQLExecutor transformer as attributes. At the time of writing, we employ close to 500 validation queries, each with their own set of columns as well as amount of columns. The picture below shows how the queries are inserted into the SQLExecutor as an attribute. This is then routed to a dynamic Excel writer by using the SchemaSetter custom transformer. The Excel report is generated as expected, except for the column order, which is sorted alphabetically instead of the order specified by the (dynamic) SQL queries. Is there a way to preserve the column order specified by the SQL queries instead of having them sorte
(Disclaimer: I have only rudimentary understandings of the inner workings of XML.)The source below is a GML file where I need to fragment/flatten the elements shown. I would like to be able to treat them as "normal" features with regular attributes. I am using the GML-reader associated with this specific data source, Norweigan SOSI, my settings are also below. Q: What would be the best way to flatten this data? (Or would the XMLfragmenter be a better tool? I must admit I find all this a bit confusing)
Hi there,I'd like to add an arcgis online feature service to my Html report. When I use the Map Esri leaflet, I'm confused by the terminology of 'feature layer URL'.... Documentation/helpThis parameter allows the user to specify a list of comma delimited ArcGIS Online feature layer URLs, that will be displayed as additional layers on the map. Is this the feature service item Id URL? or do we need to be more specific and enter the REST URL of the layer in the feature service? As I understand it leaflet provides visualization capabilities for data hosted in Feature Services, Map Services & Image services. I think the documentation needs some detailed wording and/or examples. I don't seem to have much luck using this option in the html reports, but I'd very much like to!
Saya hendak menukar file IFC kepada geopackage. Semasa meletakan writer geopackage saya telah memilih table definition manual dan juga Automatic. Masalah yang saya hadapi pada writer yang disetting Automatic, tiada objek geometri dan pada writer yang disetting manual berlaku kegagalan…Hanya apabila memilih dinamik sahaja ianya ok. Maslah saya disini dalah tidak mahu menggunakan table definition secara dynamic. Mohon bantuan bagi yang mahir. Bersama ini disertakan file2 tersebut. Tqvm.
Experiencing, Schema features output from the SQLExecutor only after the Data features. This is causing issues for dynamic workspace. Currently managing this by connecting FeatureHolder to the Result (Data features) port of SQLExecutor, to hold the Data features and let the Schema features reach dynamic writer first. From the above screenshot it can be noticed that, Schema features are started coming out only after the Data features. To address this, required either of the below for SQLExecutor.Schema features output first before Data features all the time.Required "Output Schema Before Data Features" parameter, similar to SchemaScanner. FME version: 2022.2.2
I am trying to think through the best way to approach this in FME. I need to create polylines from a CSV file. I have two files in the following format: File1 contains one row per line, including the start and end coordinates for all lines:Line123, StartX, StartY, EndX, EndYLine456, StartX, StartY, EndX, EndY File2 may or may not have additional midpoints. Each midpoint is on a new row. So two midpoints for Line123 would look like: Line123, X1, Y1Line123, X2, Y2 I need to combine these in the correct order to rebuild the line. For each unique LineID, I need [StartXY] + [Midpoints] + [EndXY], and the midpoints need to be in the same order as originally presented. There are likely many ways to approach this. Here is my first attempt. I know I can use LineBuilder to construct any midpoints from the second file. It's set to wait for all inputs and process at the end, grouping by LineID. I know the order of vertices depends on the input. I want the LineBuilder to process the span S
Hi,My workspace worked in 2019.x, but I noticed an issue when it was migrated to 2022.2.0. I read in multiple *.TXT files from a single folder using a FeatureReader (passing the folder name with a parameter), they are actually csv files - so use that as the format. In the Parameters I set "Field Names Line" to None as there are none. I expose "col0,col1". It reads all the files and I get the correct feature count, but it reads the first file fine, but all subsequent files it uses the values from the first line as the field names - effectively ignoring the "Field Names Line" Parameter. Is this a bug? As I say, it worked before. Kind regards John
Hi everyone, I am looking for the right transformer to do a simple table manipulation here. So I have T1 (a table with multiple columns) and T2 (a table with a single column representing groups). I would like to duplicate T1 n number of times (n = number of groups in T2) where each row in T1 would be copied to be represented in each group to give T3 as a result. Thanks in advance!