Using transformers to modify data.
Recently active
Huge thanks to @mark2atsafe for granting me a shiny FME Star badge!It really gave me the push to finally share some of the custom tools I’ve built, starting with this one: the TimeSeriesGenerator. The idea came up when I needed to build a time‑series dataset to plot user activity over time. My end goal was to generate an HTML report showing how users interacted with an application. I was starting from a log file of user requests, but if no one made a request during a given period, I’d have gaps in my data and nothing to show in the report. This issue is a common one. Even FME Flow with his analytics page doesn’t handle time period with no data.This FME Flow is idling most of the time, but the Analytics page doesn’t report that. That’s where the TimeSeriesGenerator comes in ! It creates a continuous series of timestamps between a start date and an end date, at a specified interval in seconds. You can then join your actual log data to those timestamps and be sure you’ll see a value (ev
I'm working with an electrical network with feeders and branches. I'd like to add the coordinates of the intersection points with the feeders as attributes in the branches. I managed to do this in the first segment using the Intersector and SpatialFilter transformers, but I had trouble adding them to the downstream segments.I have a common field for each branch that can be obtained using networkTopology.So, my question is how to create conditional queries to add the coordinate values of the intersection points with the downstream branches (see attached diagram).Thanks in advance.
Hi, I'm trying to access the property sets within the Extended data from dwg file, the property sets are attached to block reference objects, quite similar to the case of this post.Attached below are two snapshots from how the property sets look like in Autocad and FME workbench featuring the two attributes that I was trying to expose with no successcan someone guide me through the detailed workflow, please? I'm using FME workbench 2024.2 Thanks,
Hi everyone, quick question: how can I remove the rows from my Excel file where the ID number is duplicated, so that only one record per ID is kept?
HelloI am trying to figure out if it is possible to read Levels from a .dgn files, and rename them according to a Table given to the script. I work at a public contracting authority where we receive “As-Built” .dgn documentation from our consultants, structured according to industry standards regarding level naming, and it would be a huge help if we could rename them to a human readable name which our maintenance employees can understand.I guess I’ve found a way to “read” levels in Microstation files, but I cannot seem to find something that can write Levels. Is that possible with FME? Any help would be appreciated. CheersIoannis
Dear FME Community,I need to calculate measure PK from an object, modify them and apply to another object for cut it to elements.I try to explain all steps with this schema :I’m at the STEP 4 but I’m blocked when I want to apply my Measure PK to another objet.For that I’ve a FMWT in ZIP join to this subject.Thank you for your attention and your help.Geo-x
I am hoping to produce a group of points along polylines of various lengths. I’ve been trying to mimic the GeneratePointsAlongLines() method from arcpy and ArcGIS Pro which will simply build out points from the start of a polyline at a designated interval (regardless of line segment vertices). I’ve investigated Densifier, but this transformer incorporates vertices and produces points that do not conform to the designated interval. I’ve contemplated utilizing Snipper, but this seems challenging given that many of the line segments I expect to incorporate may vary in lengths for different inputs.I’d appreciate any insight that can be offered.
Hi. I'm reading dwg files with the civil 3D reader. I need to use the attributes in the propertysets. this works perfectly with exposing 'autocad_xrecord_datalist' in the reader for all geometry types, but not for the blocks. the property set attributes from the block don't seem to be present on the 'autocad_insert'. I tried exposing fme_attrib_info but they are also not there. any ideas? or is this just not possible on blocks ?i added a screenshot of the pset in the dwg
Hi,Does anyone know how to retrieve the information from the Settings tab of a layer published to Esri ArcGIS Online (AGOL)? I’m specifically trying to get the Data Source URL. The Request URL I’m using doesn’t return that information. Any ideas?
Sometimes when I do a transformation from dwg to shape everything is included in 1 polyline (text, pipes, arrows) and when I look at it in inspektion mode I see that the dwg is splitting the lines by color, how do i do the transformation with a separation by color or adding the color value inside the whole polyline Sorry if my vocabulary is wrong
Hello,This should be a very simple thing, but I just can't figure out how to do it!I want to append two tables together (Tables 1 & 2), both with very similar attributes, but I want to use the ID from Table 1 as the official Primary Key, and then get the highest number from that PK and increment upwards to create new PK values for the Table 2 appended values. I can get the maximum value from Table 1 using StatisticsCalculator, but I can't for the life of me work out how to use that value in the creation of the new Primary Key.I've been trying to do a conditional value calculation in Attribute Manager, something like, if Table 1 ID has a value, then PK = Table 1 ID, else use MaxValue from StatisticsCalculator and sum it with @sum(@double(@Count()),1.0) to increment up. But it's not working.Any ideas greatly appreciated!Thank you!Katrina
I am Featurejoining the output from a change detector that compares an original layer from ArcGIS Online to a revised layer from my Geodatabase. Note: The AGOL layer was originally published from ArcGIS Pro from the coordinate system WGS 1984 Web Mercator (auxiliary sphere) .The Featurejoiner transformer rejects the features saying: “Coordinate system does not match first feature's coordinate system”Similar to the issue as seen in https://community.safe.com/topic/show?tid=20659&fid=8When I inspect the original and revised features, my features on AGOL have “SPHERICAL_MERCATOR” and my revised features have “SPHERICAL_MERCATOR_0”In my workspace, my revised features are reprojected with ESRIReporojector to WGS_1984_Web_Mercator_Auxiliary_Sphere before entering the change detector. They then show a Coord system of “SPHERICAL_MERCATOR_0”. FYI The ESRIProjector does display a warning saying “2.1_EsriReprojector: Ignoring input feature coordinate system `_MGA2020-54_FME_0'. This
I have a JSON file from waze that I am trying to read.I am using the JSON (JavaScript Object Notation) reader.There are three schema; alerts, irregularities and jamsI can read alerts okay with this queryjson["alerts"][*]Flatten Nested JSON values into Attributes = YesRead Entire Feature as JSON Fragment = Nowhich reads 433 alerts, each with a location.x and location.y which allows me to built a point object (Vertex) for each feature.But I am struggling with the irregularities and jams.The irregularities have a line object which obviously does not convert into two neat columns.How do I read the line object?I have attached the json file here
Hi All,I have set up my tool tip to tell me the version number of a particular Transformer in my workbench.Is there a way of relating the version number of a Transformer to the version number of my software?Can I find out which version of the software that a particular Transformer has an upgrade?For any particular software version, is there a list of the version numbers of the Transformers?Thanks,Nick
Hi everyone, I have a question: how can I use FME to create a series of equally spaced points along a 3D polyline provided as input from a DXF file?
I don’t have an programming background, so please bear with me. I need to find out the circular standard deviation of the rotation attributes from a set of features in degrees.The built in AI in the PythonCaller has taken me as far as the code below. I have tried many different prompts, they use somewhat different methods to do the calculations, but all throw errors about missing methods or incorrect classes. It seems that the AI is unable to initialize the script “The FME way”, or I have not figured out the correct prompt.What do I need to ad to the script in order to get the below working? My desired output is the circular_standard_deviation as a new attribute.Another nooby question, what should I write in the box: Class to process features? import mathimport numpy as np# Function to calculate circular standard deviationdef circular_standard_deviation(angles_deg): angles_rad = np.deg2rad(angles_deg) sin_sum = np.sum(np.sin(angles_rad)) cos_sum = np.sum(np.cos(angles_rad))
Have a DTM. Am creating contour lines. Are there any tools in FME that can be used to identify any Depression Contours in the data?
Hello, so we have now switched from Server to Flow and all is good and great except from one bit, and that is there have been made some changes between these versions that have made my emailer workarounds from Server useless.So what we did before is that we just set up the Emailer in the workspaces and sent automatic answers in the ‘Body’ section of the Emailer such as:p>Hello Colleague</p><p>Here is your GeoJson to DWG/Shapefile datapackage:<a href="$(FME_SERVER_DEST_DIR)">Click me to download</a></p>Where the ‘$(FME_SERVER_DEST_DIR)’ was the download link for the result and it worked very well.But now on Flow it doesnt work, the email sends and all but there is no value being fed into the ‘a href’ so now download hyperlink for the message.What has changed here, is it only the value for the URL and if so what value should I be referring to now to get the result data on flow downloadable?If this has now been made very different then what should I be doi
Hi All,How can I add a conditional parameter (visibility) in FME 2022? I know it’s possible for 2023 but can’t find it for 2022.I have created a workflow that allows the user to export data into different formats (E57, CAD, LAS, XYZ) and I want to offer the option to export the data as DWG or DXF if the user picks CAD, some images below: ...then the user only has the ‘Choose the output CAD format’ enable if CAD was chosen in the first parameter. I’m on FME(R) 2022.2.5.0 (20230329 - Build 22795 - WIN64)
Hello,I am using LineOnLineOverlay to detect intersections within a polyline dataset. I am only interested in intersection points that involve more than one feature, and would therefore like to exclude any intersection points where a feature is intersecting against itself.Using the attached image as an example; I wish to ignore the intersection where line A is intersecting itself, but need to record where lines A and B intersect, and where line C crosses over line B.TIA,RB
Recently two independent installations of FME 2018.1.2 crashes at start. Has anybody had similar situations and may suggest how to identify the root cause?
Hi everyone,I'm working in FME Form (not FME Server), and I would like to capture any error messages that occur during translation and send them via email using the Emailer transformer.I tried using the LogMessageStreamer transformer, but it seems that it doesn't capture error messages — only warnings and general log info.Is there a way to retrieve the error messages (or even the full log) during a translation, and pass them into the Emailer transformer?I'm looking for a solution that works within FME Form. Any ideas or best practices would be greatly appreciated!Thanks in advance,Isabelle
I think this is a simple one, but for the life of me i cant seem to figure it out. I am running a line on line overlayer and only want to compare 1 feature dataset to another (i.e. i dont want features from the same input dataset to self intersect). Thanks in advance. I am running FME2011.
Good morning, I'm trying to write some geodb_point features (cell) to a DGN using Bentley MicroStation Design Writer. The MicroStation cell library must be specified in the writer's parameters. The cells are placed in the DGN, but they appear incorrectly scaled compared to the cells in the cell library. If I refresh the cells in the DGN again from the cell library, they appear correctly scaled again. Unfortunately, I have to perform this step manually for each cell. I've tried adjusting various settings in the writer's advanced parameters. To no avail. Can anyone help me?
Hi everyone,I am new FME user and I will be grateful if i could get some tips what transformers should I use for such an analysis I need to do:I have two addresses’ database (one is reference), both contain addresses (points) and one contains buildings (polygones). i have to compare that dataset: if addresses are on the building or not and if not how distance is betwen address and builiding. If postalcodes are correct; for example if addresses on street x have all the same postalcode. if address is located on correct street and correct town/village.