Using transformers to modify data.
Recently active
Hi All,I have set up my tool tip to tell me the version number of a particular Transformer in my workbench.Is there a way of relating the version number of a Transformer to the version number of my software?Can I find out which version of the software that a particular Transformer has an upgrade?For any particular software version, is there a list of the version numbers of the Transformers?Thanks,Nick
Hi everyone, I have a question: how can I use FME to create a series of equally spaced points along a 3D polyline provided as input from a DXF file?
I don’t have an programming background, so please bear with me. I need to find out the circular standard deviation of the rotation attributes from a set of features in degrees.The built in AI in the PythonCaller has taken me as far as the code below. I have tried many different prompts, they use somewhat different methods to do the calculations, but all throw errors about missing methods or incorrect classes. It seems that the AI is unable to initialize the script “The FME way”, or I have not figured out the correct prompt.What do I need to ad to the script in order to get the below working? My desired output is the circular_standard_deviation as a new attribute.Another nooby question, what should I write in the box: Class to process features? import mathimport numpy as np# Function to calculate circular standard deviationdef circular_standard_deviation(angles_deg): angles_rad = np.deg2rad(angles_deg) sin_sum = np.sum(np.sin(angles_rad)) cos_sum = np.sum(np.cos(angles_rad))
Have a DTM. Am creating contour lines. Are there any tools in FME that can be used to identify any Depression Contours in the data?
Hello, so we have now switched from Server to Flow and all is good and great except from one bit, and that is there have been made some changes between these versions that have made my emailer workarounds from Server useless.So what we did before is that we just set up the Emailer in the workspaces and sent automatic answers in the ‘Body’ section of the Emailer such as:p>Hello Colleague</p><p>Here is your GeoJson to DWG/Shapefile datapackage:<a href="$(FME_SERVER_DEST_DIR)">Click me to download</a></p>Where the ‘$(FME_SERVER_DEST_DIR)’ was the download link for the result and it worked very well.But now on Flow it doesnt work, the email sends and all but there is no value being fed into the ‘a href’ so now download hyperlink for the message.What has changed here, is it only the value for the URL and if so what value should I be referring to now to get the result data on flow downloadable?If this has now been made very different then what should I be doi
Hi All,How can I add a conditional parameter (visibility) in FME 2022? I know it’s possible for 2023 but can’t find it for 2022.I have created a workflow that allows the user to export data into different formats (E57, CAD, LAS, XYZ) and I want to offer the option to export the data as DWG or DXF if the user picks CAD, some images below: ...then the user only has the ‘Choose the output CAD format’ enable if CAD was chosen in the first parameter. I’m on FME(R) 2022.2.5.0 (20230329 - Build 22795 - WIN64)
Hello,I am using LineOnLineOverlay to detect intersections within a polyline dataset. I am only interested in intersection points that involve more than one feature, and would therefore like to exclude any intersection points where a feature is intersecting against itself.Using the attached image as an example; I wish to ignore the intersection where line A is intersecting itself, but need to record where lines A and B intersect, and where line C crosses over line B.TIA,RB
Recently two independent installations of FME 2018.1.2 crashes at start. Has anybody had similar situations and may suggest how to identify the root cause?
Hi everyone,I'm working in FME Form (not FME Server), and I would like to capture any error messages that occur during translation and send them via email using the Emailer transformer.I tried using the LogMessageStreamer transformer, but it seems that it doesn't capture error messages — only warnings and general log info.Is there a way to retrieve the error messages (or even the full log) during a translation, and pass them into the Emailer transformer?I'm looking for a solution that works within FME Form. Any ideas or best practices would be greatly appreciated!Thanks in advance,Isabelle
I think this is a simple one, but for the life of me i cant seem to figure it out. I am running a line on line overlayer and only want to compare 1 feature dataset to another (i.e. i dont want features from the same input dataset to self intersect). Thanks in advance. I am running FME2011.
Good morning, I'm trying to write some geodb_point features (cell) to a DGN using Bentley MicroStation Design Writer. The MicroStation cell library must be specified in the writer's parameters. The cells are placed in the DGN, but they appear incorrectly scaled compared to the cells in the cell library. If I refresh the cells in the DGN again from the cell library, they appear correctly scaled again. Unfortunately, I have to perform this step manually for each cell. I've tried adjusting various settings in the writer's advanced parameters. To no avail. Can anyone help me?
Hi everyone,I am new FME user and I will be grateful if i could get some tips what transformers should I use for such an analysis I need to do:I have two addresses’ database (one is reference), both contain addresses (points) and one contains buildings (polygones). i have to compare that dataset: if addresses are on the building or not and if not how distance is betwen address and builiding. If postalcodes are correct; for example if addresses on street x have all the same postalcode. if address is located on correct street and correct town/village.
HI All,I have prepared a workspace that allows the user to clip a LAS file and export it to LAS or DWG. I was thinking to use the GenericWriter to include the options for the user….but the transformer fails when trying to export as LAS. The reason for that is because I have included a PointCloudToPointCoercer right before the writer to make sure the points are written to DWG however the fme_point geometry isn’t allowed by the LAS format as requires point cloud geometry. Here is a visual screenshot of the workspace: I have included (for now) an additional LAS writer that skips the PointCloudToPointCoercer and writes the LAS file as point cloud geometry…How can I modify the User Parameters to allow the user to chose one writer (LAS) or the other (DWG)?
I need to output a list of paired values as a JSON File.I have a list called JSONList with two attributes JSONname and JSONvalue.I am using the JSONTemplater to organise the data.I have the root template set as{ "publishedParameters": [ fme:process-features("SUB") ]}and the SUB Template as{ "name": fme:get-list-attribute("JSONList{}.JSONname"), "value": fme:get-list-attribute("JSONList{}.JSONvalue")} but I am just getting the name and value as a single line each. How do I change the structure so each name and value pair are separated, similar to the below? { "publishedParameters": [ { "name": "_portalLayer", "value": "parks" }, { "name": "_portalOrganisation", "value": "SWR" } ]}
I am reading in a very poorly formatted JSON file which has hundreds of lines but I just want to extract some key attributes that will then be used to create a JSON file that can be passed to FME Flow to start a work bench using the extracted attributes. I am reading the JSON file in and running it through an attribute manager to get the attributes I need. If I then run through JSON writer I just get a list like this[ { "json_featuretype" : "JSONFeature", "Catalogue Key" : "Data Catalogue", "Layer Name" : "Testville Roads", "Data From" : "Import type from CSV file", "Data Access" : "Restricted", "Update User" : "Alex", "Description" : "Roads data for Testville COuncil", "Dataset Dimension" : "3D", "Data Update Frequency" : "As needed", "Geometry Type" : "Points", "Spatial Presentation Type" : "Vector", "Data Currency" : "2025-11-09", "Initial Publication Date" : "2025-04-15", "Contact"
Im trying to implement some dynamic selection based on an API call response. So far I can build a package for scripted selection according to Dynamic choices using Scripted Selection - FME Packages SDK Guideand debug in VS Code attaching to Workbench (Build a Hello World package - FME Packages SDK Guide).The problem is that debugging is bound to running the translation and that is already late for the script I need to debug. The selection scripts are run when filling in the transformer parameters. I need to add breakpoints and inspect the execution of selection script (ScriptedSelectionCallback) during the API calls and browsing the object structure. Is there some setup to make this possible?The final purpose is to get this into User parameter scripted selection in FME Flow. I understand it would work this way in scripted parameter selection as it is in the transformers.
Hi everyone,I have a problem that I can't seem to solve. I have a workspace that writes data from a PostGIS database to a feature layer on our portal using the ArcGIS portal writer. When this workspace is run locally on FME form, it works perfectly fine. When it is uploaded to portal and run there, it seems to work fine (the amount of features written is identical to the amount when run locally), but some important fields are not filled. Flow and Form both use the same web connection with the same authorization parameters. Why is it that a identical workspace that runs locally can fill all fields fine, but when run on portal it seems to not be able to fill these fields??? I have put testfilters and loggers in between to check if the fields actually have values and they do, so it must be a writer quirk. Field names between the features and writer are identical as well (all lowercase) so I am at a loss... I am using fme form/flow 2023.2.2 and ArcGIS portal 11.1
Hi, I have a task in which I have some points attached to the line. I need to select point values and split the line at the point.I have attempted to generate points between two points using the Densifier transformer, but I am not achieving the desired outcome. If someone can assist me in this situation, I would greatly appreciate it.
@daveatsafe Dear FME Community,I am seeking assistance in developing a Python script for use within an FME workspace to automate the desurveying of diamond drill holes (DDH) using the minimum curvature method. I aim to create a flexible solution that allows users to specify a custom desurvey interval (e.g., 1m, 3m, etc.).Background:Desurveying a drill hole involves calculating the actual XYZ coordinates along its length based on the collar location and survey data (azimuth and dip at regular downhole distances).I've researched existing methods and found the following resources helpful:Understanding Drillhole De-surveying: https://seequent.zendesk.com/hc/en-us/articles/360001547955-Understanding-drillhole-de-surveying Desurveying Methods and Interactive Tool: https://endarthur.github.io/writting/desurvey.html Drillhole Desurveying Python Code (GitHub): https://github.com/WilliamsB39/Drillhole-Desurveying QGIS Geoscience Plugin: https://www.spatialintegration.com/processing-drill-holes
I’m trying to compress FGDB with ArcToolbox tool with PythonCaller. This gives no error, but nothing happens after running it. What I am missing? Using FME 2024 with ArcGIS Pro 3.4. Compatability is set to ArcGIS Python 3.11. import fmeimport arcpydef compress_fgdb(fme_feature): fgdb_path = fme.macroValues['FGDB_PATH'] arcpy.management.CompressFileGeodatabaseData(fgdb_path, "Lossless compression") return fme_feature
I would like to automatically number an electrical network as shown in the diagram below.If the digitization direction of the features is correct, then I get the correct numbering. I used the NetworkTopologyCalculator and TopologyBuilder transformers to perform the automatic numbering.If the direction is reversed, then the numbering is incorrect.Is there a solution to this problem?Thanks in advance.
Hi All,I’m working on a workflow that reads a LAS file storage as blob in a Azure database. I need to clip the LAS file with a polygon (AOI) and then exports the result as LAS file (or other format).After doing some research, the community suggests to set the My AzureBlobStorageConnector settings to download the LAS file and then process the data. My current LAS file is around 10GB and downloading it every time that needs to be clipped is not very good! The total time of downloading the LAS, clip it and re-export it can be crazy!here are my settings: Is there any way to read the LAS file as blob and clip it directly without download it?
I have an issue with some Python code in Form 2024.1.I have to make a connection to a PostgreSQL database using psycogp2. When I run the PythonCaller in my workspace then it fails with an error message that psycogp2 is missing (Python Exception <ModuleNotFoundError>: No module named 'psycopg2')I tried to single out the problem in a minimal workspace (attached), but here it works without a problem. Hence, I am wondering how and what is causing the issue. The actual workspace is rather big and I will share a screenshot of the essential part that is failing.The AttributeManager10 receives a single feature from the summary port of a FeatureWriter and in AttributeManager10 all other exposed attributes are deleted, except the site_id (integer) is kept. Unexposed attributes are there only two:fme_geometry -> fme_undefined fme_type -> fme_no_geom Running to the Attributemanager10 works fine. The next partial run of PythonCaller_4 fails with:2025-04-30 13:46:19| 3.6| 3.4|ERROR |Mes
Hi there,I am trying to generate a survey123 report using FME. I have downloaded and added the custom Survey123ReportGeter transformer however I am using a portal connection instead of an AGOL connection: After this step i have the Tester that checks for the submit_response_body beginning with {"jobId" however the flow always fails here. I get an invalid token message in my submit_response_body:{"error":{"message":"498: Invalid token.","code":498},"success":false}I am not sure if the request URL needs to be different for portal? or if the token i am providing in my query string parameters is not being read in properly…Any help would be greatly appreciated.This is what my transformer looks like:
I am encountering difficulties when using the SharePointOnlineConnector transformer.The flow is as follows: I have an Excel file listing a series of files to download from the BOX service. If the file is not yet downloaded locally, I download it to G:\workspace\tmp. I then modify the relative path by removing the filename: Example:/xxx/xxx/xxx.zip becomes /xxx/xxx I upload the locally downloaded file to the target SharePoint site, using the modified path as the destination. I successfully managed to upload around 700 files out of 3600 because facertains numbers of folders already exist into the sharpeoint site.However, I am now consistently getting errors such as:UPLOAD_ERROR Could not find the folder.It seems that I might need to create the subfolders first.What would be the best way to proceed from now?Thank you in advance for your help!