Using transformers to modify data.
Recently active
In my scenario, I have an FME script that performs data validation. If the data is valid, it updates the database. However, if any records contain errors, I want to capture those records in an Excel file for users to review before uploading the data. In this error case, no data will be updated to database. So, the logic I'm aiming for is as follows:Validate the data. After validating all data, capture all invalid records to an Excel file. Then, terminate the FME script without uploading the data to the database. If all data is valid, proceed to upload it to the database.I've attempted to create a flow with a terminator, but the Excel writer doesn't have a connector. Connecting the terminator to the output port of the TestFilter after validation would terminate the writing of the error Excel file as well.Can anyone provide suggestions to solve this issue?
I have two point files and need to identify the nearest point in file A to the nearest point in file B, however the matching must be unique. Meaning once a point in file B is matched to a point in file A it cannot be matched to any other point in file A.I can match them using nearest neighbor but don't see a way to restrict to eliminate duplicate matching, so I end up with the same point in file B matched to multiple points in file A.
Hi All,I’m having a bit of headache to read all the SHP included within a ZIP through the FeatureReader transformer, I’m getting the following error Shapefile and cannot be read for some reason. I can reader it with the normal SHP reader but can’t get it to work on FeatureReader, here is a screenshot of the settings: What am I doing wrong?
Hi all,I have a 15 minute timestep data which has random missing values (expected). I’ve managed to track where the data has gaps, but in order to calculate a consistent rolling 24 average of the value I need to fill these missing gaps with a timestep but null value (so i can calculate an average from the preceding X values)Does anyone have any suggestions on how to fill these data gaps automatically? Or better still calculate a 24 hour rolling average using specific timesteps rather than just number of rows? Thanks
I have a SHP file with geometry. It has an attribute called 'id_alt.' I would like to extract only the values of this attribute. Is there any way to convert these values into variables that I can use the value use with TESTER after UUIDGenerator to filter my data? Alternatively, what is the most efficient method to achieve this with FME
I have an attribute containing String values such asGladstone RegionalSouthern Downs Regional, Goondiwindi RegionalMoreton Bay City, Noosa Shire, Somerset Regional, Sunshine Coast RegionalI want to replace the last comma with “ &” so that the output will look like thisGladstone RegionalSouthern Downs Regional & Goondiwindi RegionalMoreton Bay City, Noosa Shire, Somerset Regional & Sunshine Coast RegionalIs there a way to use a Regular Expression inside the StringReplacer transformer to accomplish this?
Hello everyone, I want to get the largest rectangle inside a parallelogram. Do you have any good ideas for achieving this goal? I didn’t find an efficient answer on the web. Is there a transformer/workflow in FME that can do this?Thank you very much for the help! Jenny
HI, I’m looking into using HTTP caller to update records in my Salesforce Org I am struggling to get anything workisng, I have tried to setup a connected app to setup a FME web Connection but keep getting an error. The aim is that another service calls the FME job and it runs and updates a record in Salesforce, we have the record ID for each run so we know what record and field to update but I’m also not sure using the HTTP Caller how to have it refresh the token also? I have also tried following this guidehttps://support.safe.com/hc/en-us/articles/25407494166029-Connecting-to-Salesforce-in-FMEbut everytime I try to test it come up with a Network Error: invalid_request Any direction would be appreciated. Thanks
I have my workbench on version 2021.2 where i am running different workspaces, the emailer transformer always throws an error 2024-05-09 22:54:24| 0.5| 0.1|ERROR |Python Exception <ModuleNotFoundError>: No module named 'fmepy_emailer'2024-05-09 22:54:24| 0.5| 0.0|FATAL |PythonFactory failed to load python symbol `fmepy_emailer.Emailer'2024-05-09 22:54:24| 0.5| 0.0|FATAL |Factory proxy not initialized2024-05-09 22:54:24| 0.5| 0.0|FATAL |Emailer_3_CALLER (PythonFactory): PythonFactory failed to process feature2024-05-09 22:54:24| 0.5| 0.0|ERROR |Emailer_3_CALLER (PythonFactory): A fatal error has occurred. Check the logfile above for details2024-05-09 22:54:24| 0.5| 0.0|ERROR |Creator_XML_Creator (CreationFactory): A fatal error has occurred. Check the logfile above for details2024-05-09 22:54:24| 0.5| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details This is the fme email package Please help me understand what i am missing here
Dear, I want to merge two different datasets. One data set has road segments with a maximum speed and the other is bike segments. For each bike segment I want to know what the maximum speed is on the nearby road segment. Now I want to merge for each bike segment the road segments that are near (next to each other) I have tried anchored snapper but that does not work 100procent. Do you have some ideas on how I could take this problem on?Thank you in advance (purple the road segments, pink? the bike segments) Only the segments that are parallel to each other should be combined
Hi All, I have FME Form 2023.2.I am trying to make a REST API call using HTTPCaller. I got this error below,{ "code": "data_validation_error", "message": "Invalid request values. Unexpected character ('_' (code 95)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')", "status": 400, "traceId": "240425163408767-2c15ec9a"}However, the same request works just fine on Postman. Not sure what exactly the error means here. Can anyone help me on this?Here is the HTTPCaller screenshot.Here is the request body, Here is the error messages from the Translation log.##########...UpdateRecordCustomTablesHTTPCaller (HTTPFactory): An error occurred while accessing the URL 'https://apis.accela.com/v4/records/PINELLAS-24CAP-00000-0004H/customTables'The below feature caused the translation to be terminatedStoring feature(s) to FME feature store file `C:\FME\Funeral Home\FuneralHomeBillingInterfacefmw_log.ffs'++++++++++++++++++++++++++++++++++++++++++++++++++++++
Hi, I’m having an issue with the StasticsCalculator returning some nulls for min and max. And also some unexpected rounded max values. Input data I’m calculating statistics on avg_dur field and grouping by SEG_ID. Unexpected results highlighted. The avg_dur field is data type real32. For some reason changing the data type to real64 results in the stats being calculated as expected.The ave_dur field was originally imported from an esri shapefile with data type .
HiCurrently I am converting a DWG file to GDB (file) / SHP,The DWG file itself has line and polygon and they have color based on their different layer name.Once I read the file, it showed only FME feature name, I used AttributeExposer to add autocad color column and a few more useful information, then I used DWGStyler and FeatureColorSetter but once I write the file to GDB or SHP and bring the data to ArcGISPro, the layer has only one single color. (Please see the attachments) Can someone give me a clue how to solve it?
Hi All,I’m trying to improve the performance of my workbench by reducing the number of transformers. I was able to use AttributeManager to calculate the length of lines with the expression @Length() but I can’t work out how to round up the value up to 3 decimal places,Is that doable using the arithmetic expression instead of AttributeRounder transformer?
Hello,I am trying to convert data from shapefile to DWG.To do that, I am using the DWGStyler to assign the correct setting to each object.Reading the post in the community, I am able to use the DWGStyler using a template and the right color is assigned to each object in CAD so, I see the match between the color in the canvas and the color in the Layer’s list. But, in some cases, I don’t have the template and when I open the file in autocad I can see the right color in the canvas assigned by the DWGStyler but in the Autocad list layer I see all layers in “red”, I attached an example. How can I resolve this situation to have the perfect match for the layer’s colors to avoid a manual rework without using the template? Thanks Max
Problem in short:I have a lot of points which some has identical coordinates. PointOnPointOverlayer does this for me and store the “twins” in a list name. Now I want to use a Pythoncaller to loop through the list of each feature and figure out if some or none of the twin attributes has a value that should update the the major feature. The problem is that I cant seem to reach the list variable created in PointOnPointOverlayer from the Pythoncaller. It seems to be exposed when running with feature cache and checking output from PointOnPointOverlayer. What’s the magic for reading the list, looping throug it and check the attribute values? Tried this example code from the PythonCaller just to see if I could reach the list but can’t see anything:
Hey! I have an 50 diffrent MXD and I need to retive the map extent from start in every mxd. There is an option to igonore map extents.But is there an an way to extract the start extent?
Hi Community,I need to extract a CSV Style content from a SQL field of an SQL table.It is stored into a single field.The content looks like this:Classification,Fonction03-1,30003-2,301AA-10,C-1000AA-12,C-1000AA-15,C-1000AA-17,C-1000AA-20,C-1000AA-22,C-1000AA-25,C-1000AA-27,C-1000AA-30,C-1000As you can see, the first line gives me the Attributes names and the following lines gives me the valuesWhat would be the best way to turn this into multiple features using the first line as the Attributes names ?Thank you
Trying to find a way to find the maximum amount (highest density) of polygons with the rulethe polygons must be non-neighbouring. Essentially selecting a polygon and jump to the next polygon which is not neighbouring and so fort and so on until you encounter a neighbouring one.See attached picture which I hand-picked.
Hello fellow FME-ers. I'm looking for a transformer to compare two GIS datasets and what has changed compared to each other. Actually, the Symmetrical Difference tool that is present in ArcGISPro. This transformer must be there in FME. Can anyone help me with this? Thanks in advance.
I have a test looking for many possible cases. one of the cases I want to find is Any folder inside of any folder that has some specific names. (BTW I am using directory and File Pathname reader to create a list) and then a tester to get all of the special cases.)I have a test line like path_directory_windows CONTAINS *\project_data\working\**\*I don’t get any errors with this syntax but it does not find the folders. Basically i am only wanting to find folders within any project_data\working folder that contain any files.If it doesn’t contain a file I am not concerned with it.Any help with a correct regex statement that would work, or the proper syntax for the contains statement are what i am needing.I have tried this regex unssuccessfullyproject_data\/working\/[^\/]+\/[^\/]+TIA
I’m trying to use FME to split out any “Complex” or “Multi-Part” annotations that exist in the dataset and have the “Complex” or “Multi-Part” deleted and insert the split records as new annotations.On my FeatureReader, I have both "Split Complex Annotations" and "Split Multi-Part Annotations" enabled and I am able to delete the old records and insert the new records. However, I’m running into an issue with the geometry of the newly inserted records.From another post it looks like FME splits complex annotations tries to preserve the location of the text but loses other text placement characteristics like the original complex text geometry (lines) and converts them to a point for each split text item.'Split Complex Annotations' when reading ArcGIS geodatabase annotationsIs there a way to create or preserve the complex text geometry for these split records? The converted points seem to be causing an issue in a downstream program with the following error:Error from downstream program: “Err
I’m attempting to access an AWS marketplace free resource, NOAA’s bathymetry, but with Anonymous access if I enter us-east-1 as the region I cannot manually specify noaa-bathymetry-pds as the bucket and I cannot get a picker, or not that I can see. Is there a trick? Thanks.
Hi there,I have an Ascii grid file.The FME can read the file I have also added a Raster Cell Coercer transformer to create a shafile this simple workbench works fine. Issue - How the raster values can be displayed in the shapefile. The shapefile has no attribute data (cell values).I need to display the raster values in the shapefile. Any hints will be greatly appreciated.Thank you very much,Sebastian Algardi-CamusWorkbench Raster image
When I use the aggregator, the IFMELine becomes an IFMEMultiCurve.I don't want the IFMELine to become a IFMEMultiCurve. How can I prevent this?