Using transformers to modify data.
Recently active
Hi! I have a dataset with 75,000 entries that were user inputted, and therefore have several typos. For example, they are proper nouns, some are labelled "kathryn" vs "katheryn" vs "kathrye". I'm trying to find out how to use a fuzzymatcher where each of these is matched to the ID that they most align with. Some challenges here:1) This is a register, so there may be 50 entries that are labelled "katheryn" and 50 entries that are labelled "kathryn". If I use a fuzzymatcher which doesn't have a threshold, then it doesn't work for me as each one connects to itself. I'm considering a similarity ratio between 0.7 and 0.99 for this reason.2) I want to preserve all entries, as entries include other data that I need for further analysis. Ideally, the output would be a column which uses an identifier for all entries that fall within the similarity threshold. Do you know how I can do this? Apologies if it isn't clear, I don
Hello FME Community! Year long learner, first time poster, please go easy on me. I've been trying to add a prefix to all files within a directory. I have searched the forums for answers, and have tried a few different suggestions from previous posts but for some reason, my files don't get renamed. In this example, I would like to add "2022-" as a prefix to all filenames in a folder. So far, I have used the "Directory and File Pathnames" Reader with the following settings:Next, I have used the Attribute Manager to change the filename properties:Finally, using the File Copy Writer to put the files into the same directory:I can't figure out which settings may be wrong or not completed properly. Thanks in advance for any help or tips! Stefanhttps://community.safe.com/s/question/0D54Q000080hKw8SAE/quick-way-too-rename-files-for-noobs
I have a shapefile in which the download URLs of many tiff images are written in the attribute "RGB". I have to download all tiffs and save to my filesystem. I first tried with the HTTPcaller transformer which downloaded the files but named them all after the header description. I couldn't find a way to determine the filename in the transformer when "save response Body to" was set to "file". Then I saw a post from Takashi in which the FeatureReader transformer was used to download files. This downloads the files into an fme-Temp directory and I am able to name the indivual files according to an attribute in the Shapefile, but after the transformer has done it's work, all the tiffs are automatically deleted. Unfortunately I have no idea what's doing on here but i'm sure i'm only a short step away from being able to download the tiff files to a directory of my choice with the correct filename. Could anyone show me what i'm forgetting?
could anyone please guide me on this step by step.
Hi all,I've drawing as a SmartSolid in Microstation with tag attributes.But, FME recognized my solid drawing as wireframe of solid. So how can i re-solid of this wireframe? or how can i import data as a Solid? not a wireframe.I also need to tag attribute value on solid in FME. So I don't want to lose them. Thanks.
I've had a look at a couple of the Inspire tutorials on writing Inspire data in particular the following:https://community.safe.com/s/article/eu-inspire-initiative-tutorialhttps://community.safe.com/s/article/inspire-natural-risk-zones-demo-annex-iiiThe issue that I am hitting is I am losing my geometries in the last step and I cannot for the life of me see why. I am missing something but cannot see it so any pointers from the community appreciated. I've attached a workflow and test data.In the screen shot below I can see the geometries in the geometry property setter but do not get written.
I'm breaking my Roadway center line into each Vertex and when I use a spatial filter I'm unable to get 100% match. Any help? I'm planning to use line builder to create each line between each Vertex and remove the fake lines as some roadways have "multipart poly lines" ..Where m = two GPS locations. I hope to spatial filter those out. This is the start of my work space, and I cannot get 100% match? Same GPS coords, I looked at the GPS value 7 decimals down and they match. 449024.999979021
Using the Esri Geodatabase (ArcSDE Geodb) Reader and Writer what would be the best settings to get the best performance to truncate and insert annotation feature class records to a writer. These annotation feature classes are not versioned
Hi,I have a dynamic pdf with a large number of questions. This file will be filled in by different people and we will recover these files once the investigation is complete.Then we want to compile all the answers from these files and we would like to do it in Excel.Is it possible to convert dynamic pdf file to Excel with FME?Thanks a lot,Have a nice dayMatthieu
i would like to write different numbers for input parameters 2354 or 6985 or 4893i mean ,i want to add different input numbers and inside the workspace i have added test filter for the input user parameters if specific attribute has 2354 or 6985 or 4893 should do function .so my question : how could i add input parameters more than id numbersFME 2018 ,thanks in advance
A FeatureReader typically outputs data features on defined data ports, plus the "<Schema>" and "<Initiator>" ports.I know that "<Schema>" features gets output before any data features (from that schema), but what about "<Initiator>" ?Does this feature get output at the very end, i.e. after all data (for this initiator) has been output ?If not, is there a way to initiate a downstream transformer _after_ all data has been output ?
I'm using the JSONTemplater and have an attribute list. My (sub) template is {"id": fme:get-attribute("sumo_id"), "crosswalks": fme:get-list-attribute("_list{}.poly_id") }Which works fine if i have multiple list elements, but becomes a string if I only have one. { "id": "390335938", "crosswalks": ["225790", "2833648", "15808"] }, { "id": "126630292", "crosswalks": "1243410" } when I'm looking for { "id": "390335938", "crosswalks": ["225790", "2833648", "15808"] }, { "id": "126630292", "crosswalks": ["1243410"] }, Is there anyway to force the JSONTemplater to keep the array, or baring that what is the best way to post process the templater results?
Hello everybody, If you have seen the image, the labels displayed near the points they mention the order or the route of GPS, I would like to know is there a possibility for example to eliminate the segment which is near point 70, because in real life it should snap on the other segment. https://zupimages.net/viewer.php?id=21/27/j24o.png
I have a directory structure containing source raster tiles (512x512 pixel png files) in TMS (XYZ) format at level 10. These have been provided to me by a third-party.From these I'd like to generate levels 9 & 8 so additional layers can be shown in a leaflet app. I thought FME and the WebMapTiler would be the answer, but I'm struggling to get this working. So far I have the following in workbench: A PNGRASTER reader that reads all the source files from the existing directory structure.A PythonCaller to calculate the bounding coordinates of the source tiles using a python function from here - https://wiki.openstreetmap.org/wiki/Slippy_map_tilenames.A RasterGeoreferencer to georeference the rasters usign the above coordinates.A RasterMosaicker to generate a single raster.A WebMapTiler (set to GlobalCRS84Scale, Minimum Zoom=8, Maximum Zoom=10) to generate the raster tiles at level 10, 9 & 8. A PNGRASTER writer with the name set as the Y (row) attribute and a fanout express
Hello,So I have a data, which is called "Amendment Date". The format is as followDD/MM/YYYY HH:MM:SS. I would like to make a checker to check if the input data are correct. I tried the attached steps and it seem ONLY works on correct order. If the data is wrong, it said ERRORS and cannot run the transformer. Would someone please guide me how to do valid the format. Thank you.
How do I convert a date such as 12/31/1979 to Julian date in FME?
Hi All,I am working a project ,where client asked us to add suffix to a attribute value .This attribute value is not a Unique , in order to make it unique we have ad suffix values as shown below image , requesting you all to provide a solution ? to reach this requirement! (the suffix number should be 4 numbers)Thanks in advance.
291 / 5000 ÜbersetzungsergebnisseI'm looking for a transformer with which I can create a buffer around a line. This buffer should have a defined width. The line has z-coordinates.At the end I would like to continue using the buffer polygon that was created and the polygon should receive the z-coordinates of the line.
I am currently using a ChangeDetector to determine which fields have been updated in two different databases. The change detector works as intended and creates a list of different fields have that have been updated. The problem I have is that all the updates need to be written to a database on a one-by-one basis and currently I cannot find a way of sorting the updates by the specific field that has been updated. The updated list created by the ChangeDetector has specific attributes called "attributeName" and "revisedValue". I want to use those two attributes to create a new single attribute which is named after "attributeName" and has the value from "revisedValue" that indicates to my database which field need to be updated and the value that has changed.
Hey community! how can I convert a point cloud in this sense? When I put my obj in Unity I have this problem....
I've got a 3D DGN of a bridge out of Bently. I'm following the instructions in the Creating FMEAR Datasets from 2D Cad models article. Since it's already a 3d model, I'm assuming that I dont need the extruder or offsetter. So it should just show up if I convert it, right? I do get a layer list and scale information in the app, but the surface dots disappear once it loads, and nothing else shows up.
The work flow of this process is that there is an excel spreadsheet from another department that is updated with one new record everyday. This excel document is the source for another spreadsheet that we use in our department where there are formulas that update columns. What we are noticing is that when the workbench is run the next day it will not pull the new record automatically. If I open this excel spreadsheet and save it manually then the FME excel reader will pull the new record. What can I do to get the FME workbench to pull the new record? Thank you, Laura
I have data for various sites and some sites have been digitised more than once and have overlapping polygons. However, these are not virtually identical polygons. They only partially overlap. I want to find the sites that have overlapping polygons. I tried using SpatialRelator with "Intersect", using the same data as both Requestor and Supplier but it picked up instances where one polygon was actually adjacent to another but probably just overlaps a tiny bit. This resulted in 3700 out of 3900 having more than 1 related candidate which doesn't really shortcut the process. "Contains" wouldn't work because not all overlapping polygons are completely contained.
I have a workbench in which I translate XML files to featureclasses in an ESRI SDE geodatabase. The featureclasses are versioned. I use a featurereader in which I specify the child version. That version is then created by the featureader since it doesn't exist before the start of the translation. Updates are done with an SDE geodatabase writer in this version. I specify in the parameters that the version is to be reconciled and posted after the translation. After posting, the version should be deleted. This is also indicated by setting the appropriate parameter. When I run this workbench in FME desktop, this works fine. However, when I publish the workbench to FME server and run it via an automation, the version is reconciled and posted, but it is not deleted. The log displays the following error:Error deleting the version 'versionname'. The error number from ArcObjects is: '-2147217140'. The error message from ArcObjects is: {The version is currently in use. [versi
I have some data that i am trying to replicate from 1 DB to another, but I cannot create the readers for several FCs that contain arcade expressions. I get the The error number from ArcObjects is: '-2147211773' message. I am running FME 2021 (64 bit), and have ArcPro installed and the Esri ArcGIS Capability is set to Pro. One thing I can't seem to get is the ArcPro Python listed under Python Compatibility. But I do see that listed in FME 2019 on the same machine. Any thoughts on whether or not this should be working and if so, how I can get it to work?