Using transformers to modify data.
Recently active
I have a Excel in which some cells have STRIKEOUT text. I can find the cells where the whole cell text is STRIKEOUT by using the advise of the below post.Recognize "strikethrough" in cells | CommunityBut the cells which have STRIKEOUT text and normal text are not recognized. I need to exclude the STRIKEOUT text and work further with NON STIKEOUT text, even if both are in one cell. The first record I can find and exclude but the third record STRIKEOUT is not recognized. Is there a way I can only read NON STIKEOUT text if it is included with STIKEOUT text?The STIKEOUT text could also be part of a sentence like: abcdefghijek mno pgrs tuvwxyzwhere pqrs should be left out.
Hello, I have a polygon dataset and I am trying to find the polygons that are within 200m of another polygon. I am trying to do this using the NeighborFinder in candidate only mode with the “Number of Neighbors to Find” = 1 and “Max Distance” = unset and then using a tester to select the features where _distance is less than 200. I am getting a lot of features out of the “unmatchedcanidate” port though. I would have though with number of features to find = 1 and an unset max distance all candidates would be matched and given a distance to their nearest neighbor? am I missing something?
In a workspace processing AutoCAD data, I have recently replaced a bunch of transformers with an InlineQuerier, and downstream of it is an AttributeFilter, filtering on the autocad_entity attribute. Because of this, I found that the InlineQuerier is dropping this attribute, regardless of whether it’s exposed when entering.I don’t need the attribute for my queries, so I had not originally added it to query columns, but after some testing, the only way I can get the attribute to persist on the features exiting is to include it in the query columns, specifically include it in my SELECT statement, and also not include fme_feature_content in the SELECT. With a simplified query:Works - autocad_entity is present on outputNot working - autocad_entity missing in outputI found this post Geometry Replacer - missing attribute after output | Community where the replies note the GeometryReplacer will remove this attribute (among others) to avoid issues downstream - this makes sense, and I’ve found
Hi, Has anyone else noticed that when you use an attribute creator in your model, or renamer, or in your manager where you reuse an existing field, it works perfectly in your model but is not transferred when you write it to your shapefile? I always have to use a separate creator at the end This used to be no problem at all. I am now using 2025.2, but I had already noticed this in version 1.
I am in the process of automating feature service creation and uploads to AGOL. We have built this process in FME 2023.2.2 and it works as intended. After updating to FME Form and Flow 2025.2, I am getting this error message (see below) when trying to create a fGDB by importing an XML schema created just upstream from the fGDB writer. I have updated my AcrPro to 3.6.0 and made sure that the Python Compatibility is set to ESRI ArcGIS Python 3.13. I have confirmed that the XML is valid by importing it into a working fGDB in ArcPro, and that it is finished being created before the attempt to create the fGDB. The ArcObjects error number points me towards the article linked below, which tells me I have a spatial reference issue, so I am not sure what the actual resolution could be. I am overwriting the spatial resolution in the XML to reflect the state plane coordinate system the potential project will be located in, which was never an issue with previous FME versions. Has anyone else come
so i have this polygon and i can see the min extents and max extents in the record information window. i know that i can get the coordinates and calculate the length and width of the polygons, but i’m interested to know if the min and max entents in the geometry portion of the Record Information can be obtained directly?
We currently use the ArcGIS Data Interoperability extension for standardization and validation of alphanumeric and spatial data, processing datasets ranging from 1,000 to 10,000,000 records.We are aware that there is a difference in the number of transformers available compared to FME Form, but we would like to understand whether there are deeper technical differences that a beginner user should consider when deciding between continuing with ArcGIS Data Interoperability or investing in a full FME Form license.Specifically, we would like to know: 1. Performance with large data volumesAre there significant performance differences between the two solutions, especially when working with millions of records? 2. Structural limitations of ArcGIS Data InteroperabilityWe would like to understand whether there are important limitations regarding: automation and scheduling of routines, database integration, advanced geometry manipulation, building and debugging more robust workflows. 3. En
I am new to lists and xml in FME and having a bit of trouble. I am trying to use the XMLTemplater to populate an XML tag using a list value.My XML template looks like this: <prompt>{fme:get-attribute("prompt")}</prompt> <output>{fme:get-attribute("output")}</output> <data> { for $testcount in fme:get-list-attribute("itemlist{}") return <item>{$testcount}</item> } </data> Test count is the output of a list element counter, and itemlist is a list attribute of the items. My output looks like this: <prompt>Material</prompt> <output>Survey Attributes/Material</output> <data> </data> There are no contents being created within the data tag.I am trying to get it to output like this: <prompt>Material</prompt> <output>Survey Attributes/Material</output>
Hello everyone,I am a beginner when it comes to FME and loops. I have the following task: I have an attribute column with a value. (e.g. Person 1, age 18Person 2, age 35Person 3, age 41Person 4 , age 45The age column should now be increased by one value x times per specified loop run. The number of loop runs should be controlled using user parameters and variables.I am using FME 2022. Can anyone help me? I have found examples with loops, but as a beginner I don't understand them.Thank you very much for your support. I look forward to your reply.A.B.
When upgrading from one version of FME to the next, I can upgrade some upgradeable transformers, and I can also upgrade the readers and writers to the latest version. But what about the readers that are called by the FeatureReader (and writers by FeatureWriter)?We just upgraded from 2024.1 to 2025.1, and I upgraded the FeatureReader transformer reading a geodatabase. Does upgrading the transformer, upgrade the GDB reader functionality? Or does it automatically call the latest GDB reader? Or does it stick with the old?
EDIT - I have solved my own issue here! We had some network changes, and I needed the SAS from the top level of the storage account rather than the specific container. Problem solved. I’ve successfully connected to the Azure BLOb using 2025.1 Form using the AzureBlobStorage Connector:I can connect to the “Hosted” folder inside the container “shared-data”. I am connecting using SAS. However, I need to use Flow 2024.2 and so I need to open this same workbench in Form 2024.2…. and this is where the fun starts!The transformer is slightly different, when I try to configure the Container I don’t seem to have the option to add the “Shared-data”. I am a complete novice at connecting to Azure, so please do not worry about over-explaining anything, I need all the help I can get! Many thanks in advance for any words of wisdom.RegardsStu
A caseA column code contains both unique and identical values (e.g., A, A, B, C, C, C, D, E, E).A second column names contains different names.I want to group a column, but the names associated with it need to be merged.How can I easily solve this in FME? Thanks in advanced!
I have a column containing values (contains 1 or more sorted names) that are both unique and duplicate. Now I want to assign a unique number to each value. This means that the values that are the same should also have the same unique number. How can I handle this within FME? Thanks in advance!
I am trying to connect to a SFTP using the FTP caller. I have followed the instructions in https://support.safe.com/hc/en-us/articles/25407554321805-Using-a-Private-SSH-key-with-FTPCaller-to-Authenticate-an-SFTP-Connection-for-FME-Form-and-FME-Flow-on-Windows-Systems and I can connect to the server using other methods (winscp, filezilla) so the new key is working. In the log (with debug enabled) I get the following:SystemCaller: Executing 'start "" "C:\Program Files\PuTTY\pageant.exe" --encrypted C:\PPK\PrivateKey.ppk'FTPCaller (FTPFactory): Using the 'SChannel' TLS library for HTTPS/FTPS connectionsFTPCaller (FTPFactory): FTP info: Trying ??.??.??.??:22...FTPCaller (FTPFactory): FTP info: Connected to ??.??.??.?? (??.??.??.??) port 22FTPCaller (FTPFactory): FTP info: Failure establishing ssh session: -5, Unable to exchange encryption keysFTPCaller (FTPFactory): FTP info: closing connection #0FTPCaller (FTPFactory): FTP/FTPS/SFTP transfer error: Failed initializationSystemCaller_2: E
Hi All, I have the following set up where / separate's attributes - where Value X and Y can exists multiple times within a month linked to the Item ID.Place / SubPlace / itemID / Year / Month / YYYYMMDD / ValueX / ValueY / SUMXPlace / SUMXSubplace / SUMYPlace / SUMYSubplace /What i would like to do is after i have the sum per month per place and subplace, is to see the sum again of these sums on a quarterly basis - ie. Jan-Mar = Q1, April-June = Q2.So the final table would be something along the lines of this - to still allow filtering per place/subplace/quarterPlace / SubPlace / Quater / QSUMXPlace / QSUMXSubplace / QSUMYPlace / QSUMYSubplace /Any ideas or help would be greatly appreciated!/Emma
Hi, I’m working on a script which copies data from an Esri arcsde geodatabase to a postgis database. I need to know if the table in the arcsde geodatabase is versioned before I run the rest of the script, and I have a pythoncaller which runs something like this (simplified here):layername = "schema.layerName"connectionFile = "path_to_connection_file"arcpy.env.workspace = connectionFiledesc = arcpy.Describe(layername)isVer = desc.isversionedfeature.setAttribute("versioned",isVer) self.pyoutput(feature)Now, I don’t want to type in the path to the connection file manually, but rather obtain it by some function which can collect the data from the list of database connections I entered in the settings. Is this possible? I’ve looked into the FME Web Services API reference for such a function without any luck. Best regards,Jacques 👷🏼
One of the greatest new features of the IFC4x3 schema is that we can write 2D lines to IFC, which was not supported in IFC2x3.Why does the new IFC writer support only 3D surfaces and solids and not 2D line geometries?
It seems that in the iOS18 update Apple made changes to the HEIC file container that means the FME Feature Reader using HEIF (High Efficiency Image File Format) now fails to read the HEIC files.We are currently using FME 2022.2.Is there a later update that will support iOS18 images? Is there an alternative way to read in these images successfully?
I'm trying to setup the children and parents list attribute for export to CityJSON. Therefore I thought to use the listbuilder, but I get a different result than it should be. This example is how it should be: And this one is my result. It looks like there is an extra layer in it.How can I solve this?
Hi Everyone!I’m currently working on a workflow using a dwg file (water system) to convert it into a geodatabase. I was wondering if anyone has any tips on the transformers and workflow I could use to successfully do this? Right now I have my dwg reader as individual types, leading into an attribute filter, and geometry filter (3 different ones- 1 for water, drainage, and sanitary). These 3 end up writing into the geodatabase. I would like to have feature datasets separating water, drainage, and sanitary written in the geodatabase. I understand this is a big undertaking, but any tips (or perhaps links to guides) would be extremely appreciated! Thank you!
I have a job that downloads 7 text files from an FTP directory, and for the last 3 days, 6/7 files have downloaded but 1 always fails (the same one each time) with the error: Number of redirects hit maximum amountI am aware of the post below, but as no similar setting exists on the FTP caller, I’m lost. I can upload fine, and manually downloading the files by logging into the FTP site, or using a WinSCP script also works. The file that failed today was empty (0MB), but so are some of the other files it downloads, and yesterdays file had records and still failed. Empty files are not uncommon for this job, and it has never presented an issue before. This has started occurring since upgrading to 2025.1.3 from 2022, and occurs on both FME Flow and Form. This error has so far not appeared in any other workspaces that use FTP callers, even for multiple file downloads at once. I’m leaning toward this being an issue with the file, rather than the FTP, but I cannot see a problem with the file t
Hi I have spent far too many hours trying to make the change detector dynamically pick up changes. The scenario is: I have 10 datasets that need to be compared between the original and updated databases. Each dataset has only a few fields that need to be checked for changes. These fields are different for each dataset. I have a CSV which is acting as a 'config' file and contains a list of the field names to check for each datasetI have 2 workbenches; the first workbench gets all of the information from the config file, then passes through the information via user-parameters to the Change Detection workbench via workspace runner. Even though I have created a user parameter for the "Match Selected Attributes" config in the ChangeDetector, I can't pass through this information via the workspace runner. It ONLY works if I run the Change Detection workbench individually, and this isn't linked to the config file, so it's not dynamic at all. I got so frustrated
Hi, sometimes the XML Driven XML Writer decides that I have not set the Application Schema when I click on FeaturePaths edit button. As you can see it is set and the XSD file behind works well in a different workspace. But for some reason I get the error you can see in the attachment and I don’t know why. Starting a workspace from scratch works again with the same settings. Thank you for advice.
Hi everyone,I’m working with DWG files in FME — reading them, attaching XREFs, and then writing back to DWG.I’m trying to attach an XREF to a specific layer (something other than Layer 0), but so far I haven’t had any success. I’ve tried setting both the fme_feature_type and autocad_layer attributes, but the XREF still ends up on Layer 0.It also seems that when using the DWG reader, FME always interprets XREFs as being on Layer 0, even when they’re on a different layer in the source DWG.Has anyone found a way to preserve or specify the layer assignment for XREFs when reading/writing DWG files in FME?Thanks in advance!
We have a polygon shapefile in which features overlap because the data is self-reported. During our analysis, we noticed that when a feature is 100% overlapped by another, it is not considered in the clip process with another dataset. However, we want all features—even those that are fully overlapped—to be taken into account when performing the clip. What configuration or procedure should we use to ensure this behavior?