Using transformers to modify data.
Recently active
I have workflow that pulls large groups shapefiles of different geometry types from a folder using a feature reader and then exports them to a geodatabase. I would like to export them into a feature dataset inside the geodatabase. I have tried including the dataset in the file path but that either gives me an error or results in a blank geodatabase. If I don’t try and put the data in the featuredataset and just put them in the geodatabase everything exports without any problems. How can I get the data into featuredatasets?Creating the path using an attribute manager.Putting the path in the Feature Class or Table Name parameter.
Hi all,I have two CSV files (A and B) that I've included using CSV readers, and I need to join them using a feature joiner on a specific column. CSV A contains numbers in all rows, whereas CSV B has numerous <Null> cells in the column. When I run the feature joiner it fails. I already tried:Changing both attribute types to number I included attribute managers before each CSV to include letters with the numbers of each CSV file to force matching as textDoes anyone have any suggestions? Many thanks.
StringReplace does not do what I expect (version 2024.2.1.0)Newlines are not replaced, can someone please point out what I'm doing wrong?
Hello everyone,I’m having trouble reprojecting a shapefile. The file is currently in SIRGAS 2000, and I need to convert it to WGS84. However, when I run the reprojection, an error occurs (see attached image).Additionally, I need to extract the current coordinate system of the shapefile. In the table, the field shows up as _FME_0, but it should display SIRGAS 2000.Does anyone know how to fix these two issues?
HelloIn one tester I enter a value through a published parameter. Then I have a second tester in which I would like to retrieve the previously entered value. How can I do this?Thanks
I want to filter all unique values of an attribute with the attributeFilter. Iam importing the values stright from the data source using the import Wizzard but it is failing to list all availabel values. It really caught me of guard.I checked the database for unique values marked “Correct” in the image vs the wrong output by AttributeFilter.I used DuplicateFilter to aslo check for unique values and it returned the same as my SQL Query. Am i using AttributeFilter wrong or is it not trustworthy?
Hi all.We’re migrating email submittals to a http based service, which takes a JSON body in a POST request.One of the fields in the post body is “emailBody”, which can be text or html.So I’m attempting to use a JSONTemplater to build this, but it fails:JSONTemplater (XMLTemplaterFactory): All features receivedJSONTemplater (XMLTemplaterFactory): The following error occurred near line 7, column 50 of the query:JSONTemplater (XMLTemplaterFactory): invalid expression: syntax error, unexpected "QName", expecting "," or "}"An error has occurred. Check the logfile above for detailsTranslation FAILED with 1 error(s) and 4 warning(s) (0 feature(s) output)Line 7 in the ROOT expression is the HTML, with escaped apostrophes and removed linefeeds and whitespace between tags:{ "emailFromId": "planinfo@lifa.dk", "emailFromName": "planinfo@lifa.dk" ,"emailAddresses": [{fme:process-features("TO")}] ,"emailCcToId": "","emailCcToName": "" ,"emailBccToId": "","emailBccToName": "" ,"emailSubject": "T
I am using FME Form 2025 and the ChangeDetector to identify differences in records from two tables with the same schema. I have ChangedOutput create List(s) named “Changes”. What Transformer do I need to connect to the Inserted and Deleted Ports to get a look at the Lists?
Hi everyone,I'm working on a workflow that writes/updates features to an ArcSDE database using FME. The process completes successfully without any errors or crashes. However, I've noticed that for certain tables, the geometry (and possibly other data) is not actually updated in the ArcSDE database.I'm fairly new to ArcSDE and would appreciate any guidance on what might be causing this issue. Specifically, I’d like to understand: What table properties or configurations could prevent updates from being written, despite a successful translation? Are there permissions, versioning, or schema-locking issues I should be aware of? This is a non versioned table but the writer only works if I select versioned. Archiving is activated for the specific table. Is there a difference in how certain tables are registered with the geodatabase that could affect write operations? Any tips on how to investigate this further or best practices when working with ArcSDE and FME would be greatly appreciated
Hello everyone, I would really appreciate your support.I have a CSV file that contains a column named "LINK" (file attached), which includes the URLs to download orthophotos (.tif).I’d like to understand how to download them all using FME: How should the HTTPCaller transformer be properly configured? Is it necessary to create an attribute to assign a name to the orthophoto files? Could someone share an example script or workflow? Thank you very much for your help and support!
I want to transform a geotiff to an ecw while removing the nodata. The geotiff has just one band (band 0: Gray8). I do not have a clipper, so I think cannot use option 2 or 3 mentioned here, but only the first: use a rasterbandnodatasetter.So I used a rasterbandnodatasetter to set 0 as nodata, but when writing to the ECW this is not retained and still a black border is shown around the georeferenced image.What should I do to remove it definitely?
Hi, Just wondering: Is there a transformer that reads Esri *.pagx layout file? Greatly appreciate your help. Thanks, Willy
I have a point dataset representing the locations of streetlights. I want to replace each point with a small line drawing that symbolizes a streetlight. This symbol is stored as a set of line geometries and can stay line geometry.I suspect I may not be using the correct approach, but here’s what I’ve tried so far:I used a GeometryExtractor to extract the line geometry of the symbol, and a GeometryReplacer to apply that geometry to each point. This almost works — however, instead of placing the symbol at the location of each point, the points are being moved to the location of the symbol. As a result, I end up with over 4000 symbols stacked on top of each other at the original symbol location.I’ve included an image of my workspace to illustrate the issue.
I have a building footprint layer that I am using an oriented bounding box transformer (blue line) and trying to keep the result as close as possible to the original polygon (black line) but for some reason the bounding box is getting squeezed out of shape. Does anyone have any suggestions as to why the bounding box is not aligning better?I am using it to try and automate the georeferencing of a CAD drawing and using the AffineWarper with lines that come from the corners of the bounding box. I am using the long side angle in the bounding box to rotate the CAD drawing, which in this example is still correct but the length of the long side is incorrect which puts out the affine points and scale calculation. This is a case where the footprint is a basic rectangle but there are many cases where the footprint is an irregular shape.
I have an Excel spreadsheet that serves as a data dictionary. After reading a shapefile in FME Workbench, is it possible to use this spreadsheet to dynamically define the data type of each field in the shapefile?
Hello there, I really have a hard time to understand how to use the "Geometry Validator". I checked the "help" and still not sure how it works. I checked an example in IMDF validator and not sure what is the column of "Issue to detect" does, such as "contains -0, NaN, or infinity". I really hope someone can give me a light introduction on this transformer. Thank you and I am really appreciate your help.
Hi! I'm new to FME and I have an issue with published parameters in a CustomTransformer.I created a CustomTransformer name "TeamsConnector" which need to use the published parameters "Message" in a pythoncaller: Now in my main flow I use twice my custom transformer with different published parameters value. "Message 1" as a value for the first use of my transformer: "Message 2" as a value for the second use of my transformer: My issue is when I run the flow instead of having "Message 1" and "Message 2" as expected, I have twice "Message 1":
Hi, It seems to me that there might be an issue when I'm trying to fetch a parameter value of a Custom Transformer, from a PythonCaller inside that Custom Transformer. If I do so, I obtain an error. When I try to do so in the main workspace, or when I add the name of the CT in the parameterfetcher, I don't get an error, and it works. See below screenshot and the attached demo workspace for an example.This seems like a bug to me, but it would be nice if the community can have a look alongside me. Kind regards, Thijs Ps. as a sidenote, I came across this Community Question in which the best practice for accessing parameter values inside a PythonCaller is discussed. In it, it is mentioned that best practice is to use param = fme.macroValues[‘parameterName’] in favour of param = FME_MacroValues[‘parameterName’] Additionally, it is mentioned that DaveatSafe created a problem report 4 years ago to make sure that this best practice is also honoured in the script editor for the Python
Probably splitting hairs here but I’m wondering what peoples preferences are for Tester vs TestFilterI have a Tester where I’m testing for someAttribute = someValue. this is case one. case two is where is fails the test.As it is on it’s own it’s not clear at all why or what the point of the test is. Using a TestFilter would let me define the output port names making it much clearer as to the purpose of the test without needing an annotation.Thoughts? Does anyone do this for the sake of clarity in a workspace?
Hi, I have a dynamic workspace where I am reading in multiple csv update files for multiple feature types to upsert into our database. I had set the primary key dynamically dependent on the target table in the database. I cannot set a where clause on an UPSERT (which I do use with other feature types that have the ability to do I, U, or D) so went to use the "Row Selection: Columns:" section instead. This parameter does not work in the normal way with attributes. It presumes the selected attribute is the primary key field (no orange left arrow in front of the name), rather than using the value. I tried manually adding @Value(primary_key) (the attribute that stores the primary key column name) in the parameter but the feature writer also presumes it is literal and obviously can't find a column called "@Value(primary_key)" and errors. This is something that I would like to do, and is very much a part of a dynamic workflow. Otherwise I will have to create one dynam
After adding FeatureReader_2, the reading order started prioritizing the XML block. Then, a join occurs with the Data Dictionary block, but since the XML is fully read first, when the flow reaches the FeatureJoiner, the data dictionary has not yet been processed, causing an error.This started after I added FeatureReader_2, because I need it to read shapefile files to extract the name and coordinate system, which are parameters defined in my spreadsheet with the paths to each shapefile.Is there any way to make the XML and Data Dictionary blocks read simultaneously? Or, since the FeatureReader is a reader, will it always have priority?
Hello,A DWG is converted to SHP with a Schema Mapper and Schema Scanner (This is a POC for a more complex workspace.). Output FileWhat is the Q_schemam attribute that is automatically created ? (I removed it from the writer but I am curious about it). How do I remove the original attribute from my Schema Mapper ? I selected ‘Source Attribute: Remove’ in the schema mapper, but the original attribute is still outputted. My output also contains Source Bra and Source Fea, how do I avoid writing this attributes? What are they ? Thank you
The FeatureReader for Esri ArcGIS Server Feature Service seems broken in 2024.0. I try to read the following feature type : "Zones de gestion intégrée eau par bassin versant - ZGIEBV";and I get the following error message : ArcGIS Feature Service Reader: Could not find a layer/table matching feature type 'Zones'Python Exception <FeatureTypeNotFoundException>: FMEException: 928219: ArcGIS Feature Service Reader: Could not find a layer/table matching feature type 'Zones' It seems to me like the feature type cannot contain spaces. This worked fine in FME 2023.
I'm using a FeatureReader to read an ArcGIS Server Map Service. The map service has a lot of layers (AKA: Feature Types) which I can choose from to read.If I choose a feature type name which doesn't have a space then it works but if I choose one with a space then FME Desktop errors saying it can't find the feature type with the truncated feature type name at the first space. Here is an extract from the logs below for "Fish habitat areas" as an example of it incorrectly reading "fish" as the feature type name ArcGIS Feature Service Reader: Could not find a layer/table matching feature type 'Fish'A fatal error has occurred. Check the logfile above for detailsStoring feature(s) to FME feature store file `C:\\tempDir\\wb-cache-DownloadFishHabitats-C19216\\Main_map_service_-_FeatureReader -1 3 fo 633 _lt_REJECTED_gt_ 0 85bd7267ad00c49a5eda9b6f99fe095bbe050483.ffsupdating' Is there a way I can get around this? (I can't remove the spaces in the
Hi All,I am working on data with Line Geometry and would require some help to solve the below scenario,While plotting them on map, I see there is small gap between lines in some scenarios and would like to join them together if the distance between two lines is less.(Reason for this gap - There is an asset in between the lines which has Point geometry.- Not sure if this statement will help, JFYI)Below is an example of different line geometries joining with each other, and there are small gap in some scenariosI would like to join gap between Line 3 and Line 4.gap between Line 5 and Line 6I am not interested in joining parallel line, as they are far from each otherAny help regarding the above would be much appreciated. Thanks