Using transformers to modify data.
Recently active
I have a workspace that writes to a simple Excel sheet. The sheet has 3 columns: Report Name, Upload Date, and Upload Time.In Excel you can set a Filter for each column allowing a user to filter the data in that column. In Excel, I added a Filter to each column, but when I write to the sheet in FME Form, the Filters disappear. Is there a way to “keep” or “add” a Filter to each column in the sheet by tweaking a Writer parameter or is there another Transformer I need to add before the Writer? The screen capture below shows what I would like the sheet to look like:
I have a list of lab test results and only want to include the rows that match a list of analytes. I am trying to use the IN operator in the tester transformer.I have followed the advice from this post:Help with syntax when using Tester transformer | Community (safe.com)This is what I have:Sheet1 contains the test results, text_line_data contains the list of analytes as one feature. I have merged them to get this: The “text_line_data” column looks like this: My tester transformer is set up as below: However, all rows fail the test. What am I doing wrong?
Hi All, I have a table with a 'route_ID' and a measure value (like a event table). On the other hand I have a polyline feature classe. The attribute 'Name' correspond to route_ID from the table. The measure values are points on the lines. Now the measure values changed by a predetermined value (e.g. the point was 10 m and now the point is 10.5m). My Problem, the Polyline feature class is not defined as route form a linear referencing system. And so the table and the Polylines have no relations. I don't no where (which coordinate) my old and new points are. Can I build a route feature class with FME? The Basisc should be my polyline Feature Class. I would have assumed a route feature class, how can I creat points (with coordinates) form the table? Thanks for your help. Debby
I have a workbench build in version 2022 using active choice to enable and disable parameters based on other parameter values. This option stopped working in the new 2023 version.Does anyone know if the active choice is discontinued?Thanks
Clustering Points With K-Means in FMEThis article has been generated using FME 2017.1For a project to assess the quality of suppliers, five suppliers were approached to perform comparisons on aerial imagery. They were asked to select areas from aerial photographs where potentially dangerous situations might arise as a result of human activity. After the first delivery of reports from the suppliers within a test area, one of the obstacles for the project appeared to be the identification of clusters of reports. A cluster of such reports represent an area where a potentially dangerous situation has come about. A criterion for selecting the best supplier to detect the situations from the imagery, could be as follows: the best supplier is the one that “touches” the maximum number of clusters with the reports generated, with as few notifications as possible. Because FME played an important role in this project, but no transformer seemed available within FME, a study was made to implement a
Hi, I have a gdb with pleanty feature classes with unique schema and I use SchemaScanner and Dynamic gdb to save the layers. Feature layers saved in the gdb have correct schema but the order of the columns is wrong, it looks like the new feature layers have the columns ordered alfabeticaly
I am having issues with glacial speeds of using a delete from statement within a SQLExecutor pointed to Oracle Database. The SQL query is something like:DELETE FROM ABCWHERE ID = @value(id)AND TO_CHAR(DATETIME,’YYYYMMDDHH24’) > @value(timefrom)AND TO_CHAR(DATETIME,’YYYYMMDDHH24’) <= @value(timeto) (note: The query above is paraphrased and might contain syntax-errors, I have checked and confirmed the syntax in the actual version) The Oracle Table contains about 40 million rows, so I expect this to take some time (1-5 minutes per query) but not the >30 minutes for the first query (at which point I gave up, I have not confirmed if the query will ever finish) Currently I am using a workaround of Loading the primary keys of all features that fit the selection criteria and using a writer to DELETE all corresponding records, but this seems unnecessarily inefficient and wasteful. I can imagine that the error is caused by Oracle not returning a ‘succeeded’ or ‘finished’ message, causi
I have XML file with features I'm trying to read.. that works. Next step is to create a polygon for each feature, I have a string with points that make the polygon. String looks like this: 173363.252 587903.412 173363.369 587902.665 173362.055 587900.798 173363.867 587888.745 173364.007 587887.815 173371.744 587888.843 173368.618 587904.7 173363.252 587903.412 That's a list of x and y coordinates, now I can't figure out a idea to make polygons from it. Any ideas? Do I have to seperate them, create lines and make a polygon from it? Any help is appreciated.
I would like to convert a json file to csv using a csv writer from a json fragmenter. How do I convert it? The json file is an output that is generated using API tokens. When I run the FME workbench, the translation log is successful. But when I try to inspect the data, I get the below error message. Please look into it and do the needful. An error has occurred. Check the logfile above for detailsCSV reader: Failed to open file 'C:\\PSDCitywide_towns\\Lake simcoe\\LakeSimcoe_Trial_17J2024\\@Value(Assets).csv' for reading. Please ensure that the file exists and you have sufficient privileges to read itCSV reader: Failed to open file 'C:\\PSDCitywide_towns\\Lake simcoe\\LakeSimcoe_Trial_17J2024\\@Value(Assets).csv' for reading. Please ensure that the file exists and you have sufficient privileges to read itAn error has occurred. Check the logfile above for detailsFailed to specify the feature index as constraints on the readerAn error has occurred. Check the logfile abov
Hey guys, I have a fairly large dataset of lines and points. The points need to receive the Z coordinate from the nearest index on the line. Using the CoordinateExtractor followed by a ListExploder isn't an option because that would be too heavy for my workspace. Isn't it possible to use the CoordinateExtractor in a way that in the setting 'Specify coordinate' you only extract the index that is nearest to a point feature? Is there a different way to go about this?
I have an FME session set up, from shapefile to shapefile with a renamer. My number fields go in as "Long". They are set to come out as "Long". When I pull the output into ArcGIS, the format is "Double" What am I doing wrong?
Hello,I encountered an issue while using the RasterObjectDetectorSamplePreparer to prepare samples for the RasterObjectDetectorModelTrainer. My goal is to detect certain objects based on a digital orthophoto image. I created an annotation.txt file using OpenCV and provided the relative paths to the negative samples directory and the annotation file as inputs to the Sample Preparer transformer. However, when running my workspace, I received the following translation log message:Translation FAILED.The translation was terminated due to the following feature:RasterObjectDetectorSamplePreparer_<Rejected> (TeeFactory): RasterObjectDetectorSamplePreparer_<Rejected>: Termination Message: 'RasterObjectDetectorSamplePreparer output a <Rejected> feature. To continue translation when features are rejected, change 'Workspace Parameters' > Translation > 'Rejected Feature Handling' to 'Continue Translation''The feature on tag `PYOUTPUT' fail
(This is a spin of question from https://community.safe.com/s/feed/0D5OO000004YH4O0AW, but I thought it made sense to rephrase the question) I am trying to run a shell script from SystemCaller but for some weird reason I can not make it work. My command line is: cd "/Volumes/disc1/test_systemcaller/" && my_script.sh 25 5The numbers at the end are parameters for the script. The error I get from the log file is:sh: my_script.sh: command not foundThe file 'my_script.sh' is placed in the actual folder, so should be found.If I test the file path by asking it to do something simple, eg mkdir, it will happily do so in the right place.If I run the command from Terminal it works fine. I made a second script in the folder with a mkdir just for testing. While it works fine in Terminal, FME claims to know nothing about it. Since system caller cant find the script file, even though it is in the folder, I guess that something might be wrong with my syntax? I'm on a Mac if that matters.
My fmw is saved in a directory called C:\\DATA\\VariousTasks. A parameter called InputFolder is pointing to a subfolder of this directory. Is it possible not to use FME MF DIR predefined parameter ? I use a text parameter to point to C:\\DATA\\VariousTasks\\DEV but the script is replacing it automatically by "$(FME_MF_DIR_USERTYPED)DEV" when executing which translates to C:\\DATA\\VariousTasks/DEV . I am using a python script later and python is every sensitive to / and \\ . How can I force FME to use C:\\DATA\\VariousTasks\\DEV instead of $(FME_MF_DIR_USERTYPED)DEV (translating to C:\\DATA\\VariousTasks/DEV) ?
Hello! I would like to create LOD2 buildings, but somehow, my files don't show their own citygml relations between parent_id and gml_id. Could you find me some errors in my workflow? I created gml_parent_id as a field already. eg.)<?xml version="1.0" encoding="UTF-8"?><core:CityModel xmlns:brid="http://www.opengis.net/citygml/bridge/2.0" xmlns:tran="http://www.opengis.net/citygml/transportation/2.0" xmlns:frn="http://www.opengis.net/citygml/cityfurniture/2.0" xmlns:wtr="http://www.opengis.net/citygml/waterbody/2.0" xmlns:sch="http://www.ascc.net/xml/schematron" xmlns:veg="http://www.opengis.net/citygml/vegetation/2.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:tun="http://www.opengis.net/citygml/tunnel/2.0" xmlns:tex="http://www.opengis.net/citygml/texturedsurface/2.0" xmlns:gml="http://www.opengis.net/gml" xmlns:gen="http://www.opengis.net/cit
I have a workspace that takes a spreadsheet that contains these fields: And I've got that reader feeding into a FeatureReader that grabs the Source Dataset feature classes from a specified .gdb. I would like to dynamically create a new attribute called "_description" and populate it with the values in the Feature Description column. The values that are referenced in the Feature Description column are not exposed, but I can view the values when I click on a feature in the visual preview. I've tried to use an AttributeCreator with the following parameters:However the output looks like the literal string input values, instead of dynamically grabbing the values from the feature:Is there another way I can achieve this?
Hello, i used the topologybuilder transformer to build the topology of a network ( roads centrlines). The problem is that z values are not considered while computing intersections. So it may not produce correct results for overpasses, inderpasses....Any recommandations please. Thank you.
I have got this Geometry XML data from HTTPCaller and need to know what is next to convert it to SHP file or other ESRI formats, I tried to find an XML template for geometry and run it with XML Processor and then XMLFragmente, but I didn't get the data.
I am writing to MSSQL using a dynamic featureWriter. But I can not understand why it fail to write to an existing schema. Warning: Cannot find a matching schema named 'dbo.MyTable' in the known set of schemas: ''. Known schema sources are: 'MSSQL_SPATIAL_1'. Please verify writer feature type configuration Error: Microsoft SQL Server Spatial Writer: A feature has arrived with 'fme_feature_type' of dbo.MyTable, but the feature type is not recognized. Halting translationMSSQL_SPATIAL writer: A fatal error has occurred. Check the logfile above for details. The fme_feature_type here is "MyTable". In the writer I use dbo as table Qualifier to match the existing table in my database "dbo.MyTable".What is it I am not getting? I have set the Schema Definition Name to the default option because it should use the table definition for the fme_feature_type "dbo.MyTable". I will try to prefix the Schema Definition Name with the dbo. prefi
I am trying to segment a line dataset at every intersection with a polygon dataset. Instead of breaking the line at the true intersection, the transformer appears to generalize the polygon first, then break the line at resulting intersections. The result is as seen in the image, in this case a dangle of about 7'. (candidate line left to right, original polygon in brown, and Intersector's drawn line from bottom left to top right. Selected blue line should end at polygon boundary.)I've tried LineOnAreaOverlayer, Intersector and Clipper with similar results. I've manipulated the coordinate systems of each dataset and changed their source type with no differences. What am I doing wrong? Thanks!
Pretty simple data export, I have a reader referencing some SDE data and then a writer to a file geodatabase. But reviewing the attributes in the file geodatabase I see that the domain attributes are the codes (1,2.3, etc) not the descriptions (copper, steel, PVC, etc).Is there a way to write the domain descriptions and not codes? The same is true for the subtypes, it is writing the code (1,2,3) and not the description (tap, bend, saddle, etc).
Hi,How can I expose the information that are visible in the Properties/Source tab of feature layer
I am joining 3 tables together. There will always be a record in the first table and there may or may not be a related record in the second. If there is a related record, there may or may not be a record in the third. I always want to have the record from the first table.The relationships are as follows:Left: Table 1 primary key - Right: Table 2 foreign keyLeft: Table 2 primary key - Right: Table 3 foregin keyWhen I try and set this up using FeatureJoiner transformers, it works ok on the first, but if there is no record in the second table, it cannot join to the third as there is no left key. Is there any way to pass records with a null left key in FeatureJoiner? If I did a similar workflow in a Microsoft Access query I would still have the record from the first table. I presume I could use a FeatureMerger and pass Merged and UnmergedRequestor into the input of the next transformer. This could work ok but I do much prefer the FeatureJoinerMany thanks
Hello! I could make a 3D buildings with simple roof form, I got SurfaceNormal Z, so I could separate flat form roof. But I have a building with complex roof. So I want to separate the building from certain Z height, above it, it is roof and under it, it is body of the building. Do you have any Idea to get it?