Transformers

Hi,When using HTTPCaller with an authorization header with a bearer token, the token appears in the log.How can I prevent this ?I’m using FME desktop and server version 2021 so LOG_FILTER_MASK doesn’t work. Updating the version is not a solution. The bearer token is obtained at runtime so I can’t put it in a private parameter (PP cannot be updated at runtime).Thanks.

Hi community, I am using FME Workbench 2024.1 to create parquet files. Those files contain DateTime columns. It seems as those DateTime columns are missing a codec flag in order to enable the loading in other software (Dremio in my user case). Using parquet-tools we can see the problem:java -jar parquet-tools-1.9.0.jar schema ~/Downloads/part0.parquet can not read class org.apache.parquet.format.FileMetaData: Required field 'codec' was not present! Struct: ColumnMetaData(type:INT64, encodings:[RLE_DICTIONARY, PLAIN, RLE], path_in_schema:[_transaction_ts], codec:null, num_values:66, total_uncompressed_size:95, total_compressed_size:113, data_page_offset:35, dictionary_page_offset:4, statistics:Statistics(max:EC 90 D1 36 42 42 10 18, min:EC 90 D1 36 42 42 10 18, null_count:0), encoding_stats:[PageEncodingStats(page_type:DICTIONARY_PAGE, encoding:PLAIN, count:1), PageEncodingStats(page_type:DATA_PAGE, encoding:RLE_DICTIONARY, count:1)]) I include here a small parquet example with two date

I have a workflow that assesses the proximity of points along lines. These points extend along a series of line segments of varying lengths. For instance, the distances to the next points might be 0ft (the start), 100ft, 100ft, 200ft, and 250ft, so I would like for the corresponding field next to these values to display 0ft, 100ft, 200ft, 400ft, and 650ft, etc. I am aware of the workflow to find cumulative sums (Attribute Creator>Statistics Calculator>Attribute Renamer). While this processes as described, I regret that the cumulative sums do not “reset” when there’s more than one batch of point data within the feature table (the initial point of an additional batch of points simply takes the prior set’s end sum and begins adding new distances from there). If there’s a way to prompt the cumulative sums to account for new “initial” points in a feature dataset and so start from scratch each time, I would greatly appreciate any insight on how to prompt that to occur. I’m happy to sha

I have a requirement to modify the list attribute generated on schema port.Lets say my schema scanner have default attributes name, fme data type and native data type.I want to look on name attribute and find any of its elements have OBJECTID string and remove if it is present.I try to modify list attributes using python caller. It modifies the list elements when I overwrite using feature.setAttribute method it is not working and returns original schema attributes unmodified. Any help using python would be highly appreciable. 

Hi, I have a lot of polygons. I want to identify these ones who contain arcs.option: the polygon is made of lines onlythe polygon is made of lines and arcsI want to filter out all the polygons that contain lines only (option 1). I want to keep the ones that contain arcs (option 2). I tried the geometry property extractor but all polygons are always rejected : MISSING_GEOMETRY_PROPERTY as the error message. I don’t understand why. pls advise. 

"Failed to free sufficient memory to reach the process usage limit"This warning is appearing my log files. What do I need to do about it? What is the potential impact if nothing is done?As far as I can tell there is nothing wrong with the output files the script is creating.  

I have a work process that inlcudes running FME jobs daily.I would like to automate logging of potential errors. To do so i am thinking of just reading the .log files from the workbench(es) and search for error as keyword to catch if something went wrong in the translation. I thought it would be straight forward to implement, but i cannot find a way to read .log files using FME directly. Instead I am thinking to use a python script. But I wanted to ask here if I have missed an easy method to check log files for errors.

Hi,I am using FME Workbench 2024. I am wanting to know if I can use a loop or iterative process of some sort to individually run multiple feature classes and shapefiles through a single AttributeKeeper Transformer for each data source, possibly using the names as an iterator. I am working on bringing in utility data from multiple sources and ultimately writing them to a single geodatabase feature dataset. First, I want to clean up the fields and only keep certain ones. Each source of data has a different schema. Currently, I can only use an AttributeKeeper on each feature class/shapefile in order to later output each to its own feature class in the output geodatabase. This would make for a messy workspace with many of the same transformers. Any advice would be greatly appreciated!

Hi All,I am working with lists and require some guidance on the below scenarioI have list which contains 'n' elements. I would like to add a sub-element to each element in the list.Assuming my list name called as "list{}"Example: (My list currently looks like this)    List{0}        element1        element2        element3    List{1}        element1        element2        element3    List{2}        element1        element2        element3    List{n}        element1        element2        element3        I would like to add new sub-element called "element4" at the end of each list element (i.e., add "element4" as sub-element below "element3" )        Expected Output (I would like to achieve something like below)    List{0}        element1        element2        element3        element4    List{1}        element1        element2        element3        element4    List{2}        element1        element2        element3        element4    List{n}        element1        element2        elem

I’m at working on matching indoor point cloud data to gml LOD2 data using ICP so I want to transform my gml data to a point cloud data to help ease the matching. Can anyone please help me? question is how do I transform GML LOD2 to point cloud data? also if there are other suggestions to complete this task. Thank you 

Hi,I have some villages (Primary and secondary villages), each containing a main folder, a subfolder, a data folder, and some empty folders. I will designate one village as the primary village. All sub-village files/data will be stored in the main village folder. Only location path links will be kept in the secondary village folder (marked in red color). Other data will be sourced from different locations (Marked in green color). Finally, I must validate whether all folders and data have been correctly segregated or not. I am currently performing this process manually, which involves copying, pasting, and validating each folder and village individually. This manual process is quite time-consuming and manpower. Kindly help me about this test cases and workflow. I am new to FME and am eager to learn more about its functionalities. Thanks.

I have a point feature which has been developed based on the polygon ID. All of these points are created at the polygon Centroid, I want to distribute the point randomly within the polygon

I have been using the FME Packager in Python to create my own transformers. I am trying to add an “images” folder to my package that my transformer will use however I get errors whenever I try to package my project.This is my package.yml file, Ive been using the Hello World Package guide for references and trying to look up ways to do it This is my file structure This is the error I get  

How i have atleast 20+ AttributeManager in my FME workbench and this take a lot of my time in editing each of them every time..... When i delete / rename any of my headers......is there better way when i rename / delete Input Attribute it reflects the changes till the end ?

Am creating three sets of numbers from one source file. Each set has a different attribute structure. I want to fan these out into separate tabs of an Excel spreadsheet, using a created attribute that is common to the three streams, but has a different value for each. Have tried every permutation of setting I can think of in the Writer/dynamic schema defn, and cannot get it to respect the three different attribute schemas. Feels like this should be easy, but…..🤔

The new FME AR app update has introduced a login page with a URL or Barcode (see attached). Are these logins for a server app or a FME Flow instance? I cannot find any documentation on the process here. I have not been successful in logging into my FME Flow Instance or server apps so I am not sure what else the login url could be. Any help is appreciated.

Anyone who knows a way to convert STEP-files (.stp) using FME? I cannot find a reader for this format, closest one is IFC I guess. The format is ASCII-based so maybe there is some workaround using other readers/transformers?

I am using FME Form 2021. I have a table with vehicles listed by department.  Vehicle 1234 Department 1Vehicle 4532 Department 1Vehicle 5645 Department 2Vehicle 8472 Department 3 When a new record (example: a vehicle) is added to the table, I want an email to be sent only if the new vehicle is associated with a specific department. For example, Vehicle 6577 is added to the table and is associated with Department 3; thus, an email would be sent notifying the recipient that a new vehicle has been added. However, if the vehicle is associated with Department 1, then no email would be sent.  What Transformer(s) that would trigger the email do you recommend I use to achieve this? It sounds like ChangeDetector could be an option, but I am only using a single table.

I am using FME Form 2021.In the Emailer Transformer Message - Body (Text Editor), Can someone tell me the proper HTML syntax to make text bold?<b>Total Number of Vehicles:<b><br><br>Number of Vehicles by Division- Using the above syntax, the email sent shows all the text is bold, including “Number of Vehicles by Division-”. I only need “Total Number of Vehicles:” to be bold. 

The scenario is as follows: We are able to get the dynamic segmentation done using Feature Merger & Snipper transformers based on event table and routes, but we also want to capture "LocationError" field values like similar to "Make Route Event Layer tool in ArcGIS" Any thoughts are suggestions like how do we achieve it in FME? 

I am in the process of working on an integration between Cityworks and ArcGIS Urban. While I am well-versed in using the HTTPCaller transformer for REST APIs in FME Desktop, after s few hours of working with an HTTPCaller, the only way I was able to make a GraphQL API call was using a PythonCaller with some custom code using the requests library. For now, the PythonCaller route will work well enough, but I would rather lean on the HTTPCaller for when others have to take over this integration who are not Pythonistas.

I’m trying to write data from one ArcGIS Online hosted feature layer to another using schema mapper for field mapping. I’m finding that the features from featureclass1 are being appended to featureclass2, but there isn’t any data written into the attribute fields for these appended features. Am I missing a setting in schema mapper?This is the result of my workspace (featureclass2). Features 4-7 were appended from featureclass1 to featureclass2, but the data didn’t come through.This is featureclass1, you can see there is data for those features.I’m using a csv file for my schema mapping. The schema mapper is mapping one → newfour and two → five. I’ve tried this keeping the source attribute and removing it with the same result.Thank you!

I authored some scripts years ago that use the ArcSDEQuerier transformer to query for records in a versioned 10.1 ArcSDE Geodatabase. The machine that FME resides on has FME 2019.3.1, both ArcGIS 10.1 and ArcSDE 10.1, and both Oracle 32-bit (ArcGIS) and 64-bit (ArcSDE) clients installed. The scripts have worked for years without issue. Recently, I’ve had to modify them a bit and on a development FME machine, the ArcSDEQuerier transformer works fine, but promoting them to another same-build FME machine has had some odd results. If I use the exact scripts/workspaces from the dev machine, the ArcSDEQuerier throws the error seen below. Or if I open scripts that were already on this machine, untouched, the ArcSDEQuerier also throws the same error: However sometimes, and I stress sometimes, if I open a brand new workspace and add a single ArcSDEQuerier, I can connect to the same DB using the same credentials without issue: I know the obvious answer is that something has changed with ArcSDE,

Hi Everyone, I tried to make use of the schemamapper transformer to create a new output excel spreadsheet which takes a customised schema csv file as an input. The problem is that the schema file sits within a random folder (date time stamp temp folder name - e.g. 20190903100000) each time the workbench run. (PS: the randomised folder is created at the beginning of the workflow and being passed through as an attribute value).Due to the randomised temp folder name which i tried to pass into the schemamapper as the dataset, I am not able to pass it through. I then tried to create a custom transformer where i can pass the temp folder name via attribute value > published parameter for the custom transformer. The new problem I have now is that the custom transformer does not appear to be able to pick up the attribute value (which has become a published parameter) in the dataset field within the schemamapper.It always throws an error shows "ERROR |CSV reader: Failed to open file &#39

Hello,does anyone know why the Truncate Existing Function in Esri SDE Writer does not reset the OBJECTID Counter of a registered Table. (Table is not Versioned).SDE Writer File is based on World Parameter (not SID) and I am using ArcGIS 3.1.4 and FME 2022.2 (but had the Issue also in constellation ArcGIS 2.6 and FME Desktop 2021)The data is written on Oracle 19.15BrGoran