Transformers

I need to output a list of paired values as a JSON File.I have a list called JSONList with two attributes JSONname and JSONvalue.I am using the JSONTemplater to organise the data.I have the root template set as{  "publishedParameters": [    fme:process-features("SUB")  ]}and the SUB Template as{  "name": fme:get-list-attribute("JSONList{}.JSONname"),  "value": fme:get-list-attribute("JSONList{}.JSONvalue")} but I am just getting the name and value as a single line each.  How do I change the structure so each name and value pair are separated, similar to the below? {  "publishedParameters": [    {      "name": "_portalLayer",      "value": "parks"    },    {      "name": "

I am reading in a very poorly formatted JSON file which has hundreds of lines but I just want to extract some key attributes that will then be used to create a JSON file that can be passed to FME Flow to start a work bench using the extracted attributes. I am reading the JSON file in and running it through an attribute manager to get the attributes I need. If I then run through JSON writer I just get a list like this[    {        "json_featuretype" : "JSONFeature",        "Catalogue Key" : "Data Catalogue",        "Layer Name" : "Testville Roads",        "Data From" : "Import type from CSV file",        "Data Access" : "Restricted",        "Update User" : "Alex",        "Description" : "Roads data for Testville COuncil",        "Dataset Dimension" : "3D",        "Data U

Im trying to implement some dynamic selection based on an API call response. So far I can build a package for scripted selection according to Dynamic choices using Scripted Selection - FME Packages SDK Guideand debug in VS Code attaching to Workbench (Build a Hello World package - FME Packages SDK Guide).The problem is that debugging is bound to running the translation and that is already late for the script I need to debug. The selection scripts are run when filling in the transformer parameters. I need to add breakpoints and inspect the execution of selection script (ScriptedSelectionCallback) during the API calls and browsing the object structure. Is there some setup to make this pos

Hi everyone,I have a problem that I can't seem to solve. I have a workspace that writes data from a PostGIS database to a feature layer on our portal using the ArcGIS portal writer. When this workspace is run locally on FME form, it works perfectly fine. When it is uploaded to portal and run there, it seems to work fine (the amount of features written is identical to the amount when run locally), but some important fields are not filled. Flow and Form both use the same web connection with the same authorization parameters. Why is it that a identical workspace that runs locally can fill all fields fine, but when run on portal it seems to not be able to fill these fields??? I have put testfilters and loggers in between to check if the fields actually have values and they do, so it must be a writer quirk. Field names between the features and writer are identical as well (all lowercase) so I am at a loss... I am using fme form/flow 2023.2.2 and ArcGIS portal 11.1

Hi, I have a task in which I have some points attached to the line. I need to select point values and split the line at the point.I have attempted to generate points between two points using the Densifier transformer, but I am not achieving the desired outcome. If someone can assist me in this situation, I would greatly appreciate it.

​@daveatsafe  Dear FME Community,I am seeking assistance in developing a Python script for use within an FME workspace to automate the desurveying of diamond drill holes (DDH) using the minimum curvature method. I aim to create a flexible solution that allows users to specify a custom desurvey interval (e.g., 1m, 3m, etc.).Background:Desurveying a drill hole involves calculating the actual XYZ coordinates along its length based on the collar location and survey data (azimuth and dip at regular downhole distances).I've researched existing methods and found the following resources helpful:Understanding Drillhole De-surveying: https://seequent.zendesk.com/hc/en-us/articles/360001547955-Understanding-drillhole-de-surveying

I’m trying to compress FGDB with ArcToolbox tool with PythonCaller. This gives no error, but nothing happens after running it. What I am missing? Using FME 2024 with ArcGIS Pro 3.4. Compatability is set to ArcGIS Python 3.11. import fmeimport arcpydef compress_fgdb(fme_feature): fgdb_path = fme.macroValues['FGDB_PATH'] arcpy.management.CompressFileGeodatabaseData(fgdb_path, "Lossless compression") return fme_feature 

I would like to automatically number an electrical network as shown in the diagram below.If the digitization direction of the features is correct, then I get the correct numbering. I used the NetworkTopologyCalculator and TopologyBuilder transformers to perform the automatic numbering.If the direction is reversed, then the numbering is incorrect.Is there a solution to this problem?Thanks in advance.  

Hi All,I’m working on a workflow that reads a LAS file storage as blob in a Azure database. I need to clip the LAS file with a polygon (AOI) and then exports the result as LAS file (or other format).After doing some research, the community suggests to set the My AzureBlobStorageConnector settings to download the LAS file and then process the data. My current LAS file is around 10GB and downloading it every time that needs to be clipped is not very good! The total time of downloading the LAS, clip it and re-export it can be crazy!here are my settings: Is there any way to read the LAS file as blob and clip it directly without download it? 

 I have an issue with some Python code in Form 2024.1.I have to make a connection to a PostgreSQL database using psycogp2. When I run the PythonCaller in my workspace then it fails with an error message that psycogp2 is missing (Python Exception <ModuleNotFoundError>: No module named 'psycopg2')I tried to single out the problem in a minimal workspace (attached), but here it works without a problem. Hence, I am wondering how and what is causing the issue. The actual workspace is rather big and I will share a screenshot of the essential part that is failing.The AttributeManager10 receives a single feature from the summary port of a FeatureWriter and in AttributeManager10 all other exposed attributes are deleted, except the site_id (integer) is kept. Unexposed attributes are there only two:fme_geometry -> fme_undefined fme_type -> fme_no_geom

Hi there,I am trying to generate a survey123 report using FME. I have downloaded and added the custom Survey123ReportGeter transformer however I am using a portal connection instead of an AGOL connection: After this step i have the Tester that checks for the submit_response_body beginning with {"jobId" however the flow always fails here. I get an invalid token message in my submit_response_body:{"error":{"message":"498: Invalid token.","code":498},"success":false}I am not sure if the request URL needs to be different for portal? or if the token i am providing in my query string parameters is not being read in properly…Any help would be greatly appreciated.This is what my transformer looks like: 

I am encountering difficulties when using the SharePointOnlineConnector transformer.The flow is as follows: I have an Excel file listing a series of files to download from the BOX service. If the file is not yet downloaded locally, I download it to G:\workspace\tmp. I then modify the relative path by removing the filename: Example:/xxx/xxx/xxx.zip becomes /xxx/xxx I upload the locally downloaded file to the target SharePoint site, using the modified path as the destination. I successfully managed to upload around 700 files out of 3600 because facertains numbers of folders already exist into the sharpeoint site.However, I am now consistently getting errors such as:UPLOAD_ERROR Could not find the folder.It seems that I might need to create the subfolders first.What would be the best

Hi,Pretty new to FME, so hopefully I have all the terminology right and I’m asking the right sort of questions. I have a feature set from Freshservice API of the available products in their asset system.It’s mostly the Latitude and OptiPlex products I need to work with so the solution can work just for them.I need to match the freshservice_product_name to a feature set that I don’t control and isn’t consistent.As you can see the tesma-description is a bit of a mess but it’s all I have to try match up the freshservice_product_name to.Can someone point me in the right track of how they would tackle this?Thanks, 

Hello all, Complete FME newbie hereI need to transform the data compiled by a different department as an excel spreadsheet to look like this:From Initial structure To Final structureBasically the idea is to pair each of the projects with each of the areas in order to then join the final table to a different spatial table on the ‘AREA’ attribute, ideally without manual input into transformers. The project attribute will have new entries added to it, with corresponding counts, the areas will remain the same.Thank you.

I'm trying to join two Excel files that share a common column called "ID".File (A), which I consider the main file, has 7 columns. File (B) has 16 columns, but I only need one column from it, called "NON", to be added to file (A).I tried using the FeatureJoiner, but it didn’t work. I also used the AttributeKeeper to filter the data, but the result is always null.Note: The column titles in both Excel files are written in Arabic. is this could be the reason? 

Hello ,I have four tables. Each table includes an attribute called result, which contains fields value  string string number. (Hello Community 30 ) ,all tables share a common attribute id I would like to combine the output from all four tables into a single attribute called result  String                String                    String             StringString number  String number   String number.  String no.  I would like the first string from each table to always appear above and the second string  and number written on the next line and All values should be combined into the same field.Thanks on advance 

I am using SystemCaller to run a pyton script (uses conda env) that creates a bunch of files and I am trying to figure out how I can get FME to then read the folder location and serve that to the user as a .zip file. The folder location is an attribute that I use to pass to SystemCaller but I cant figure out how to pass this attribute value to say a FileCopy or even a FeatureReader. The output folder is a concatonated path $(FME_WORKSPACE_DIR) + _output that I made as a new attribute value (_output_folder).In the pic below, I tried to connect the Logger to FileCopy but that doesnt seem to do anythinghere is the FileCopy settings i am using. Am I doing this correctly or any other su

Hello ,Is it possible to control the position of Upper left x and Upper left  y in a PDF formatter by setting their values in an attribute beforehand, so that the PDF formatter reads and uses them directly?I don’t want to keep adjusting the x and y positions directly inside the PDF page formatter every time I find that the output is not properly aligned. Do you have any tricks or suggestions to help me arrange my PDF layout more quickly?It takes a long time to design the PDF layout . Thanks in advance .

Hi all, I am querying an API to download a large number of tables (50+) as CSVs that will be written into a DB. I have automated the process of downloading the tables and dynamically writing them to the DB, but the default/source attributes the tables come with when downloaded are messy/poor quality.One attempt at this I’ve tried is to set up a mapping spreadsheet for each table with an example shown below. I have been able to use a SchemaMapper and dynamic CSV writer to write a single table with the updated attribute names, but I am wanting to do this dynamically using a WorkspaceRunner to automate updating the attribute names for all the tables, while also reading and writing records to the DB.Does anyone have any advice for this? The SchemaMapper is not able to take parameters/attributes to read the mapping spre

I would like to open and read a .accdb file which contains multiple named tables. Instead of reading all tables I just want to select the ones which names match the ID criteria.The example below works fine by using a Microsoft Access reader which compiles all tables into one single merged feature type. After that I compare the source CSV file name against one of the listed attributes and pass forward only the matched lines.  That method worked well and served its purpose, but the downside is that it is way too slow since it is reading the whole accdb and this file is constantly growing because we keep on adding tables over time.I have tried to use the Feature Reader with an initiator which provides the route ID as a key to search an open table if name contains the ID but with no luck. I have tried to add a

I need to transpose an attribute table and tried so far the StatisticsCalculator as well as the AttributePivoter, but do not get the result I need. In addition I was following the advice of Mark (@mark2atsafe​ ) in this posting at StackExchange. While the advice from mark looks 'straight' forward, I struggle with the reader-as-resource since the data are produce through analysis within the workspace where I need to transpose the attributes. After sorting my results I get the following attribute tableand what I need is a structure like 

Currently I am testing the upgrade of FME Form 2024 (from FME form 2022) for my electrical company. When doing auto-update I found out that my stringcasechanger set on lowercase were updated to UPPERCASE. The same behaviour occurs when you update the transformer manually and choosing the default setting. It would be better if it can take over the old setting. 

I have been able to extract polylines from esri fgdb, combine the lines into one record but I cannot seem to figure out how to now recalculate all the M-measures in that line. In arcmap I would manually use the Route Measure editing tools, Set As Distance to 0 and Apply Factor of 0.00018939 to recalculate the line M-measures in miles for the line. I couldn’t seem to get the measure transformers to get the result I was looking for. This was probably user error. Thanks,Ryan 

Hello, I need your help. I'm looking for a workflow to transform my keys and values into a list. Here is an example:I have this table:Key Value a 1 b 2 c 3 a 4 b 5 c 6 a 7 b 8 c 9 and I wanna transform it toa b c 1 2 3 4 5 6 7 8 9  Thank you

I need to transform XYZ data from the currently used DHHN2016 height (EPSG:7837) to the older DHHN12 height (EPSG:7699). Unfortunately, the various transforming options don't seem to be able to do this. E. g. EsriReprojector, with "Use Vertical Transformation" checked, only lists <None> as option under "Vertical Transformation". To complicate things further, the switch to DHHN2016 did not happen directly from DHHN12, but first to DHHN92. So the transformation might need to be done with an extra step: DHHN2016 height (EPSG:7837) -> DHHN92 height (EPSG:5783) -> DHHN12 height (EPSG:7699). However there is no option for this way either.Perhaps a combination is necessary? In this case it would be 25832+7837 to 31468+7699 (or 25832+7837 -> 31468+5783 -> 31468+7699). I added the Reproject files to the install directory but that had no effect. I also don't have "PROJReprojector" available for some reason(?).Version:Data Inter