Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,721 Replies
10000 Posts
limo
Supporter
limoSupporter
asked in Transformers
How to set up web connection to fme server 2023?

Hi, I have a workbench where I download data from Arcgis online.For this I use the transformer "ArcGIS_AP_FileGDBExport". This works fine with FME Form. But I will use this workbench inside fme flow and during the upload comes the following warning: If I ignore the warnings the workbench is not working! How can I set up web connections correctly in fme flow?

570
limo
Supporter
bayram
Contributor
bayramContributor
asked in Transformers
Point to line

good week everyone There is a yield in point format. I want to produce a line from these points. There is a method I used before, but I did not get very good results. As an attribute, each point has a shooting time. Can I create a line using this shooting time?

840
nielsgerrits
VIP
renosungis
Contributor
renosungisContributor
asked in Transformers
Converting a CSV File Loaded as an Attribute via SharePointOnline Connector to a Temporary Table for Transformation

Dear FME Community, I am facing a challenge while using the SharePointOnline Connector in FME to load a CSV file directly as an attribute. My objective is to avoid storing this CSV file on any network drive, local drive, or an M365 named account OneDrive folder. Instead, I'd like to process it immediately within the FME workflow. Goal:My end goal is to convert this attribute—which contains the entire table from the CSV file in text form—into a temporary table or a temporary CSV within FME for further transformation. Version:I am currently using FME version [2022.2.0.0 (20221103 - Build 22765 - WIN64) ]. Problem:I can successfully load the CSV file as an attribute (see picture), but I am struggling to convert this attribute to a format (temporary table or temporary CSV) that I can then transform further.  Questions:How can I convert an attribute (_contents) containing a full CSV text file into a temporary table or CSV within FME? Are there any transformers or specific settings that

830
nielsgerrits
VIP
E
envtom
asked in Transformers
FeatureWriter does not give an output if using a function in the file name

I have used the FeatureWriter to save a csv with a dynamic filename of "Name_@Left(@DateTimeNow(),8)" before passing on the features to be used by the Emailer transformer. However I only get a result from the Summary port and nothing in the output port.  If I change the file name so that it doesn't include functions and uses an attribute instead (creating a new attribute to handle the date function before the featurewriter) then I see features in the output port.

683
DanAtSafe
Safer
C
charu
asked in Transformers
JSON fragmenter works fine in FME Workbench but throws an "Unexpected character: 't'. One of the following characters was expected: '"', '}' " while running the workspace through datastreaming service from another web app.

Hi, I am trying to run the attached fme workspace in fme server as datastreaming service. The workspace works fine in FME Workbench and while running in FME server web interface as datastreaming service. However, I am trying to access this service from my web app. Below is how I am forming the request : var httpRequest = new XMLHttpRequest();httpRequest.open("POST", url, true);httpRequest.setRequestHeader("Authorization","fmetoken token=*********")httpRequest.setRequestHeader("Access-Control-Allow-Origin", "http://localhost:8080");httpRequest.setRequestHeader("Accept","application/json;charset=UTF-8");httpRequest.setRequestHeader("content-Type","application/x-www-form-urlencoded"); httpRequest.onreadystatechange = function() { if (httpRequest.readyState == 4 && httpRequest.status == 200) { console.log(httpRequest.responseText); } } // send a request so we get a reply httpRequest.send(&quot

1380
resegura
Contributor
W
wyymsl001
asked in Transformers
How to get the geometry shape of walls converted from CityGML to IFC

Hi, everyone I'm new to FME, I had some difficulty in getting the geometry shape of walls converted from CityGML to IFC. The details are as follows:I can get the Guid of each wall, but there is no geometry information, could you give me some help? Thank you very much. Best regards Ying

490
daveatsafe
Safer
S
stlym
asked in Transformers
I am trying to loop through a simple process. I have made a custom transformer and added the transformer loop. I two inputs and two outputs of the proces but I can't get my head around how to handle that in the loop?

I have attached a screenshot of the start of the proces without the loop. I want the loop to continue until there are no failed output in the tester. Any ideas on what I can do? Thanks!

280
danminneyatsaf
Safer
V
vijai
asked in Transformers
Distance between lines

I need to find distance between many lines, any suggestion? I tried NeighborFinder, but not helping.

90
V
smclaugh1
Contributor
smclaugh1Contributor
asked in Transformers
Get alias names from ArcGIS Enterprise (Portal) Feature Service.

Is there a way to get the field name aliases from an ArcGIS Feature Service instead of just the field names?

490
nielsgerrits
VIP
dallas2011
Contributor
dallas2011Contributor
asked in Transformers
Create an array for house number analysis

Hello everyone I have street numbers. I have the first and last number of each street. I would like to know witch are missing from my database. My idea is I set the min number ect 1 and the max 60 and creat a list or array to this street has theses numbers. A di could compare it with my database and find with is missing.Thanks advice

140
nielsgerrits
VIP
goatboyboz
Contributor
goatboybozContributor
asked in Transformers
How to return the attribute name of max value in a list.

Hi All, I have a record with these attributes: ID, Condition1, Condition2, Conditon3. Condition values are integers. I want to write to an new attribute the name of the Condition attribute with the highest Condition value. IE if records is ID =Bob, Condition1 =20, Condition2=0, Condition3=80 then write out 'Condition3' to my attribute.  I have created a list, sorted the list then used listindex set to 0 which returns highest value but not the attribute name from where it came from. Any help appreciated @takashi Thanks Steve

600
goatboyboz
Contributor
R
robeesafe
asked in Transformers
I'm trying to create point feature class in File Geodatabase. I'm getting an error when I try to write to a file geodatabase: An error occurred while attempting to convert the '' component of a date....

I'm able to create a point shapefile successfully.

830
fchevaillier
Participant
fme
Contributor
fmeContributor
asked in Transformers
How to convert this to run in FME to pass all excel file types .xlsx out to an attribute. What I want to achieve is to recurse into every folder on my list, recursing into subfolders to identify all .xlsx files and return their file paths.

import os def get_excel_file_paths(folder_path):  excel_file_paths = []     for root, dirs, files in os.walk(folder_path):    for file in files:      if file.endswith(".xlsx"):        excel_file_paths.append(os.path.join(root, file))           return excel_file_paths folder_path = "/path/to/my/folder" ----I have a list of folders in a csv file which i read into the workspace so i plan to use that attribute hereexcel_paths = get_excel_file_paths(folder_path) for path in excel_paths:  print(path) Having troubles converting this to run in fme Thanks!

6216
fme
Contributor
S
shatterstar6457
asked in Transformers
Iterating Excel spreadsheet into OpenAIChatGPTConnector transformer

I have an Excel spreadsheet that contains 2 columns, 1st column is called Terms, 2nd column is called Definitions.  What I want to do is convert each flashcard pair (4 rows) into multiple choice questions via GPT3.5Turbo. The problem I'm running into is that while OpenAIChatGPTConnector  takes in the data just fine, it is only outputting 1 pair (The last row). How can I work around this? 

170
danminneyatsaf
Safer
thijsknapen
Contributor
thijsknapenContributor
asked in Transformers
Issues with Parameters in nested Custom Transformers

I encountered something a bit weird. In a bit larger workspace I wanted to apply parallel processing for part of the workspace, so I embedded that part of the workspace (which already contained some custom transformers) in a new custom transformer. Then however I obtained some issues with the parameters, it seemed that they were not passed on correctly. Attached is a workspace where I replicated the issue. It's just a dummy workspace that connects to an Oracle DB, and (aims to) return the static result; 'Greeting' = 'Hello'. Main;CT_0;CT_1;If I run the workspace with a database connection named 'My_DB_Schema (1-O) @ dev', I obtain an error;Error connecting to Oracle database: message was `ORA-12154: TNS:could not resolve the connect identifier specified'. (serverType=`<serverType>', serverName=`My_DB_Schema', userName=`', password=`***', dbname=`') Although this issue occurs with a Database connection parameter, in my main works

120
thijsknapen
Contributor
katt
Supporter
kattSupporter
asked in Transformers
Why is the ok button missing when using sqlexecutor - attributes to expose ?

Hello, I am using the sqlexecutor and I am populating the attributes to expose from sql query. It correctly displays them but there is a (ok) button missing to add them successfully. When I close the window (x), they won't be added.

60
katt
Supporter
parashari
parashari
asked in Transformers
OSM Basemap in Data Inspector

Hey FME Users, There is a lot of information in and around OSM on the forum, but can we add OSM as the background map in Data Inspector?

890
j.botterill
Influencer
robertgilley
Contributor
robertgilleyContributor
asked in Transformers
Setup details for FTPCaller

I have been tasked to set up an automation that will FTP a file from a State-supported site to our network.I have been advised to use the FTPCaller transformation to achieve this. I have the specifics to the State-supported site and, using WINSCP, can manually download the file. In order to do this, In WinSCP, I supply the host name, the port, and a username supplied by the State. Additionally, I have to click on the Advanced button, then under SSH click on the Authentication text, click on the ellipsis (...) under Private Key File I enter the name of a Putty file (that was given to me by the FME Administrator) The file is sent by FTP using this manual method. At this point I am trying to automate the process so that the FME, using FTPCaller as advised, will achieve the same transfer. However, I am not clear how-to setup the FTPCaller to incorporate all of the parameters (host name, port, username, Putty file) that I have been given for the manual transfer. Can I get some advice on

5065
robertgilley
Contributor
gisbradokla
Enthusiast
gisbradoklaEnthusiast
asked in Transformers
add message response to data download when no data is returned in workspace app

I have a workspace app that accepts a kmz dropped on it. The result is a postgres/postgis spatial overlay with the kmz. When there is no resulting feature I need to send a message to the app instead of the resulting data. I have added NoFeature testers into my workspace to capture any streams that do not have output. Just not sure how to generate a report and get that to the app when the workspace completes. I am thinking now it would be nice to have a count from each of the input data streams whether there is a spatial relate or not.Thanks for any direction.

100
siennaatsafe
Safer
wil
Contributor
wilContributor
asked in Transformers
How to select the latest feature class from ESRI file geodatabase

I have a file geodatabase where backups are stored with a date in the name that gives the backupdate, BU_20230724, BU_20230731 etc. How can I select that only the latest will be read for further analysis? Normally, a feature class is selected under Constraints > Tables and you can select the one you need but, the latest Backup will not stay the same during the year. In a automated proces I would like to select the one with the latest date without changing it manually.

260
wil
Contributor
bskim
Participant
bskimParticipant
asked in Transformers
How to handle when there are different custom properties for each IFC?

HI. Do I still have to manually input using the AttributeExposer transformer, like the answer to the question below? https://community.safe.com/s/question/0D54Q000080hcshSAA/problem-ifc-reading-user-attributes What should I do when a user-defined property exists for each IFC file in the way that the fmw file runs FME Application in the shell and operates? please answer about my question. Regards,Bongsup Kim​

300
bskim
Participant
G
gamze
asked in Transformers
Insert operation failed

Hi, I am trying to get CAD data into Smallworld GIS. I did get one dataset in, one layer from the Cad drawing into Smallworld. I tried it with another layer from CAD file and I got the message "insert operation failed" which resulted no data being inserted into Smallworld GIS. I am able to see all data in Universal Viewer so I am thinking that there must be something wrong with the writer. Is there anyone that can help me with this problem? Thank you gamze

220
tednorcott
Contributor
M
mbatinic
asked in Transformers
Issue with generating sequential numbers based on attribute values in FME

Hello,I am currently working with FME Desktop 2022 and I have encountered an issue while trying to generate sequential numbers in a column based on attribute values. I have two tables, "Dokumenti" and "KatOperat," and I need to create a connected table called "ListKatPlana." In the "ListKatPlana" table, I have two columns: "ID_KatOperat", "ID_List" and "creationDate".The challenge I'm facing is generating the values for the "ID_List" column based on the "Koliko" attribute in the "Dokumenti" table. The "Koliko" attribute represents the number of records that should be associated with each "ID_KatOperat." For example, if I have an "ID_KatOperat" of 2304 and the "Koliko" attribute is 9, I need to generate numbers from 1 to 9 in the "ID_List" column for that specific "ID_KatOperat."I have tried using an aggregator to separate th

3630
geomancer
Evangelist
mathiku
Supporter
mathikuSupporter
asked in Transformers
JSON - extract value by value

I am receiving a JSON file that's around 85 MB. The file contains a large around of elements in a single nesting. I want to extract a given value by looking at the neighbor key.  In the example below it could be that I want to extract the value "2.000" from the section where "field" has the value "Frontside heights interval".         "field" : "Frontside heights interval",         "value" : "2.000",Can this be done using the built in JSON transformers?{   "stackId" : "d9a5ba5e2a00407ca52b68f902e43393",   "departmentId" : "5f4adeebe93b46368e6451f8b43ba914",   "registrationPosition" : null,   "measurementPosition" : {      "longitude" : 9.6567316353411,      "latitude" : 56.30290238191994,      "height" : 29.993129805661738,      "accuracy" : 6.213567568298807   },   "stackNumber" : 0,   "polterId" : null,   "registrator" : null,   "surveyor" : "ipadreg@hdlogsystems.com",   "state" : "Measured",   "registrationDateTime" : "2023-08-18T07:33:01.735+00:00",   "measurementDateTime" : "2023-0

709
thijsknapen
Contributor
S
sigaldry
asked in Transformers
PointOnAreaOverlayer, selecting attributes from user parameter

Hi, I have features about vegetation observations with many attributes like Date, ObservationId, Latitude, Longitude, IdTaxon and IdTaxCompl.I did the following workflow obtaining successful results: 1) buffer features to a specific distance; 2) Dissolve buffered features grouped by IdTaxon (obtaining what I call "stations"); 3) Renamed IdTaxon to sIdTaxon on the Dissolver resultant table; 4) Add a UniqueID for each station; 5) using a combination of PointOnAreaOverlayer, ListExploder and TestFilter I manage to join the corresponding StationId to the original observations table. To do this I set up PointOnAreadOverlayer to produce a list On Output 'Point' with the selected attributes "_ulid" and "sIdTaxon". I need the exploded list because observations of one species may also intersect stations from other species (so my TestFilter select the overlayed data using the condition "IdTaxon like sIdTaxon".My problem is that alternatively, I&#39

160
S

Badge Winners

  • Teacher (Bronze)
    probert1968has earned the badge Teacher (Bronze)
  • Webinar Watcher (Grey)
    arxit_cbuhas earned the badge Webinar Watcher (Grey)
  • German Speaker
    janakhas earned the badge German Speaker
  • English Speaker
    janakhas earned the badge English Speaker
  • Welcome Back
    arxit_cbuhas earned the badge Welcome Back
Show all badges

Community Stats

31,818
Posts
120,851
Replies
39,446
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.