Skip to main content

Transformers

Using transformers to modify data.

  • 12,871 Posts
  • 51,400 Replies
10000 Posts
amber369
Contributor
amber369Contributor
asked in Transformers
Print HTTPCaller

Hi, First off, excuse my ignorance in this question - im a beginner. Please let me know if any additional details would be helpful. I am using the HTTPCaller transformer to run a print POST from an AGOL app (Experience Builder). I’m able to successfully run the HTTPCaller and pull the response_body containing the output pdf URL. Id like to now run another transformer to download that pdf locally. Any suggestions on the next transformer to achieve this? An example of the URL: https://utility.arcgisonline.com/arcgis/rest/directories/arcgisoutput/Utilities/PrintingTools_GPServer/_ags_mapfile_name_hear.pdf Much thanks!

263
amber369
Contributor
icemanserna
Participant
icemansernaParticipant
asked in Transformers
Custom Transformer - API Request with http caller in a loop, does not exist on time

Im fairly new to FME, I have a programming background, and I was hoping to bring those skill here, but i can see is not fully the same. So I apologize before hand 😂 I have a custom transformer that does a API calls and loops until it finds “last-batch” set to true from the Header area. For Reference Here is the custom transformer: The first call uses uses the InitialHTTPCaller, which uses the the request url and access token from the main workbench. Here is a screen cap: The _response_header list will have the variables I need to determine if the its the last-batch = true and the next batch url. The JSONFragmenter, is exposing the values for _response_header{5}.value,_response_header{6}.value. I have a tester that checks if _response_header(5) is true to go the pass else it will fail and will go to Output and call upon the Loop to the NextPage. When the NextHTTPCaller gets called it will be using the User Parameter named NextUrl of which im setting it with the @Value(_response_header{

241
icemanserna
Participant
johnt
Contributor
johntContributor
asked in Transformers
Dynamically setting "Columns" on UPSERT in FeatureWriter to PostgreSQL

Hi, I have a dynamic workspace where I am reading in multiple csv update files for multiple feature types to upsert into our database. I had set the primary key dynamically dependent on the target table in the database. I cannot set a where clause on an UPSERT (which I do use with other feature types that have the ability to do I, U, or D) so went to use the "Row Selection: Columns:" section instead. This parameter does not work in the normal way with attributes. It presumes the selected attribute is the primary key field (no orange left arrow in front of the name), rather than using the value. I tried manually adding @Value(primary_key) (the attribute that stores the primary key column name) in the parameter but the feature writer also presumes it is literal and obviously can't find a column called "@Value(primary_key)" and errors. This is something that I would like to do, and is very much a part of a dynamic workflow. Otherwise I will have to create one dynamic feature writer for ea

2473
evieatsafe
Safer
pabloolivaresm
Supporter
pabloolivaresmSupporter
asked in Transformers
Neighborfinder multiple candidates and calculate average distance

Hi, I need to find the average distance of 25 nearest neighbours in a point layer. I have tried with Neighborfinder set to 25 number of neighbours to find and generate a list, then a ListExploder to expose the list, but I don't know how to group the 25 neighbours to calculate the average distance of these 25 neighbours to the base point Im gettin this of ListExploder: idRecord it’s the ID of points. Any ideas for grouping the 25 neighbours to calculate the average distance? Thanks you all.

373
geomancer
Evangelist
beau
Contributor
beauContributor
asked in Transformers
Get an export of the completed jobs in FME Server

Hi guys! I'm trying to export a list of the completed jobs using the FME Rest API, but I can't seem to get it done. What I want is basically a list of all the completed jobs, including the start time, end time, job id, engine, workspace name etc. For this, I'm using FME Form, a creator connected to a http-caller. Used the following Request URL: /fmerest/v3/jobs/completed?status=SUCCESS/fmerest/v3/jobs/completed And a few others.I got two headers, one with the token and one with the content type. The errors are being returned:{"message":"null for uri….} Does anyone know a solution for this?

252
beau
Contributor
theandroidbell
Contributor
theandroidbellContributor
asked in Transformers
I'm trying to use RasterClipOverlay to extract an area on GeoTIFF defined by a polygon. FME is currently giving me the incorrect area.

I'm trying to use RasterClipOverlay to extract an area on GeoTIFF defined by a polygon. FME is currently giving me the incorrect area. The Workspace: The workspace has a polygon coming from a POSTGIS layer which is filtered. It also has an GeoTIFF both of which are inputs to the RasterClipOverlay. The results are output to a GEOTIFF. As a test I have also added a simple output image that does not come from the RasterClipOverlay. Both the polygon and image are in the same projection EPSG:3395. The original image (displayed in QGIS): The polygon (in QGIS): The results: Displayed in QGIS with Open Street Map behind and the polygon overlaid.​​​​As you see from the results, the area of the map is not correctly extracted. The polygon is supposed to cut out the sea, however, it also cuts the map boundaries and part of the land. The shape of the cut is correct however the map is “shrunk” hence the area of the map is incorrect. This is just one example, I have various other maps I’m working wit

578
geomancer
Evangelist
justinweaver
Contributor
justinweaverContributor
asked in Transformers
Is there a way to see the HTTPCALLER Post without it sending?

Im wanting to see the http it’s generating so i can understand where its going wrong. Is there a way to see this - without it being submitted? Or even if it’s being submitted? Im sure im missing something. JKW

293
nielsgerrits
VIP
lance
Contributor
lanceContributor
asked in Transformers
Excel Reader - Incorrect String Length

I am using FME Form 2024.0 to read an excel file for processing. The reader is not determining the correct max length of multiple text fields in the XLSX file. I have set the max rows to scan to a value larger than the total row but short of manually setting these values I cannot get the reader to detect the correct field length. The FME Help for the MS Excel Reader states to leave this setting blank to scan all rows but the transformer will not except a blank value. I also tried to use the FeatureReader rather than a standard Excel Reader with the same results. I want this to be dynamic as the data being read is variable. Any suggestions or workarounds?

592
justinweaver
Contributor
ohashkii
Contributor
ohashkiiContributor
asked in Transformers
GDB feature class reader as published parameter

Hi, How can create a published reader parameter for gdb feature classes? The gdb conation Point, line Polygon feature

203
crutledge
Enthusiast
g_tz
Contributor
g_tzContributor
asked in Transformers
Read AEC Objects (Geometries and Attributes) in FME

I am working on feature and attribute extraction from an AutoCAD Architectural file, namely the extraction of room polygons and their attributes from AEC blocks that represent rooms. I have tried the Civil 3D reader and the reader actually sees the layer with the room AEC blocks and it shows me the available attributes correctly, alas the reader does not return any features. There are no errors, only a lot of warnings about attribute renaming because of scpecial characters. Has anyone ever succeeded in reading AEC block features and attributes? If so, how did you do it?

161
emmaatsafe
Safer
lifalin2016
Contributor
lifalin2016Contributor
asked in Transformers
Using HttpCaller with custom SSL client certificate - doesn't work !?

Apparently this feature was finally introduced 5 months ago, yay. I’ve been waiting for this for 5 years. I’ve just tested it today, with a PKCS#12 certificate, and unfortunately it doesn’t work. We’ve sofar been using our own C# service provider for this, and the certificate is used here on a daily basis with success. And I’ve verified the private key password. Has anyone tried this feature (with PKCS#12) yet with success ? Using 2024.2.3 (build 24825). Cheers.

271
lifalin2016
Contributor
sujitbhunia
Contributor
sujitbhuniaContributor
asked in Transformers
Hi, I am having a problem where LAZ is not being read.

Reading laz from Local / Network drive throws error: LAS reader: Failed to open file for reading. Please ensure that the file exists and you have sufficient privileges to read it. Any ideas why this happens?

879
donalmateer
Safer
model_art
Contributor
model_artContributor
asked in Transformers
Convert polyhedralsurfacez from postgis to cesium 3d tiles along with all the attributes of the polyhedralsurfaces

How to convert polyhedralsurfaces(voxels) stored in database with addtional attributes stored in columns into cesium 3dtiles?Additionaly to export the data in a suitable format to view voxel and its attributes?

150
model_art
Contributor
xproch40
Contributor
xproch40Contributor
asked in Transformers
Qgis in FME calling pythoncaller

Hey, I’ve been trying to get FME (Feature Manipulation Engine) by Safe Software to use Python libraries from QGIS (like qgis.core) so I can mix their cool features in my temp.fmw workspace. The idea is to use QGIS’s Python (version 3.9) inside FME by setting it up with PowerShell commands. But it’s not working, and here’s why, explained like I’m talking to a 5-year-old and then a bit more grown-up: The Toy Box Story (Simple Version) Imagine Python is a kid who needs toy helpers to do jobs—like QGIS toys (for maps) and FME toys (for data tricks). These toys are called DLLs (little helper files). I want Python to borrow toys from both QGIS’s toy box and FME’s toy box at the same time. Step 1: I told Python, “Look in QGIS’s box (C:\Program Files\QGIS 3.32.0\apps\Python39) and FME’s box (C:\Program Files\FME\python)!” That’s like setting PYTHONHOME and PYTHONPATH.Step 2: Python found some QGIS toys (like qgis.core), but then it yelled, “Where’s my Qt5Core.dll toy? I can’t play!” It’s like

513
AliAtSafe
Safer
aditi21698
Participant
aditi21698Participant
asked in Transformers
AreaCalculator calculating different areas for the same feature

Hi all, I have a workspace that preps all input features by reprojecting them to GDA94/ Australian Albers and then calculates input area. When I run the same feature (as a shapefile, but different different coordinate systems) I get different Area values even though they’re both in the same Coordinate System. I ended up testing the features with an AreaOnAreaOverlayer and turns of there’s really tiny slivers across the boundary of the feature (I don’t know where these slivers are coming from?). I added both the shapefiles in ArcGIS Pro and followed the same process- reproject and calculate area and both area values are coming out as the same in Pro. I am unable to figure out why I’m getting this difference in areas in FME but not ArcGIS Pro. The difference is tiny but ends up changing the final stats. Screenshots attached. Any help would be greatly appreciated.

456
j.m-visma
Contributor
tb09114
Supporter
tb09114Supporter
asked in Transformers
FeatureMerger and FeatureJoiner do not match visually identical values

I need to use FeatureMerger or FeatureJoiner based on two varchar(200) attributes. Visually those values do match. No white spaces trailing anywhere, the strings are the same, yet neither FeatureMerger nor FeatureJoiner are able to combine the data. settings for FeatureJoiner As an example from the the Feature Information pane right attribute to join on left attribute to join on The join/merge is supposed to happen within a custom transformer, but I also tried it in the main workflow, where I received the same results. FeatureMerger is in version 21, and FeatureJoiner is in version 1001. Any suggestion on how I can identify the culprit and get these features to join/merge?

798
tb09114
Supporter
galigis
Enthusiast
galigisEnthusiast
asked in Transformers
Linear Referencing Speed along line / Event CSV and Line Geometry

Hi All, I have been trying to put a workflow together to linear referencing a few event tables in GIS. I usually do the task in ArcGIS but this time I want to automate the process as much I can. I have been checking a few of the LRS FME tutorials online but can’t get it to work. The aim is to linear referencing speeds along a railway route (line) using an event table that relates the lines and speeds. The input of my workflow as follows: Event table (xls) that shows the Line and speeds, example below: Line geometry with the line ID as well the ‘From_Chain’ and ‘To_Chain’ fields as parts of the attribute I have got to this point in the automation but can’t get the Snipper to work for some reason since doesn’t split the lines according to the speed lengths: Any advise how to accomplish the task? Thanks

242
galigis
Enthusiast
ebygomm
Influencer
ebygommInfluencer
asked in Transformers
ArcSDE FeatureReader - Workspace succeeds even when there is an error

FeatureReader setup with a parameterized connection. If an incorrect connection is selected, the errors are reported “The error number from ArcObjects is: '-2147216100'. The error message from ArcObjects is: {Insufficient permissions” But the workspace doesn’t terminate and nothing exits the rejected port of the FeatureReader. Rejected Feature Handling is set to Terminate Translation. I would expect the workspace to fail/and or output from the rejected port on this sort of error FME 2024.1 (Form & Flow)

120
ebygomm
Influencer
danilo_fme
Evangelist
danilo_fmeEvangelist
asked in Transformers
Set attribute JSON with Python

Hello all, I have a Workspace that makes the reverse geocoding using PythonCaller. import fme import fmeobjects import json ,urllib2 # def processFeature(feature): att = urllib2.urlopen('http://maps.googleapis.com/maps/api/geocode/json?latlng=-23.2186725,-45.9056706') data = json.load(att) print "o json é ", data When i run my workspace i see the results on the log file because i put the Print: How can i get this result with a new attribute? Thanks in Advance, Danilo de Lima

1325
gedgg
Contributor
evagardner
Contributor
evagardner
asked in Transformers
Directory and File Pathnames

Hi, I just upgraded FME Form and FME Flow from 2024.0 to 2024.2.3. One of my jobs failed using a FeatureReader with the Directory and File Pathnames due to the extension not being in all caps because the extension on the file it’s looking for is in all caps (.CSV). Originally the parameter was set to filename.csv and the FeatureReader would have no issues finding the file on 2024.0. Now the FeatureReader is not able to find the file in 2024.2.3. I changed the parameter to all caps .CSV in the featureReader and it finds the file with no issue. Anyone else noticing this with 2024.2.3?

723
ebygomm
Influencer
calvin.fme
Contributor
calvin.fmeContributor
asked in Transformers
Count the Number of Responses

Hi All, I have a survey asking participants to rank their favourite colours—Red, Blue, and Green—in numerical order (1, 2, 3). I want to use the results to create a workflow that counts how many times each colour has been picked based on the ranking. Here is some example data. Sample Data Unique_ID Colour Rank 1 Red 3 1 Blue 2 1 Green 1 2 Red 1 2 Blue 2 2 Green 3 3 Red 1 3 Blue 2 3 Green 3 What I am trying to achieve Colour Rank_ 1_Count Rank_2_Count Rank _3_Count Red 2 0 1 Blue 0 3 0 Green 1 0 2

866
geomancer
Evangelist
howeitzor
Contributor
howeitzorContributor
asked in Transformers
Issues with feature reader execution order

I have a feature reader that’s reading an Oracle non-spatial database. I have a workbench that writes all of the read tables to a file geodatabase. Some tables, I process twice; one where just the flat table is written, and another where the coordinate attributes in the table are used to create a point feature class written to the same file geodatabase. For some reason, only the flat tables are being written and none of the point feature classes are being created. Both work if I run them separately but not if I have two coming out of the same reader port. I’ve hidden the lines to write the flat tables to the feature writer. Is there a setting in the feature reader that I need to change to ensure it processes multiple outputs for each feature?

171
howeitzor
Contributor
brad
Contributor
bradContributor
asked in Transformers
Error writing to Temp GeoDatabase using Arcpy via Python Caller

Hello there, I am trying to execute some Python using the ArcPy module in a workbench base on this Tutorial, Using Arcpy for FME Feature Processing, but I am getting this error the following error: Geodatabase Error (-2147220970): Cannot acquire a schema lock because of an existing lock.Could not open File Geodatabase dataset `C:\Users\’USERNAME’\AppData\Local\Temp\wbrun_1740499345598_2444\fmetmp_24\1740665793794_2528_d\tor470\temp.gdb' for readingFailed to obtain any schemas from reader 'FILEGDB' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information It the issue seems to be the GeoDatabase is still “open” in memory, but my Google Fu has failed to come up with a fix

272
j.botterill
Influencer
sami26beniaouf
Contributor
sami26beniaoufContributor
asked in Transformers
Increment from a starting value until reaching another value

Hello FME Experts, I am working on processing a point cloud and need to create height-based sections to later filter the point cloud accordingly. Here is my goal: Extract the minimum and maximum height of the point cloud (already done). Create sections every 1m, starting from the minimum height up to the maximum height. For each section, create a buffer of ±0.5m (so each section spans 1m). Finally, filter the point cloud to extract the slices based on these buffers. My idea is to extract the Bounding box of the pointcloud, extrude it 0.5m lower, and then slice it starting from bottom every 1m until reaching zmax, and use them with Clipper. How can i slice this bounding box? I thought about creating a new attribut Number of slices = zmax - zmin and then use it as increment? or is there a simpler solution? Thank you for your help

342
sami26beniaouf
Contributor
deanhowell
Influencer
deanhowellInfluencer
asked in Transformers
Writing to File Name created from multiple attributes

I am trying to write out to a DWG from multiple inputs and need the output file name to be a combination of variables i.e. Extract_@Value(lot_number)_@Value(survey_type)@Value(survey_number)_@Trim($(_extractCoordinateSystem),EPSG:)_@DateTimeFormat(@DateTimeNow(), %Y%m%d).dwg The variable creates fine using a variable setter But when I try to run the writer it fails. It appears it is trying to write the file multiple time and fails to overwrite Any ideas on how I could set the variable file name better?

403
deanhowell
Influencer

Most helpful members this week

Badge winners

  • FME Form Advanced Training
    a.hamannhas earned the badge FME Form Advanced Training
  • Welcome Back
    kangursirlehas earned the badge Welcome Back
  • Teacher (Grey)
    icemansernahas earned the badge Teacher (Grey)
  • Student (Grey)
    jferrerhas earned the badge Student (Grey)
  • Welcome Back
    mapianhas earned the badge Welcome Back
Show all badges
30,853
Posts

Popular tags

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.