Skip to main content

FME Form

A space to discuss FME Form

10000 Posts
enrico.artini
Participant
enrico.artiniParticipant
asked in Authoring
Copying files to two different destination folders

Hello I would like to copy files contained in an input folder to two different destination folders using filecopy writer, but I can't set two different destination paths.Do you have any suggestions?Thanks a lot in advance Enrico

414
enrico.artini
Participant
aguan
Contributor
aguanContributor
asked in Transformers
Is there a way to extract coordinate system from datasets to be standard ESRI coordinate system names?

I am using the CoordinateSystemExtractor to extract CRS from shape files. The output attribute _coordsys is an abbreviated name and hard to make use of it downstream. For example. the shape file prj file has the name “NAD_1927_BLM_Zone_15N”, which is an ESRI standard name. But the _coordsys value is _NAD27.BLM-15N.ft_0. I would hope the output is NAD_1927_BLM_Zone_15N so that I can use it directly in EsriReprojector. Any idea to achieve this? I have an excel file with over 150 global CRSs that need to reprojected to WGS 84. Both the sources and transformations in this excel file use standard ESRI names. Want to use this excel file to reproject all source datasets (shape files) into WGS 84 using just one EsriReprojector for which both the source and destination CRS parameters are set directly from the excel file. If you know a solution, please send reply to my work email - allen.guan@woodside.com. Appreciate the help.

264
ebygomm
Influencer
williamlin98
Contributor
williamlin98Contributor
asked in Transformers
Workspace process just stopping at 19%

I’ve been trying to process IFC data and convert it into a GDB format, however when running it will just stop processing at 19%. The workspace as worked with other IFC datasets but with a few of them it will stop at random arbitrary percentages too. Has anyone run into this issue before and is there a solution?

91
danilo_fme
Evangelist
fme_junior
Contributor
fme_juniorContributor
asked in Data
Summing the population data from several rasters for overlapping polygons

I have two layers: one raster with population data for each cell (blue) overlapping polygons (buffer of 100m) around existing road segments (red) I would like to know the total population contains in each polygon. How do I do this in FME?

142
danilo_fme
Evangelist
geovision
Contributor
geovisionContributor
asked in Data
Create one dataset from three

I have three datasets containing points which I want to bring down to one complete set. Dataset A contains most of the points but not very accurate in terms of location Dataset B contains less points but is more accurate then dataset A Dataset C contains the least points but is the most accurate of all three sets. So I am looking to create something like the following: When there are three points (dataset A, B and C) within one meter of each other merge the A and B with the point from C. When there are two points, for example dataset A and C, merge the point from dataset A with the one from C. And so on.. A way of ranking I would say. Now I have tried using the NeighborhoodAggregator but I cannot specify which point I want to merge which point. I have also looked at the NeighborFinder but I cannot seem to get that working either. Is it possible to have all three datasets analyzed together? Or do I have to do two at a time?

182
max_h
Contributor
moustik
Contributor
moustikContributor
asked in Transformers
SQLExecutor in FME2024.1 doesn't show Geometry of PostGIS raster, in contrary with FME2023.1

Hello, I am currently working with some database PostGIS rasters and wanted to import some into FME 2024.1, using a filter to only select 2 out of 11030.To do so, I tried both a SQL Executor and a FeatureReader (as both enables PostGIS raster reading).The SQL Executor filters the rasters correctly but doesn’t create the geometry and returns an error in the log file.The FeatureReader loads the 11030 rasters without filtering, suggesting a problem with the “WHERE clause”. I tried the same thing using FME 2023.1 and the SQL Executor is working under this version. I am wondering if there is a bug in the FME 2024.1 version.The problem was the same for the Feature Reader.A colleague said that the Feature Reader outputs everything as well in previous versions of FME (2022.2 and 2021.1). Do you know when the FME 2024.1 bug will be corrected?We are linking our work with ArcPro and we know we will have to use FME 2024. I am enclosing a share folder with the different logs (as txt) and the 2 work

25514
saraatsafe
Safer
langley.select
Contributor
langley.selectContributor
asked in Transformers
Workspace temp files management

I have a workspace that is moving 18million records between databases. Part of the translation involves updating geometry and reprojecting. I am running the workspace WITHOUT the option to cache features; however the GeometryReplacer transformer seems to be writing quite a bit of data to memory (expected) and that is not purged (reading 100k features at a time). Because it’s not cleaning up itself, the workspace is just erroring out because it’s running out of disk space. I can stop the translation and update the start feature number to continue, but this is cumbersome. Any ideas how to fix this so I can run this unattended?

9716
nielsgerrits
VIP
andrej
Contributor
andrejContributor
posted in Transformers
TesseratCaller partially broken - potential fix

Hi, The TesseractCaller appears to be partially broken at the moment. It sometimes doesn’t return all words from the OCR process and the results aren’t transformed correctly to fit on the page. I suspect that this is the results from Tesseract having been updated since the release of the transformer. See the images below as documentation. Where the existing TesseractCaller produces 38 word results from my input image and the fix produces 81. (This difference is the result of a listexploder rejecting features not containing a list, so nothing has been changed about how FME interacts with Tesseract) The results are also correctly flipped and scaled in FME to match the input image. I have supplied the fixed transformer as a zip to this post. Differences: Before, text is missing, scaled incorrectly and flipped from the image After, all text is included and correctly aligned with the image

81
hkingsbury
Celebrity
fmejohn93
Participant
fmejohn93Participant
asked in Integration
Unable to connect to IBM DB2

Unable to connect to IBM DB2 in FME form 2024.2. I’ve checked with other members of my organizations’ logins and those work fine on my machine; it’s just this particular user that is having issues. Please see attached screenshots

290
fmejohn93
Participant
fme_junior
Contributor
fme_juniorContributor
asked in Authoring
Spatial filter with overlapping polygons

I merged a population raster with polygons (buffer) to find out how many inhabitants live in each polygone (buffer). I used the spatial filter for this operation and the results are mostly satisfying. There is one case when the results seem to be wrong : that is when I have overlapping polygons. In that case, each population raster in only use for one polygon. Which setting should I change to make sure that the entire population raster is checked for each polygon (buffer) in order to have the correct value for population?

161
takashi
Supporter
geckosolutions
Contributor
geckosolutionsContributor
asked in Data
FME Ingesting AGOL json

Hi Everyone, I have this “open” dataset provided by the City of Toronto. I am using a few from the city that are provided in this manner. The only way to bring it into ArcPro and then extract it to a geodatabase is to use the json address and add by url, then use the ‘feature to point’ geoprocessing tool to extract the data to points in gdb format, then use as needed. I need to get this layer into FME from the live feed so I can analyze it and then push it out via other format(s), one of which is AGOL feature layer. For some reason I have been unable to bring it into my FME script via any JSON reader or HTTP caller and I’m wondering if anyone else here will have more luck. The link I am working with is as follows: https://gis.toronto.ca/arcgis/rest/services/cot_geospatial2/MapServer/64 The json link is: https://gis.toronto.ca/arcgis/rest/services/cot_geospatial2/MapServer/64?f=pjson If anyone has the steps to bring the content into FME (geometry and attributes) to have it available for

182
geckosolutions
Contributor
stlj
Contributor
stljContributor
asked in Authoring
Best way to update prefetch cache in stram processing

HiI work with stream processing and need to validate data in real time against a database using for example a database joiner. We have an MQ connector recieving large volumes of real time data. For best performance, I need to cache the dataset I am validating against, but the question is, what is the best way to update the cache? The data is updated in the database once per hour and there is 1.000.000 records in the table. A timewindow change can trigger cache update in Fme, but I can´t find out how to solve it, and what readers/transformers to use./Stefan *Edit, caption should be Stream processing….Cant edit.

130
stlj
Contributor
lifalin2016
Contributor
lifalin2016Contributor
asked in Transformers
2024.2 yields an error in SharepointOnlineConnector ?

Hi. I built a workspace in 2024.1, that fetches a number of files from a customer Sharepoint site. It works (in 2024.1) without problems. I just installed 2024.2, and ran the workspace (with no changes). Now it issues an error with a SyntaxWarning from the package “safe.microsoft-sharepoint”: C:\Users\xxx\AppData\Roaming\Safe Software\FME\Packages\24783-win64\python\safe.microsoft-sharepoint\stringcase.py:247: SyntaxWarning: invalid escape sequence '\W' return re.sub("\W+", "", string) Is this something that I should worry about ? SharepointOnlineConnector is not listed as an upgradable transformer in 2024.2 Cheers.

15316
sfb
Contributor
riplizard
Contributor
riplizardContributor
asked in Transformers
Transforming heights (Germany)

I need to transform XYZ data from the currently used DHHN2016 height (EPSG:7837) to the older DHHN12 height (EPSG:7699). Unfortunately, the various transforming options don't seem to be able to do this. E. g. EsriReprojector, with "Use Vertical Transformation" checked, only lists <None> as option under "Vertical Transformation". To complicate things further, the switch to DHHN2016 did not happen directly from DHHN12, but first to DHHN92. So the transformation might need to be done with an extra step: DHHN2016 height (EPSG:7837) -> DHHN92 height (EPSG:5783) -> DHHN12 height (EPSG:7699). However there is no option for this way either. Perhaps a combination is necessary? In this case it would be 25832+7837 to 31468+7699 (or 25832+7837 -> 31468+5783 -> 31468+7699). I added the Reproject files to the install directory but that had no effect. I also don't have "PROJReprojector" available for some reason(?). Version: Data Interoperability Fixed OEM LicenseFME(R) 2024.1.2.1 (20240920 - Build 2

280
riplizard
Contributor
Z
zacharylee1204
asked in Transformers
How do I create "points" and import to 3ds max

Hello Sir/ Madam, So I have a .txt file with Points Name, X, Y, Z. So I would like to create points and import in 3ds Max. My .txt table is as follow Point X Y Z A 822041.761 833958.234 13.519 B 821997.708 833954.943 16.341 I create points by using vertex creator transformer. Then I convert to .dxf and import to 3ds Max. It works fine. However, all the points are named "Point" in 3ds Max. Is there anyway that I can use the Point name "A", "B", etc instead of point? Other formats is fine, as long as I can get the coordinates and point name. Hope somebody can give me a hand. Thank you.

613
risamon
Participant
B
bramvr
asked in Data
Optimizing i3s (slpk) LOD

I'm converting 3D data from Postgres to an Esri Indexed 3D Scene Layer (slpk). I'm converting this to an i3s service on Azure (not ArcGIS Online). When loading this as an external layer in ArcGIS Online, the LOD seems totally random, buildings are being visualised but not the way I'd like to see (not based on distance). Is there a way of optimizing this in FME?

44415
vince_j
Contributor
G
gisgis
asked in Transformers
How can I read everything from File GDB except one feature type ?

I am reading some feature types from File GDB as "Single merged Feature Type". One of these feature types while reading is giving me an error saying "Read feature (or portion thereof if SPLIT_AT_ARCS is YES) from the feature class 'xxxyyy' that contains only zero length segments...." How can I read all feature types but ignore this one which is causing error or maybe any Idea how to solve the error problem ? p.s. In different Databases there can be different feature types thats why I am always reading everything but trying to exclude one which name is always the same. Any Idea ?

1797
gwn
Participant
javierml
Contributor
javiermlContributor
asked in Transformers
Custom Transformer - Input attribute values can't be exposed nor used on the prompt

Hello everyone I've been designing a new custom transformer to sum up part of my workflow (in FME Form 2025.0). The issue is that I can't add any of my attributes to the text editor even though all attributes are selected to be exposed in the input parametres. Moreso, If I edit it individually, no attributes appear (as obvious), but if I edit them inside a workbench session and I choose specific attributes to expose, they are still not availaible in the text editor, but they get instead automatically added as user parametres for the custom transformer. Can anyone explain me how this works? I don't get a clear answer from looking at https://docs.safe.com/fme/2025.0/html/FME-Form-Documentation/FME-Form/Workbench/Using_Custom_Transformers.htm#Editing_Input_Output_Ports It also irritates me that it’s theoretically a copy of another transformer with a couple of changes (only adding transformers or changing their parametres, none with the inputs) and that transformer allows to add feature at

692
javierml
Contributor
jakethepainter
Contributor
jakethepainterContributor
asked in Data
Error reading KML: Could not determine the root kml file of

I'm trying to read some USFS wildland fire data. There's a link to the kml on their website: http://www.wfas.net/google-earth/wfas_nfdr.kmz When I use the url in the kml reader, it downloads it to a temp file location successfully (I can see it there) and it's unzipped. It's got a folder structure about 5 deep. Then I get FATAL |KML: Could not determine the root kml file of `C:\\Users\\xxx\\AppData\\Local\\Temp\\FME_OGCKML_KMZ_1562607566639_14376' If I go to the temp file location and navigate down to the kml, I can read it in no problem. C:\\Users\\xxx\\AppData\\Local\\Temp\\FME_OGCKML_KMZ_1562607566639_14376\\fsfiles\\office\\wfas2\\dir-obs\\wfas_nfdr.kml

287
deanhowell
Influencer
scarter
Contributor
scarterContributor
asked in Integration
Connecting to a live table in Microsoft Dataverse with FME Form

Hello Forum, I need to pull in a live Microsoft Dataverse data table using FME. The table contains coordinate pairs. I want to pull this out to create one useable polygon geojson file. Here’s a screenshot of the Dataverse table... Can I create a connection into Dataverse in FME Form? What kind of values do I need to present to FME Form (from Dataverse) to make it work? Do I need any particular permissions opened up on the Dataverse, or FME side? Thanks, Stuart

111
hkingsbury
Celebrity
philiqq
Contributor
philiqqContributor
asked in Transformers
Error when using GoogleCloudStorageConnector on MacOS

Since the last update of the GoogleCloudStorageConnector (on 26.03.2025, safe.google-cloud-storage [2.5.0]), it no longer works.I always get this error message: Message Type: fme::internal::_v0::py::Exception Python Exception <TypeError>: JSONConnection.api_request() got an unexpected keyword argument 'extra_api_info' Error encountered while calling method `input' GoogleCloudStorageConnector_CALLER (PythonFactory): PythonFactory failed to process feature I am using FME 2025.0.0 with Python 3.13 on a macOS Sequoia (15.3.2).Except of the transformer update nothing has been changed.The error does not appear on Wondows with the same FME settings.

193
jbradfor
Contributor
mr_fme
Enthusiast
mr_fmeEnthusiast
asked in Transformers
remove duplicates values from Excel

Hi, I have one column in my excel file that show tha values like below: VARIEDADE ABB4, ABB2, ABB4, ABB5 ABB4 ABB2, ABB5 ABB2, ABB2 ABB4, ABB4, ABB4, ABB4 The two last lines have the same value separated by comma. I would like to simplify like below: ABB2 ABB4 How Can I do this? Thank´s

393
devbyisty
3d_ff
Contributor
3d_ffContributor
asked in Transformers
FME Python Script for Automated DDH Desurveying (Minimum Curvature, Flexible Intervals)

​@daveatsafe Dear FME Community, I am seeking assistance in developing a Python script for use within an FME workspace to automate the desurveying of diamond drill holes (DDH) using the minimum curvature method. I aim to create a flexible solution that allows users to specify a custom desurvey interval (e.g., 1m, 3m, etc.). Background: Desurveying a drill hole involves calculating the actual XYZ coordinates along its length based on the collar location and survey data (azimuth and dip at regular downhole distances). I've researched existing methods and found the following resources helpful: Understanding Drillhole De-surveying: https://seequent.zendesk.com/hc/en-us/articles/360001547955-Understanding-drillhole-de-surveying Desurveying Methods and Interactive Tool: https://endarthur.github.io/writting/desurvey.html Drillhole Desurveying Python Code (GitHub): https://github.com/WilliamsB39/Drillhole-Desurveying QGIS Geoscience Plugin: https://www.spatialintegration.com/processing-drill-h

303
3d_ff
Contributor
koen
Contributor
koenContributor
asked in Integration
FeatureReader failes to retrieve featuretypes from ArcGIS Portal Service

We just a installed a new ArcGIS Enterprise (11.4) environment and want to connect to it with FME 2024.2 I successfully configured a Web Connection to the ArcGIS Portal using this guide. When I try retrieve Features Services from Portal this takes very long (4min) and eventually I get the an "Error Retrieving Selections” as below I tried connecting to https://mydomain/portal/sharing/rest/portals/self directly with an HttpCaller and the same Web Connection and that gives a good response✅. So my web connection is able to connect to ArcGIS Portal successfully. Just not with the FeatureReader. And also not with a traditional reader. Any ideas on how to solve this?

638
koen
Contributor
creinier
Contributor
creinierContributor
asked in Data
Data sources in an ArcGIS project (aprx)

I’m working on a data inventory project and need to figure out what data sources are being used in a large number of aprx’s. Is there a way to determine the data sources of an ArcGIS project by directing a workbench to an aprx file path?

233
creinier
Contributor

Helpful Members This Week

Badge Winners

  • Socializer (Ice Breaker)
    colejo02has earned the badge Socializer (Ice Breaker)
  • Conversationalist
    colejo02has earned the badge Conversationalist
  • Teacher (Grey)
    sveouuhas earned the badge Teacher (Grey)
  • Student (Grey)
    geovisionhas earned the badge Student (Grey)
  • Teacher (Bronze)
    geovisionhas earned the badge Teacher (Bronze)
Show all badges

Popular Tags

Community Stats

31,046
Posts
117,705
Replies
38,824
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.