Skip to main content

FME Flow

A space to discuss FME Flow

2451 Posts
iamprem
Contributor
iampremContributor
asked in Automation
How to verify if all the workbenches in an automation for a particular run/trigger are successful?

Problem Statement: I need to verify if all the workbenches in an automation for a particular run/trigger are successful. There can be multiple runs/triggers in a day, and the number of triggers per day is unknown. Things I Have Tried: When I attempt to retrieve relevant data from the FME Flow PostgreSQL database, I can't find a unique identifier for each run/trigger of an automation. I can see an event_id in web interface, but unable to find that in the postgres database.

517
iamprem
Contributor
erik.ahlm
Participant
erik.ahlmParticipant
asked in Automation
Geometry User Parameter: Configuration for Geometry Types are missing in FME Flow automations

Hi, For user parameter Geometry in FME Form, you can configure what type of “selecting geometry” to allow under the GeoJSON Configuration > Geometry Types (Point, Box, Line, Polygon). But when I publish the workspace to FME Flow and set up the user parameters in Automations, the configuration for Geometry Types is missing for the Geometry User parameter. For my example, I want only Point as a valid Geometry type for the Geometry user parameter. I publish the workspace to FME Flow with these settings and create an automation app with the same user parameters, but when I run the app the user can choose between all geometry types (Point, Box, Line, Polygon).

102
crutledge
Enthusiast
worjak
Contributor
worjakContributor
asked in Deployment
Restore after install failed!

Hi, We are following this instruction Upgrading In Place, On the Same Machine and failing in the last step. what could be wrong? We are upgrading from FME flow 2023.1 to 2024.2 So what about that file: Migration) File "/temp/tomcat/fde0b0779317417da467e76dec4c9027/restServerRestore.fsconfig" does not exist for shared resource "FME_SHAREDRESOURCE_SYSTEM".

463
steveatsafe
Safer
N
niches
asked in Automation
Use HTTPCaller to download file, to use in my workflow

I want to create a workflow that downloads a file from the internet (SHP file compressed as ZIP file). That file should then be used in my workflow for further analysis and processing. How should I set that up? I now have a "Creator", followed by a 'HTTPCaller'. This HTTPCaller downloads my ZIP file (contains a SHP file). How can I now use this data for further processing? When I use a ESRI SHP File Reader, I can't seem to send this file as an input to that Reader?

5359
hodsen96
Contributor
fjanson
Contributor
fjansonContributor
asked in Architecture
Workspace running on FME Server will not acquire an ArcGIS licence

We have an issue where a Workspace running on FME Server will not acquire an ArcGIS licence and we get the error message "Unable to perform any licensing related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator -> Workspace Parameters -> Translation. This 64-bit version of FME requires ArcGIS Desktop along with 64-bit Background Geoprocessing; ArcGIS Pro; or ArcGIS Enterprise. Refer to this this article http://fme.ly/qua for more details" It seems the issue is related to user accounts and licenses used to run FME and ArcGIS, but I'm having trouble understanding how to set this up. I have tried with ArcGIS PRO 3.0.3 with Single User Advanced license or Named User Advanced License, FME Server 2022.2 with services running as either domain user with Administrator access or as a local user who is member of the local Administrator group. The FME Server and FME desktop versions match, Esri ArcGIS Compatibility is set to ArcGIS Pro. Does anyone know wh

9669
australgis
Contributor
V
vannary_ubc
asked in Architecture
Error: A compatible ArcGIS application could not be found... when running workspaces with arcpy.

Hi, I have installed ArcGIS Pro 2.9 and FME Workbench 2022 on my computer. I have downloaded arcpy-example.fmw from the website, but I could not get it to run. I changed my setting, so that python compatibility is set to Esri ArcGIS Python 3.7+. I kept getting an ERROR: A compatible ArcGIS application could not be found or is not licensed for Python Compatibility 'Esri ArcGIS Python 3.7+' I am unsure whether I would need an extra step to connect my ArcGIS Pro license to FME. In addition, my ArcGIS Pro is not authorized to work offline. I was wondering whether this was an issue. In addition, inside my ArcGIS, the Data Interoperability extension is grayed out. Is this the reason why I could not use Arcpy in FME desktop? My ArcGIS licensing shows that data interoperability is licensed on my ArcGIS. Do I need to install ArcGIS Data interoperability for Pro for it works? Thank you

2336
australgis
Contributor
pragathjobs
Participant
pragathjobsParticipant
asked in Deployment
FME server 2020.2 failing with - "Unable to perform any licensing related tasks. This 64-bit version of FME requires 64-bit Background Geoprocessing, ArcGIS Pro or ArcGIS Server"

FME server 2020.2 failing with - "Unable to perform any licensing related tasks. This 64-bit version of FME requires 64-bit Background Geoprocessing, ArcGIS Pro or ArcGIS Server". There is already ArcGIS pro installed on same machine and the version of ArcGIS Pro is 2.6. Is ArcGIS server required for this?

255
crutledge
Enthusiast
joshmon
Participant
joshmonParticipant
asked in Automation
Flow jobs failing on python script using exportToPDF

I have several automated jobs that use either a startup or shutdown python script. These scripts run fine in workbench and even in the ESRI Python interpreter on the Flow machine. The issue arises when I run them from Flow. When it gets to the script it will output expected products until the exportToPDF command at which point it fails. No errors are indicated anywhere except in the Engine Log where this is displayed: WARN localhost_Engine2 393562 : Process "localhost_Engine2" ended unexpectedly. Being restarted on attempt 1… Example of script: import arcpy, os, sys, time, shutilfrom datetime import datetime sdpFolder = r"****OBSCURED****"exportFolder = os.path.join(sdpFolder, "SiteDevPlanFiles")date = time.strftime("%Y-%m-%d")dateFolder = os.path.join(exportFolder, date) archiveFolder = os.path.join(sdpFolder, "_Archive") zipExportFolder = exportFolder + ".zip" # from zipfile import ZipFile# for file in ZipFile(zipExportFolder).namelist(): # archive previous zip destZip = os.path.join

802
dylan.at.safe
Safer
pauldeq
Contributor
pauldeqContributor
asked in Automation
FME Flow Fanout Dataset Filename Issue

I built a workbench that creates 2 excel files with unique names that are created use the Fanout Dataset in the excel writers using a filename attribute that creates the unique file name. However, when I run workbench in FME Flow to set up the automation, it says it created it successfully, and the log seems to show that the files were created with the unique names, however, there are no files to open at all in the destination folder that I set up for it on FME Flow. Please help. Thank you! Pic of the fanout in the workbench. I have tried to add the log file to this post but it will not let me as the file type is “log” and for some reason the FME Forum system does not allow for those files to be uploaded.

284
crutledge
Enthusiast
william_sweco
Participant
william_swecoParticipant
asked in Automation
Upload project withFME Flow Rest API

I am trying to upload a project to FME Flow using REST API V3. The curl command is blank in the documentation. I have tried to configure a command based on the documentation and other (working) commands, but I have not had much success. Does anyone have an example of a working command to upload a .fsproject file?

202
william_sweco
Participant
dellerbeck
Contributor
dellerbeckContributor
asked in Automation
Automation Parameters are Resetting

If you have an existing automation and need to make a change, you make your changes and publish \\ overwrite in FME Forms. Once you go to the automation and stop it, all parameters are reset to defaults. This happens even to workspaces that were not updated. This has happened the last 2 or 3 releases, currently we are on FME Flow 2023.1 Build 23619 - win64

2357
ebygomm
Influencer
9val
Contributor
9valContributor
asked in Deployment
Best EC2 instance type for FME

Hi all, Could you please share your experience on what types of AWS EC2 instances you use for FME Flow and FME Form. I wonder if the M5 instance type is recommended since it is used for FME Flow Hosted. We mostly use “t3.large”. I understand that the choice depends on server load etc., but I would like to know the best practices. Thanks!

152
redgeographics
Celebrity
nielsgerrits
VIP
nielsgerritsVIP
asked in Architecture
Which version of FME Flow will support ArcGIS Enterprise 11.5

We are wondering which version of FME Flow will support ArcGIS Enterprise 11.5. Looking on the history in Notes on FME and Esri Versions and Compatibility I would guess it might be 2025.1?

483
hkingsbury
Celebrity
vxn43
Supporter
vxn43Supporter
asked in Automation
Change Automation Directory Watch Poll Interval

I am using FME Flow 2021.2. Is there a way to change the Directory Watch Poll Interval in an Automation to trigger only Monday through Friday, 8 a.m. to 5 p.m.?

121
hkingsbury
Celebrity
ebygomm
Influencer
ebygommInfluencer
asked in Automation
Automations Writer - multiple child jobs run against a single engine

If there is an automation where a workspace with an automations writer, triggers a child workspace a number of times is it possible to restrict those jobs to run on the same engine without the use of a queue? I want all child jobs triggered from the writer to run on the same engine as each other for a single automation run, but i don’t necessarily want to say that jobs can only be run on a single engine, as would be the case if I set up a queue.

151
hkingsbury
Celebrity
hlynur
Contributor
hlynurContributor
asked in Deployment
Flow's map based data distribution

Hello you all and perhaps especially ​@LizAtSafe Gone through this tutorial here: Using the Geometry Parameter – FME Support Center And this is of great help, just have one question that I cant figure out the answer to and that is if the selection map can be set as “Inline” by default instead of “Pop up”, as in that the users have the little imbedded selection map by default when accessing the tool? With regards,

132
hlynur
Contributor
vxn43
Supporter
vxn43Supporter
asked in Architecture
Which version of FME Form and FME Flow supports ArcGIS Enterprise 11.3?

Hello, I have FME Form and FME Flow 2021.2. Can I still use this version of FME with ArcGIS Enterprise 11.3? Is there a document outlining which versions of FME work with what versions of ArcGIS Enterprise?

111
crutledge
Enthusiast
emo10001
Contributor
emo10001Contributor
asked in Deployment
Questions about in place upgrade of FME Server 2022 to Flow 2024

We are currently running FME Server 2022.2. on prem (not cloud hosted). We had been planning on upgrading to the latest, but now even more so with the privilege escalation issue, and there apparently not being a fix for our version….except to upgrade. Looking over the “in place upgrade” portion of the documentation, it seems we can simply backup the configuration files (we’re not using version control yet), do an uninstall of 2022.2, do a fresh install of the latest 2024, and then restore the configuration backup. Are there any known issues with doing this from 2022 to 2024? I know the product was rebranded in 2023, but the differences I could see between 2022 and 2023 seemed mostly cosmetic for the rebrand. However, I know 2024 seems to be different. I just really want to dot all my i’s and cross all my t’s, and keep any down time to a minimum. And know if there are any “gotchas” that can be avoided. Thank you.

512
j.botterill
Influencer
apence231
Contributor
apence231Contributor
asked in Flow Hosted
FME Flow App - Geometry/Map picker Intermittently Not working

In my FME Flow app - I have a geometry/location picker option and sometimes the map is not centered right/doesn’t load correctly (notworking.png) but once a user refreshes the app a few times it goes back to working again (working.png). I’m on version 2022.1 of Flow Hosted and have the screenshots of what the different maps look like below.

91
j.botterill
Influencer
kirti2810kr
Participant
kirti2810krParticipant
asked in Flow Hosted
SQLCreator when used as a single transformer in a workbench file is unable to execute queries when run from FME Flow as a scheduled job

There is one workbench file that only has a SQLCreator within it that executes some update queries in the database tables for Oracle DB. This workbench was previously scheduled to run from FME server but we recently migrated our FME environment from FME Server (on-prem) to FME Flow 2023 (azure environment). We are seeing issues when this process is run from FME Flow , the SQL queries defined to be executed within the SQLCreator are not getting executed. However, when run from FME Form (2023) it is working fine. Can you please confirm if there is a known issue with SQLCreator from FME Flow. We have observed that when SQLCreator is replaced with Creator+SQLExecutor , the process seems to be working fine from both FME Form and FME Flow. Hence need confirmation to proceed with the change

292
kirti2810kr
Participant
michaelh
Contributor
michaelhContributor
asked in Deployment
FME Server/Flow HTTPCaller Fails with Web Connection but works on Desktop/Form

Hi! I could use a hand. I'm running an FME workspace that downloads data from ArcGIS Online using 4 HTTPCallers and a Web Connection. The workflow works fine in FME Form 2024, but when I publish and run it in FME Flow 2024.1, it fails. Setup: Using a Web Connection to authenticate (ArcGIS Online). The Web Connection exists in FME Server and is assigned to my user. The Web Connection is correctly assigned in FME Server. Does anyone have experience with this issue? Could it be related to permissions, token handling, or FME Server settings? Any suggestions would be greatly appreciated!

573
michaelh
Contributor
mgress
Contributor
mgressContributor
asked in Deployment
FME Flow 2024.2.3 Download

Where can we find the download for FME Flow and Form version 2024.2.3? I only see versions 2024.2.2 and 2025.0 in the list of available downloads. Thank you

442
danilo_fme
Evangelist
jnknnn
Contributor
jnknnnContributor
asked in Deployment
Oracle client libraries (e.g. oci.dll) could not be loaded in kubernetes installation of FME Flow

Build info: FME Flow 2024.2.3Build 24825 - linux-x64 running in Ubuntu 24.04.1 LTS AWS Kubernetes I have trouble installing oracle client correctly. We are using FME Flow in AWS Kubernetes with helm. I used this dockerfile to install oracle client to the engine pod (this worked in fmeserver 2021): FROM safesoftware/fmeflow-engine:2024.2.3USER root RUN apt-get update && apt-get install -y \ unzip \ libaio1t64 \ sqlite3 \ software-properties-common && \ apt-get clean && \ rm -rf /var/lib/apt/lists/* RUN mkdir -p /opt/oracle/instantclient_19_26COPY instantclient-basic-linux.x64-19.26.0.0.0dbru.zip /opt/oracle/WORKDIR /opt/oracleRUN unzip instantclient-basic-linux.x64-19.26.0.0.0dbru.zip ENV LD_LIBRARY_PATH=/opt/oracle/instantclient_19_26:$LD_LIBRARY_PATH RUN rm instantclient-basic-linux.x64-19.26.0.0.0dbru.zip COPY mod_spatialite.so /usr/local/lib/ RUN echo "LD_LIBRARY_PATH=/opt/oracle/instantclient_19_26:\$LD_LIBRARY_PATH" >> /etc/environment WORKDIR / USER fmeflow i used kubectl exec to

401
jnknnn
Contributor
curtisd54
Contributor
curtisd54Contributor
asked in Automation
using attribute value mapper - to map from multiple input attributes to a single output attribute

Hello, I am looking to use attribute value mapper ( or another transformer etc) to map from multiple input attributes (VEG_SBOIS) and (CLASSE) to a single output attribute (SURF_COVER) see below screenshots for example I have tried using a tester with left value filled in and operator “attribute has a value” but it doesnt work perfectly since im only looking to map certain input values (not all ) to different output values. any help is appreciated, thanks, Curtis

342
curtisd54
Contributor
carl.turner
Contributor
carl.turnerContributor
asked in Deployment
Parallel Processing - Worker Logs

We make use of parallel processing within FME Flow 2023.1. However we are struggling to de-bug issues that intermittently occur in the worker processes. I can see that, whilst running, each worker process has a log file, stored under the parent job log. However, this is deleted when the worker process closes, even if it fails. This makes it very difficult retrospectively diagnose any issues. In our FME Server 2021 instance, the worker logs are surfaced in the main job log once complete, which is fine, but I can’t identify any setting to control and replicate this behaviour. Does any one know of a config change that I can make, in FME Flow 2023, to retain these worker logs somehow?

362
luke.hicks
Safer

Most helpful members this week

Badge winners

  • FME Flow Authoring Training
    siobhanryanhas earned the badge FME Flow Authoring Training
  • FME Flow Authoring Training
    gavinparkhas earned the badge FME Flow Authoring Training
  • FME Flow Authoring Training
    rizwanahas earned the badge FME Flow Authoring Training
  • Welcome Back
    mmohammadihas earned the badge Welcome Back
  • FME Form Basic Training
    laylaborremanshas earned the badge FME Form Basic Training
Show all badges
30,845
Posts

Popular tags

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.