Skip to main content

FME Flow

A space to discuss FME Flow

2497 Posts
dellerbeck
Contributor
dellerbeckContributor
asked in Automation
Automation Parameters are Resetting

If you have an existing automation and need to make a change, you make your changes and publish \\ overwrite in FME Forms. Once you go to the automation and stop it, all parameters are reset to defaults. This happens even to workspaces that were not updated. This has happened the last 2 or 3 releases, currently we are on FME Flow 2023.1 Build 23619 - win64

3179
sdepriest
Contributor
keller
Contributor
kellerContributor
asked in Deployment
Using fme pathreader in fme flow apps

Maybe someone has experienced this before, i have been trying to make an workspace App in fme FLOW 2023, the goal is to make an app where the user can choose the source file. I have tried creating the App but it does not allow the user to choose the file location. does someone have an idea what i may be missing out? I am using the FME PATH reader. Thanks, Keller.

717
geomancer
Evangelist
joshuajames1979
Contributor
joshuajames1979Contributor
asked in Automation
Geometry Validator not repairing Self Intersection

I have a routine that extracts property boundaries from a web service and outputs to shp to be imported into our Property and Rating system. I do have a Geometry Validation process to repair geometries where they may self intersect or are corrupted, however there are two polygons that are not repairing, even though they pass the test. Both are like the below. The polygon doesn’t actually cross over itself. Rather, this is two separate vertices where the bottom section meets the top section, and it’s all one polygon. Is there a way to automatically fix these with FME as we can’t edit the original. My workaround is to have the tiniest buffer and dissolve so the vertices don’t touch which passes the validation test in our P&R import, but ideally we should have clean geometries. Any help appreciated. Regards, Josh

917
joshuajames1979
Contributor
joshuajames1979
Contributor
joshuajames1979Contributor
asked in Automation
FMW fails to run via Scheduled Task when Using Service Account

Hi there, I have a number of FME Workflows on our GIS server that successfully run via scheduled tasks and bat file. However this latest one I have created only runs under my account and not the service account. The difference between this and other workflows is that this one is connecting to web services (Vicmap as a Service). I have made sure the service account has full permissions on any folders it is writing to as well the FME Programs folder. We are currently on FME Workbench 2022 but will soon be upgrading to the latest license structure. Do I need to consider any other permissions when dealing with web services? Regards, Josh

426
crutledge
Enthusiast
awrob_
Contributor
awrob_Contributor
asked in Deployment
Microsoft Sharepoint Online (safe.microsft-sharepoint) Web Service - where is the 'Request Format' field?

I’m trying to replicate a user’s Web Service for Sharepoint Online. However, I don’t have the field called ‘Request Format’ within the ‘Retrieve Token Parameters’ section. Does anyone know why this would be missing for me but not for other users within the business? Other users

121
hkingsbury
Celebrity
joshmon
Contributor
joshmonContributor
asked in Automation
Flow jobs failing on python script using exportToPDF

I have several automated jobs that use either a startup or shutdown python script. These scripts run fine in workbench and even in the ESRI Python interpreter on the Flow machine. The issue arises when I run them from Flow. When it gets to the script it will output expected products until the exportToPDF command at which point it fails. No errors are indicated anywhere except in the Engine Log where this is displayed: WARN localhost_Engine2 393562 : Process "localhost_Engine2" ended unexpectedly. Being restarted on attempt 1… Example of script: import arcpy, os, sys, time, shutilfrom datetime import datetime sdpFolder = r"****OBSCURED****"exportFolder = os.path.join(sdpFolder, "SiteDevPlanFiles")date = time.strftime("%Y-%m-%d")dateFolder = os.path.join(exportFolder, date) archiveFolder = os.path.join(sdpFolder, "_Archive") zipExportFolder = exportFolder + ".zip" # from zipfile import ZipFile# for file in ZipFile(zipExportFolder).namelist(): # archive previous zip destZip = os.path.join

2018
joshmon
Contributor
helmoetz
Supporter
helmoetzSupporter
asked in Deployment
Comparison FME Flow silent install properties to FME Server

Hi, we are silent installing FME Flow for the first time. We used to install FME Server using a silent install script, which uses the next installation properties: FMESERVERHOSTNAMEINSTALLDIRFMESERVERSHAREDDATAPGDATAWEBSERVERHOSTNAMESERVLETPORTDATABASEPASSWORD In the new FME Flow silent install instructions, a different set of installation properties is used. I think the properties above compare to COREHOSTNAME (changed)INSTALLDIR (unchanged)FMEFLOWSHAREDDATA (changed)PGDATA (unchanged)EXTERNALHOSTNAME (changed)SERVLETPORT (unchanged)DATABASEPASSWORD (unchanged). My questions: Can this be confirmed? Would it be possible to get a link to the location where this is documented?

363
luke.hicks
Safer
wil
Contributor
wilContributor
asked in Automation
Flow 2024 Parameter assignment, integers not recognized

I am creating an Automations proces and when assigning the parameters to an integer field get the following message: Must be a whole number. Decimals are not supported. In the Automations first a csv is read for creating all sorts of parameters In here there are no decimals. In the workspace tm_data has the Type int16 In the Automations writer it is also defined as integer. But when assigning the parameters, I receive the error. This applies for all integers I use in this. This is a automations proces that I also build in Server 2021 and I didn't have this issue but in Flow 2024 I can't get any further because of this error. Is there something I do wrong or is this a bug?

201
wil
Contributor
afod
Contributor
afodContributor
asked in Automation
Cant access Download URL from automation

I am running an automation process that collects some data via a webhook ,does some processing then outputs some shapefiles. I am trying to extract the URL to the download zip that you get when you run the workspace outside the automation from a workspace app or just run on flow itself. The issues im having are: -When the workspace is run within the automation it does not create a zip file in the temp/engineresults like when you run from a workspace app -If i explicitly define temp/engineresults as the output location, it will write either a hardcoded zipfile name (not the autogenerated one) OR if i remove the .zip extension it writes each individual file - which i dont want -I am able to extract out the autogenerated URL from the logfile, however because of the bullet points above there is actually no file being created at that URL I've seen plenty of topics around this URL, but none of them seem to cover my situation, im basically asking what configuration do i need on my writer and

353
crutledge
Enthusiast
nchap
Contributor
nchapContributor
asked in Deployment
FME Flow Error: SDE Database Connection & Resource Path

We are converting a number of GIS-focused Automations in FME Flow 2024.0 to use the new SDE Database Connections instead of the old PATH resource. FME Flow is returning an error when attempting to read the new database connection properties: ‘An error occurred while attempting to retrieve the connection parameters from the connection file’ For each of the FME Flow Database Connections, we used an FME Resource, ‘SDE_GISD’, for the path reference for the connection file. We found if we use a UNC path instead of the FME Flow resource it works as expected. Is this a limitation or are we doing something wrong? Connection works as expected on local host, local server host, and with UNC path for the database connection within FME Flow. Just not with using a Resource path in the connection. Error: 315 2024-7-31 11:51:25 | Opening the Esri Geodatabase reader 316 2024-7-31 11:51:25 | An ArcGIS license is already checked out. The product checked out is 'ArcServer' 317 2024-7-31 11:51:25 | Install

4739
sashal
Contributor
bbnj356
Contributor
bbnj356Contributor
asked in Deployment
FME Flow 2024.2 - Create Project not able to add Resource Path

We migrated from FME Server 2022 to FME Flow 2024 (FME Flow 2024.2.3Build 24825 - win64) and we have imported the 2022 backup successfully. When I now want to create a new project and I want to add a Resource path to the Project, the list of Resources to chose from is empty. I’ve looked at the request and the response contains the list of resource paths at the highest level but this list is not displayed in the UI. Is there a known issue with this release or a config setting that we missed? Request URL: https://<fmeserver>/fmeapiv4/resources/connections?limit=100&offset=0&suppressBroadcastError=false&cb=1744107685909 Request Method: GET Status Code: 200 OK Response : { "items": [ { "name": "FME_SHAREDRESOURCE_BACKUP", "owner": "admin", "ownerID": "fb2dd313-e5cf-432e-a24a-814e46929ab7", "sharable": true, "displayName": "Backup", "description": "This shared resource is the backup directory", "migratable": false, "type": "network", "properties": { "DIR": "<UNC_Path>/resources/backups/" },

474
bbnj356
Contributor
totobobiasos
totobobiasos
asked in Automation
Download URLfrom server app

So, I've created an server app that sometimes posts very large datasets and have so far been able to restrict access to the data by just emailing the dataset back as an attachment (user email as parameter) (its not super safe, but safe enough - the data isn't super sensitive but sensitive enough). I've thus been able to restrict the data to the person running the server app by letting the person enter their email and get the data back that way. But now the datasets is growing kinda fast and the email client isn't putting up with 20-50 megabytes of attachments. So I read that it was possible to get the server app to respond with the download link (again not super safe, but safe enough). So: how do I do that? What parameter carries the data download link from server apps? Or, it doesn't work that way? (in wich case I'd have to do a workaround, and nobody likes workarounds :-) Been searching and trying for several hours without luck. Tried the ServerNotifier and the emailer and both are s

56114
zoe.forbes
Safer
jugoslaviaa
Enthusiast
jugoslaviaaEnthusiast
asked in Automation
Issue with SchemaScanner Misinterpreting ID Field Data Type

I have an ID field that is correctly read by FME as varchar(22) when writing using the Feature Writer. However, before that, I use the SchemaScanner, and it incorrectly detects the data type as fme_real64. As a result, the original value is eventually written in scientific notation, like 2.2072213393213062e+21, instead of preserving the original string format. Is there a way to ensure that SchemaScanner correctly detects the field as varchar(22) to prevent this issue? Any suggestions would be appreciated!

647
jugoslaviaa
Enthusiast
chelseawu
Contributor
chelseawuContributor
asked in Automation
Has anyone ever created Flow APP for public survey purpose?

I am doing proof-of-concept testing to create a FLOW APP to collect public input data (public survey).. It’s simple survey, just a few questions. Everything seems working (I published workspace for ‘job submitter’.. but Is it possible to modify the ‘Run’ button in the App? e.g. as ‘Submit’. 2. disable the ‘Run Again’ after a run? After run complete, is it possible to return some text message? e.g. ‘Your inputs has been recorded. Thank you for your help!...” or a bit more advanced to return the summary of data input by user? Not sure if I am heading a wrong direction. Any help is appreciated.

557
j.botterill
Influencer
erik_jan
Contributor
erik_janContributor
asked in General
FME Data streaming HTML file

Hi All, I have a FME workspace published with the Data streaming service of FME Server 2016. The workspace creates a HTML file for output. When I run the workspace my browser allows me to download the file (or run it). I want the HTML contents of the file to replace the FME Server page (or automatically open in a new tab). What do I need to change to open the HTML file without user interaction? Thanks for any help, Erik Jan

1973
chelseawu
Contributor
nedwaterman
Contributor
nedwatermanContributor
asked in Deployment
Set FilePath for FME_SHAREDRESOURCES_TEMP

Morning all, I’m trying to create a workspace that works both on FME Flow & Form. I’m using the FME_JOB_ID to determine what the workflow is running on. If its FME Form I’m setting the filepath to a shared drive. For Flow I’m trying to set it to the FME_SHAREDRESOURCE_TEMP folder to produce a data download. If I hard code the parameter in the writer to $(FME_SHAREDRESOURCE_TEMP)@Value(_FILEPATH) its fine, but I can’t do this as the file will not then post to a shared drive. If I try and set the FME_SHAREDRESOURCE_TEMP in the workspace to push that to my parameter and add it to the created filepath FME no longer produces the downloaded zip file. I’m setting the FME_SHAREDRESOURCE_TEMP to the url defined on Flow - which in this case is something like https://-myserverlocation-/fmeserver/resources/browse?path=FME_SHAREDRESOURCE_TEMP&name=Temp Is this correct, or should I be using a shorter, relative path? EDIT: Sorry just figured out I don’t need to set this at all! FME Flow just does it

732
tb09114
Supporter
panda
Enthusiast
pandaEnthusiast
asked in Architecture
Is there a way to change generated FME engine result zipped file name?

I’m wondering is there a way to add like datetime stamps to the engine result zipped file name? I know this need to be unique but would be nice to add datetime stamps to it while have it remain unique.

242
panda
Enthusiast
ebygomm
Influencer
ebygommInfluencer
asked in Automation
Trigger automation to run once at a specified time

I want a workspace to run on FME Flow at 11pm with a user initiating it at some point within the working day. Currently thinking of having the workspace run within an automation, which is scheduled to run daily at 11pm. User would enable the automation, workspace would run at 11pm and then trigger a second workspace which makes a http call to stop the automation. So the workspace is only run once and won’t run again until the process is repeated. Any ideas of a better way to do this?

517
birgit
Influencer
scarter
Contributor
scarterContributor
asked in Automation
API end points, or equivalent from FME Flow

Hello Forum, Is is possible within FME Flow to post a dataset (e.g.: a geojson) to an API endpoint, or equivalent function. I would then pass the API details to an external partner, from where they would download the full geojson file. Thanks,

424
s.jager
Influencer
jackyd
Contributor
jackydContributor
asked in Automation
Getting a list of items, workspaces, automations etc from fme flow

Hi everyone, We are planning an fme upgrade shortly and I want to compile a list of the workspaces, automations and other items we have on our FME Flow instance to help plan for testing, and determining the amount of effort etc we will need to plan for. Is there a way of doing this? Does anyone have a process they can share? Have had a look at using the api interface and http callers and could set something up with this, but hoping someone might have already done this that I could adapt for my systems. Or that there is a simpler native way that i have missed. TIA Jacky

664
redgeographics
Celebrity
_jacques_
Supporter
_jacques_Supporter
asked in Automation
Edit log filters in FME Flow

Hi, every day I monitor hundreds of jobs on an instance of FME Flow. Whenever an error occurs, I look in the log file of that job to figure out what went wrong. Now the problem is that sometimes that log file is empty, or only consists of a few warnings. I found out that it is related to which log-filters was configured when the workspace was uploaded to FME Flow. Is there any way to change the global log-filters on FME Flow, to make sure every workspace uses the same filter? Best regards, Jacques

394
_jacques_
Supporter
limo
Supporter
limoSupporter
asked in Automation
How to generate download link for a workspace app?

Hi, we are using an fme flow app do to some export jobs for us. When the job is done, a mail is sent tot he user. This is done by using the transformer “emailer” after FeatureWriter. The mail contains the link to download the data. To generatet he download link we have oriented ourselves here: https://community.safe.com/automation-13/download-urlfrom-server-app-11037 Our download link looks like: {FME Server Web URL}/fmedatadownload/results/{zip file name from FME_SERVER_DEST_DIR} But when I click on the link the message „Download Dataset Expired“ appears Can anyone help us?

665
mattmatsafe
Safer
keller
Contributor
kellerContributor
asked in Deployment
FME FLOW runs small workspaces but fails on large workspaces without an error

Hello, I recently received a new fme flow 2024 from my IT department and something keeps failing when i run a large workspace(1096704 kB), i get no error but the workspace fails.This same workspace runs in fme flow 2023 without any problem. Here are my system details, FME FLOW 2023 System Status: 43.39 GB of disk space available in the FME temporary folder (C:\Users\Username\AppData\Local\Temp\fmeengines\{enginename}_Engine1) System Status: 30.00 GB of physical memory available System Status: 126.00 GB of virtual memory available FME FLOW 2024 System Status: 65.31 GB of disk space available in the FME temporary folder (C:\Windows\TEMP\fmeengines\{enginename}_Engine2) System Status: 30.00 GB of physical memory available System Status: 126.00 GB of virtual memory available I have been reading around but i have not been able to pint out where the problem actually lies. How can i check for example how much memory has been allocated to an engine?Could it that i need to change the engine to

392
keller
Contributor
cbird
Participant
cbirdParticipant
asked in Deployment
Deployment parameters in Flow 2024.1.1 app not working

A simple workspace created in Workbench 2024.1.1 with three FME Flow deployment parameters - a web connection using Esri ArcGIS Portal (Template), a DB connection to PostgreSQL and a Text deployment parameter - works perfectly in Workbench as well as a manual or scheduled job once published to Flow. An FME Flow app created from that workspace fails trying to access the Web and DB deployment parameters. The Text parameter works fine. The app fails whether or not authentication is required to run the app. The Web and DB connections and the associated deployment parameters have been shared with fmeuser and fmeguest roles with Read access to try to fix the problem - but that did not help. Web connection error: 2025-3-20 14:46:38 | FME Flow error: `FME Flow error: `Unauthorized request by user due to lack of proper permissions for connection: WEB_ARCGIS_PORTAL. Please see: http://fme.ly/zn8'' 2025-3-20 14:29:41 | ArcGIS Portal Feature Service Reader: Connection 'WEB_ARCGIS_PORTAL' does not

301
mattmatsafe
Safer
durgam.balaraju
Observer
durgam.balarajuObserver
asked in Deployment
The error message in your FME Flow Server job indicates that FME is unable to connect to the File Geodatabase at \\vmbldtstweu001\F$\TestFME\TestCheckout_ERW.gdb.

While running a job on FME Flow 2024 Server, the following error occurred: "Unable to connect to the File Geodatabase located at '\vmbltstweu001\FS\TestFME\TestCheckout_ERW.gdb'. Please verify that the correct file path is specified and that the Geodatabase is not saved in a newer version of ArcGIS than the one installed on the server. The error code from ArcObjects is '-2147024891'." Could anyone please help me on that

151
mattmatsafe
Safer

Helpful Members This Week

Badge Winners

  • User Conference 2025
    tinohas earned the badge User Conference 2025
  • Teacher (Grey)
    cschra-chas earned the badge Teacher (Grey)
  • Welcome Back
    cofk_stefaniehas earned the badge Welcome Back
  • Student (Grey)
    magmhas earned the badge Student (Grey)
  • Teacher (Grey)
    magmhas earned the badge Teacher (Grey)
Show all badges

Popular Tags

Community Stats

31,157
Posts
118,121
Replies
38,778
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.