Skip to main content
  • EN

Automation

Schedules, triggers, events, alerts, and notifications.

  • 914 Posts
  • 3,101 Replies
914 Posts
joshmon
Contributor
joshmonContributor
asked in Automation
Flow jobs failing on python script using exportToPDF

I have several automated jobs that use either a startup or shutdown python script.  These scripts run fine in workbench and even in the ESRI Python interpreter on the Flow machine.  The issue arises when I run them from Flow.  When it gets to the script it will output expected products until the exportToPDF command at which point it fails.  No errors are indicated anywhere except in the Engine Log where this is displayed: WARN     localhost_Engine2   393562 : Process "localhost_Engine2" ended unexpectedly. Being restarted on attempt 1…Example of script:import arcpy, os, sys, time, shutilfrom datetime import datetimesdpFolder = r"****OBSCURED****"exportFolder = os.path.join(sdpFolder, "SiteDevPlanFiles")date = time.strftime("%Y-%m-%d")dateFolder = os.path.join(exportFolder, date) archiveFolder = os.path.join(sdpFolder, "_Archive")zipExportFolder = exportFolder + ".zip"# from zipfile import ZipFile# for file in ZipFile(zipExportFolder).namelist():# archive previous zipdestZip = os.path.

26811
dbecker
Contributor
gkvoelkl
Contributor
gkvoelklContributor
asked in Automation
rest api - want to create a session token

Want to create a Session Token with JavaScript and api. What is the way to do it with rest api v3?best regards Gerhard

413
alexbiz
Influencer
mccunee
Contributor
mccuneeContributor
asked in Automation
Recover Deleted Automation

I accidentally deleted the wrong automation in FME Flow and I am not able to see how I can recover it.

704
deanhowell
Influencer
vimva679
Supporter
vimva679Supporter
asked in Automation
Automating Excel Tracker on MS TEAMS using FME

Dear All, I am requesting your input on how to automate task on Teams using FME?  Excel tracker on TEAMSON TEAMS : I have day-to-day job task tracker in Excel format. ON MONDAY.COM: The team members go and update data (dates, complete / in progress status, this Monday.com data could be manually downloaded in excel file  ACTION / INPUT required : I would like to do fully automate process meaning: FME connect and pick /extract data from MONDAY.com  FME apply those transformer to obtain desired statistics (i have complete this part and could do this myself) FME goes back and APPEND the new statistics in Excel file stored on TEAMS. When the task is complete, am email goes to line manager and other stakeholder that the task is completed.  Highly obliged with you inputs many thanks /Vim

272
david_r
Celebrity
vn1
Contributor
vn1Contributor
asked in Automation
FME API Automation topic trigger and external action query

If an automation is triggered by a schedule, you can obtain the schedule properties via the Schedules list.  https://docs.safe.com/fme/html/FME_REST/apidoc/v3/index.html#!/schedules/list If an automation is triggered by a topic, how do you obtain the name(s) of the topic(s) that trigger that automation?If an automation posts to a topic, how do you obtain the name(s) of the topic(s) that automation posts to?

675
whichwayisnorth
Contributor
wil
Contributor
wilContributor
asked in Automation
Flow 2024 Parameter assignment, integers not recognized

I am creating an Automations proces and when assigning the parameters to an integer field  get the following message: Must be a whole number. Decimals are not supported.In the Automations first a csv is read for creating all sorts of parametersIn here there are no decimals.In the workspace tm_data has the Type int16In the Automations writer it is also defined as integer.But when assigning the parameters, I receive the error. This applies for all integers I use in this.This is a automations proces that I also build in Server 2021 and I didn't have this issue but in Flow 2024 I can't get any further because of this error.Is there something I do wrong or is this a bug?

544
kgnadt
Observer
mathiku
Supporter
mathikuSupporter
asked in Automation
Log - what's taking so long?

I have a job running that takes 10 minutes and generates 19.000 rows in the log. The runtime is not the issue here, I'm just curious to out some numbers on time-spent.What’s the best way to find out where the time is spent?I suspect a few specific transformers, but since this is probably a common question I wonder what other people are doing.

588
virtualcitymatt
Celebrity
joy
Enthusiast
joyEnthusiast
asked in Automation
Data Dowload only returns one output [FME Flow 2024.2.1]

Hello everyone, I encounter a similar problem to the following post from 4 years ago.I am able to write several output files (2 .dgn files) in FME Form. However when I publish the script to FME Flow and run  the script in the form of a workspace I only get one output result back.I already looked into the Data Download Service Properties when I publish the script to FME Flow and both writers are already included in the Writers in Download attribute. So I am not sure why I don't get both files in the zip file. The files don't have the same name. The weird thing is also that the dgn file I get back from FME Flow has the same name as the zip file, while in FME Form they get the name I have defined in the writers (Bomen.dgn and Kabels_Met_Buffers.dgn).Another finding is when I look into the translation log on FME Flow, it looks all features are written (23000 features). I know that 18000 features are in one file and 5000 features in the other file. So it looks like all feature are written, 

695
joy
Enthusiast
fmejohn93
Contributor
fmejohn93Contributor
asked in Automation
FME form trying to create a folder when it should create a file

This job works fine in FME Workbench 2024.2. But in FME flow, when I try to run the workspace, it’s trying to create a folder instead of a .xml file. See screenshots

584
fmejohn93
Contributor
deanhowell
Influencer
deanhowellInfluencer
asked in Automation
AWS SNS Issue

I have a 2023.2.1 workbench that reads in a JSON file using the TextLine reader, does some FME magic and the outputs the results for FME Server (Flow) to use.2023.2.1 workbench to process JSONThe reader parameters are set to read the whole file at onceThe workbench is published to FME Flow 2023.2.1 and is used in an Automation that gets an AWS SNS message with the JSON info in the message of the SNS. The SNS is received as expected but the message appears to be reading each line as a separate source and as such it never processes the file as expected.  Any advice as to what I am doing wrong in the process?

262
deanhowell
Influencer
vxn43
Supporter
vxn43Supporter
asked in Automation
Directory Watch in Automation does not watch

Hello, I am using FME Flow 2021. I have an Automation that uses Directory Watch. When a file is added to the “Directory to Watch,” the Automation should run. But it does not run when a new file is added. I can run it manually, and it works as expected. In my screen capture below, it seems I need to add something to “Events to Watch for” to trigger. What am I missing?  

283
dylan.at.safe
Safer
ecx
Supporter
ecxSupporter
asked in Automation
Data streaming service doesn't display HTML page, stuck loading

Hello all, I have a FME flow web-app (image 1). I am attempting to get a message to the user in certain circumstances via HTML output (image 2), which displays a message via the browser to the user if certain conditions are met, via redirecting the web-app page, e.g. there is an issue with their edits (image 3)image 1image 2image 3, text printed through the browserThis works, sort of. but its not good enough for end users, as the page redirects, but is blank and is stuck in a perpetual loading state. Until the user hits the ‘stop refresh’ (X) on their browser, then the message (image 3) appears.My questions are:How can I make this work without the user having to hit the stop refresh button?Will that page redirect stop the rest of the FME process from running/committing changes? Is there a way to link this to a terminator? if I can terminate the process the perpetual refresh may also stop.   I have the services set up like this:Or, are there any alternative ways to get a message to the

483
j.botterill
Influencer
alisonsep
Contributor
alisonsepContributor
asked in Automation
Issue with FTPCaller on Flow but now on Form (desktop)-Could not resolve hostname

Greetings!I have a simple workbench that runs without issue on Form (v2025.0) that uses a CSV reader that lists File_name, file_url in which the url is a SFTP://hostname:22/path/filename.typ The CSV reader is linked to the FTPCaller.This process works fine on Form (desktop) and loads the files to the respective server and path.However, when the workbench is run from the server, is runs Successful-but does not load the files; in the log there is an error: FTPCaller (FTPFactory): FTP/FTPS/SFTP transfer error: Could not resolve hostname Any suggestions on why?

444
alisonsep
Contributor
galigis
Enthusiast
galigisEnthusiast
asked in Automation
ArcGIS and Flow Integration / Data downloader & 3D Viewer

Hi All,I have a question regarding the integration of FME Flow with the ArcGIS suite. I am currently developing a 3D viewer platform utilising ArcGIS technologies, such as the 3D viewer, to display LiDAR data in SLPK format. The platform operates smoothly; however, my client has requested the capability to download the data as LAS files based on an 'Area of Interest' (AOI) drawn by the user.I am considering embedding an FME Flow application within an ArcGIS Experience Builder that hosts both the 3D Viewer and the FME Flow application to facilitate the download of LAS files. Is this feasible? Any information or resources to assist in achieving this would be greatly appreciated.Additionally, is it possible to customise the FME Flow map to function as an ArcGIS Webmap (either 2D or 3D) to display the extent of the LiDAR data? My tests have only shown the default map with OpenStreetMap as the background, but I aim to provide users with the extent of the LiDAR data so they are aware of what

481
carlw
Safer
alexander.hall
Contributor
alexander.hallContributor
asked in Automation
ArcGIS Online Webhooks - FME Flow Automation

Hopefully someone can offer some advice on using ArcGIS Online hosted feature service webhooks and FME Flow.I have set up webhooks on a test hosted feature service, derived from a survey123 form. When implementing a webhook directly via Survey123, I successfully receive a response in the FME Flow log. However, when implementing a webhook on the feature service, there is no response in the log.I’ve done some checks using https://webhook.site/ and I can see that ArcGIS Online is sending data when using that URL, so it’s not a problem with the feature service webhook, but appears to be an issue with FME Flow.I should add, FME Flow is HTTPS enabled. All feature service settings look to be correct and I have default Admin rights on AGOL.Has anyone encountered a similar problem?  

4127
skyleratsafe
Safer
asali
Contributor
asaliContributor
asked in Automation
Job Error Notification System

Hi guys, I have a doubt, I don’t know if such an option already exists or not, if it does, please guide me to the page.I need to make a notification system within the FME Server to send a live notification to a email if a job fails. Now there are number of methods to do this I believe, and I tried some of them but failed to achieve what I really require. What I need is a live notification system, i.e., it must notify me as soon the job fails. Now this notification message must contain time, workspace name, repository name, and the error message in a clean manner, like for example “Workspace Name : work.fmw”. Here the workspace name and repository name must be there without any fail, the other details I can compromise, but these two information is a must. Now, this notification system must not depend on a workspace, because I know i can create a notification system using FME Flow Notifier within a workspace. But I want the system to be independent of a workspace as it requires the works

715
skyleratsafe
Safer
lukas_infrabel
Contributor
lukas_infrabelContributor
asked in Automation
FME Engine encountered a Python issue

Hi, We encountered a strange problem regarding python environment when running multiple jobs via jobsubmitters on FME Flow. We recently updated from FME Server 2022 to FME Flow 2024.2.3Build 24825 which is when the automation stopped working. The automation triggers a sequence of master workspaces, which then runs multiple child workspaces. The first master workspace contains a creator, pythonCaller and 2 FMEFlowJobSubmitters in sequence. The rest of the workspace is not important, as the problem is with these first transformers. When running the master workspace, the Flow engine is loaded with python 3.12+ and runs the first pytonCaller and first FMEFlowJobSubmitter without a problem. However, when running the second FMEJobSubmitter, the following error is given: “FME Engine encountered a Python issue. Workspace requiring Python 2.7 is requested to run on an FME Engine configured to use a Python 3.12+ interpreter. FME cannot continue given the Python version mismatch”However, all mast

733
lukas_infrabel
Contributor
maarten_wsrl
Contributor
maarten_wsrlContributor
asked in Automation
FME Flow Automation App - Action failed in app interface

Hi,We are creating an FME Flow Automation App to help our land surveyors importing their data. Is there a way to send a message to the FME Flow Automation App interface if an action fails?We are currently using FME Flow 2023.2.2.

322
maarten_wsrl
Contributor
N
nickj
asked in Automation
Using FileCopy Writer to copy single file to multiple subfolders

I have managed to use The Directory and File Pathnames reader, Attribute Manager and File Copy Writer to copy a file from one location to another. How would I be able to copy that same file into multiple subfolders of a single parent folder? I used this method so far.

2932
sveouu
Contributor
ebygomm
Influencer
ebygommInfluencer
asked in Automation
FME Automations - Merge - Invalid Link

I’m trying to set up an automation with a merge process similar to what is described hereGetting Started with the Split-Merge Block – FME Support Center However, when I try to add in a Merge action to the Failure port I get the following error message Has anyone encountered this? I’m using the Merge Tool with a Failure Port so I’m not sure why it’s complaining FME 2024.1 Build 24612

171
nia.colebrooke
Safer
joshuajames1979
Contributor
joshuajames1979Contributor
asked in Automation
Geometry Validator not repairing Self Intersection

I have a routine that extracts property boundaries from a web service and outputs to shp to be imported into our Property and Rating system. I do have a Geometry Validation process to repair geometries where they may self intersect or are corrupted, however there are two polygons that are not repairing, even though they pass the test. Both are like the below. The polygon doesn’t actually cross over itself. Rather, this is two separate vertices where the bottom section meets the top section, and it’s all one polygon. Is there a way to automatically fix these with FME as we can’t edit the original. My workaround is to have the tiniest buffer and dissolve so the vertices don’t touch which passes the validation test in our P&R import, but ideally we should have clean geometries.Any help appreciated. Regards, Josh

2077
joshuajames1979
Contributor
joshuajames1979
Contributor
joshuajames1979Contributor
asked in Automation
FMW fails to run via Scheduled Task when Using Service Account

Hi there,I have a number of FME Workflows on our GIS server that successfully run via scheduled tasks and bat file. However this latest one I have created only runs under my account and not the service account. The difference between this and other workflows is that this one is connecting to web services (Vicmap as a Service). I have made sure the service account has full permissions on any folders it is writing to as well the FME Programs folder. We are currently on FME Workbench 2022 but will soon be upgrading to the latest license structure.Do I need to consider any other permissions when dealing with web services? Regards,Josh

1126
crutledge
Influencer
afod
Contributor
afodContributor
asked in Automation
Cant access Download URL from automation

I am running an automation process that collects some data via a webhook ,does some processing then outputs some shapefiles. I am trying to extract the URL to the download zip that you get when you run the workspace outside the automation from a workspace app or just run on flow itself.The issues im having are:-When the workspace is run within the automation it does not create a zip file in the temp/engineresults like when you run from a workspace app-If i explicitly define temp/engineresults as the output location, it will write either a hardcoded zipfile name (not the autogenerated one) OR if i remove the .zip extension it writes each individual file - which i dont want-I am able to extract out the autogenerated URL from the logfile, however because of the bullet points above there is actually no file being created at that URLI've seen plenty of topics around this URL, but none of them seem to cover my situation, im basically asking what configuration do i need on my writer and then

483
crutledge
Influencer
totobobiasos
totobobiasos
asked in Automation
Download URLfrom server app

So, I've created an server app that sometimes posts very large datasets and have so far been able to restrict access to the data by just emailing the dataset back as an attachment (user email as parameter)(its not super safe, but safe enough - the data isn't super sensitive but sensitive enough). I've thus been able to restrict the data to the person running the server app by letting the person enter their email and get the data back that way. But now the datasets is growing kinda fast and the email client isn't putting up with 20-50 megabytes of attachments. So I read that it was possible to get the server app to respond with the download link (again not super safe, but safe enough). So: how do I do that? What parameter carries the data download link from server apps? Or, it doesn't work that way? (in wich case I'd have to do a workaround, and nobody likes workarounds :-) Been searching and trying for several hours without luck. Tried the ServerNotifier and the

63014
zoe.forbes
Safer
jugoslaviaa
Enthusiast
jugoslaviaaEnthusiast
asked in Automation
Issue with SchemaScanner Misinterpreting ID Field Data Type

I have an ID field that is correctly read by FME as varchar(22) when writing using the Feature Writer.However, before that, I use the SchemaScanner, and it incorrectly detects the data type as fme_real64. As a result, the original value is eventually written in scientific notation, like 2.2072213393213062e+21, instead of preserving the original string format.Is there a way to ensure that SchemaScanner correctly detects the field as varchar(22) to prevent this issue? Any suggestions would be appreciated!  

877
jugoslaviaa
Enthusiast

Badge Winners

Show all badges

Community Stats

31,758
Posts
120,641
Replies
39,382
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.