Skip to main content

Automation

Schedules, triggers, events, alerts, and notifications.

  • 867 Posts
  • 2,915 Replies
867 Posts
maarten_wsrl
Contributor
maarten_wsrlContributor
asked in Automation
FME Flow Automation App - Action failed in app interface

Hi, We are creating an FME Flow Automation App to help our land surveyors importing their data. Is there a way to send a message to the FME Flow Automation App interface if an action fails? We are currently using FME Flow 2023.2.2.

262
maarten_wsrl
Contributor
alexander.hall
Contributor
alexander.hallContributor
asked in Automation
ArcGIS Online Webhooks - FME Flow Automation

Hopefully someone can offer some advice on using ArcGIS Online hosted feature service webhooks and FME Flow. I have set up webhooks on a test hosted feature service, derived from a survey123 form. When implementing a webhook directly via Survey123, I successfully receive a response in the FME Flow log. However, when implementing a webhook on the feature service, there is no response in the log. I’ve done some checks using https://webhook.site/ and I can see that ArcGIS Online is sending data when using that URL, so it’s not a problem with the feature service webhook, but appears to be an issue with FME Flow. I should add, FME Flow is HTTPS enabled. All feature service settings look to be correct and I have default Admin rights on AGOL. Has anyone encountered a similar problem?

2844
droberg
Participant
N
nickj
asked in Automation
Using FileCopy Writer to copy single file to multiple subfolders

I have managed to use The Directory and File Pathnames reader, Attribute Manager and File Copy Writer to copy a file from one location to another. How would I be able to copy that same file into multiple subfolders of a single parent folder? I used this method so far.

1932
sveouu
Contributor
mccunee
Contributor
mccuneeContributor
asked in Automation
Recover Deleted Automation

I accidentally deleted the wrong automation in FME Flow and I am not able to see how I can recover it.

101
hkingsbury
Celebrity
ebygomm
Influencer
ebygommInfluencer
asked in Automation
Automation triggered by FME Flow Schedule initiated twice at the same time

We have an automation that is triggered daily with a CRON expression which runs 4 workspaces. The first 3 workspaces are run in parallel and the fourth runs on successful completion of one of the workspaces. Last night, two events appear to have been triggered at the scheduled time and so each workspace was run twice. Has anyone ever come across anything similar? I can’t see any obvious errors in the logs

141
hkingsbury
Celebrity
ebygomm
Influencer
ebygommInfluencer
asked in Automation
FME Automations - Merge - Invalid Link

I’m trying to set up an automation with a merge process similar to what is described here Getting Started with the Split-Merge Block – FME Support Center However, when I try to add in a Merge action to the Failure port I get the following error message Has anyone encountered this? I’m using the Merge Tool with a Failure Port so I’m not sure why it’s complaining FME 2024.1 Build 24612

141
nia.colebrooke
Safer
dellerbeck
Contributor
dellerbeckContributor
asked in Automation
Automation Parameters are Resetting

If you have an existing automation and need to make a change, you make your changes and publish \\ overwrite in FME Forms. Once you go to the automation and stop it, all parameters are reset to defaults. This happens even to workspaces that were not updated. This has happened the last 2 or 3 releases, currently we are on FME Flow 2023.1 Build 23619 - win64

2949
sdepriest
Contributor
asali
Contributor
asaliContributor
asked in Automation
Job Error Notification System

Hi guys, I have a doubt, I don’t know if such an option already exists or not, if it does, please guide me to the page. I need to make a notification system within the FME Server to send a live notification to a email if a job fails. Now there are number of methods to do this I believe, and I tried some of them but failed to achieve what I really require. What I need is a live notification system, i.e., it must notify me as soon the job fails. Now this notification message must contain time, workspace name, repository name, and the error message in a clean manner, like for example “Workspace Name : work.fmw”. Here the workspace name and repository name must be there without any fail, the other details I can compromise, but these two information is a must. Now, this notification system must not depend on a workspace, because I know i can create a notification system using FME Flow Notifier within a workspace. But I want the system to be independent of a workspace as it requires the work

304
asali
Contributor
lukas_infrabel
Participant
lukas_infrabelParticipant
asked in Automation
FME Engine encountered a Python issue

Hi, We encountered a strange problem regarding python environment when running multiple jobs via jobsubmitters on FME Flow. We recently updated from FME Server 2022 to FME Flow 2024.2.3Build 24825 which is when the automation stopped working. The automation triggers a sequence of master workspaces, which then runs multiple child workspaces. The first master workspace contains a creator, pythonCaller and 2 FMEFlowJobSubmitters in sequence. The rest of the workspace is not important, as the problem is with these first transformers. When running the master workspace, the Flow engine is loaded with python 3.12+ and runs the first pytonCaller and first FMEFlowJobSubmitter without a problem. However, when running the second FMEJobSubmitter, the following error is given: “FME Engine encountered a Python issue. Workspace requiring Python 2.7 is requested to run on an FME Engine configured to use a Python 3.12+ interpreter. FME cannot continue given the Python version mismatch” However, all mas

272
david_r
Evangelist
joshuajames1979
Contributor
joshuajames1979Contributor
asked in Automation
Geometry Validator not repairing Self Intersection

I have a routine that extracts property boundaries from a web service and outputs to shp to be imported into our Property and Rating system. I do have a Geometry Validation process to repair geometries where they may self intersect or are corrupted, however there are two polygons that are not repairing, even though they pass the test. Both are like the below. The polygon doesn’t actually cross over itself. Rather, this is two separate vertices where the bottom section meets the top section, and it’s all one polygon. Is there a way to automatically fix these with FME as we can’t edit the original. My workaround is to have the tiniest buffer and dissolve so the vertices don’t touch which passes the validation test in our P&R import, but ideally we should have clean geometries. Any help appreciated. Regards, Josh

887
joshuajames1979
Contributor
joshuajames1979
Contributor
joshuajames1979Contributor
asked in Automation
FMW fails to run via Scheduled Task when Using Service Account

Hi there, I have a number of FME Workflows on our GIS server that successfully run via scheduled tasks and bat file. However this latest one I have created only runs under my account and not the service account. The difference between this and other workflows is that this one is connecting to web services (Vicmap as a Service). I have made sure the service account has full permissions on any folders it is writing to as well the FME Programs folder. We are currently on FME Workbench 2022 but will soon be upgrading to the latest license structure. Do I need to consider any other permissions when dealing with web services? Regards, Josh

336
crutledge
Enthusiast
joshmon
Contributor
joshmonContributor
asked in Automation
Flow jobs failing on python script using exportToPDF

I have several automated jobs that use either a startup or shutdown python script. These scripts run fine in workbench and even in the ESRI Python interpreter on the Flow machine. The issue arises when I run them from Flow. When it gets to the script it will output expected products until the exportToPDF command at which point it fails. No errors are indicated anywhere except in the Engine Log where this is displayed: WARN localhost_Engine2 393562 : Process "localhost_Engine2" ended unexpectedly. Being restarted on attempt 1… Example of script: import arcpy, os, sys, time, shutilfrom datetime import datetime sdpFolder = r"****OBSCURED****"exportFolder = os.path.join(sdpFolder, "SiteDevPlanFiles")date = time.strftime("%Y-%m-%d")dateFolder = os.path.join(exportFolder, date) archiveFolder = os.path.join(sdpFolder, "_Archive") zipExportFolder = exportFolder + ".zip" # from zipfile import ZipFile# for file in ZipFile(zipExportFolder).namelist(): # archive previous zip destZip = os.path.join

1868
joshmon
Contributor
wil
Contributor
wilContributor
asked in Automation
Flow 2024 Parameter assignment, integers not recognized

I am creating an Automations proces and when assigning the parameters to an integer field get the following message: Must be a whole number. Decimals are not supported. In the Automations first a csv is read for creating all sorts of parameters In here there are no decimals. In the workspace tm_data has the Type int16 In the Automations writer it is also defined as integer. But when assigning the parameters, I receive the error. This applies for all integers I use in this. This is a automations proces that I also build in Server 2021 and I didn't have this issue but in Flow 2024 I can't get any further because of this error. Is there something I do wrong or is this a bug?

181
wil
Contributor
afod
Contributor
afodContributor
asked in Automation
Cant access Download URL from automation

I am running an automation process that collects some data via a webhook ,does some processing then outputs some shapefiles. I am trying to extract the URL to the download zip that you get when you run the workspace outside the automation from a workspace app or just run on flow itself. The issues im having are: -When the workspace is run within the automation it does not create a zip file in the temp/engineresults like when you run from a workspace app -If i explicitly define temp/engineresults as the output location, it will write either a hardcoded zipfile name (not the autogenerated one) OR if i remove the .zip extension it writes each individual file - which i dont want -I am able to extract out the autogenerated URL from the logfile, however because of the bullet points above there is actually no file being created at that URL I've seen plenty of topics around this URL, but none of them seem to cover my situation, im basically asking what configuration do i need on my writer and

333
crutledge
Enthusiast
totobobiasos
totobobiasos
asked in Automation
Download URLfrom server app

So, I've created an server app that sometimes posts very large datasets and have so far been able to restrict access to the data by just emailing the dataset back as an attachment (user email as parameter) (its not super safe, but safe enough - the data isn't super sensitive but sensitive enough). I've thus been able to restrict the data to the person running the server app by letting the person enter their email and get the data back that way. But now the datasets is growing kinda fast and the email client isn't putting up with 20-50 megabytes of attachments. So I read that it was possible to get the server app to respond with the download link (again not super safe, but safe enough). So: how do I do that? What parameter carries the data download link from server apps? Or, it doesn't work that way? (in wich case I'd have to do a workaround, and nobody likes workarounds :-) Been searching and trying for several hours without luck. Tried the ServerNotifier and the emailer and both are s

54814
zoe.forbes
Safer
jugoslaviaa
Enthusiast
jugoslaviaaEnthusiast
asked in Automation
Issue with SchemaScanner Misinterpreting ID Field Data Type

I have an ID field that is correctly read by FME as varchar(22) when writing using the Feature Writer. However, before that, I use the SchemaScanner, and it incorrectly detects the data type as fme_real64. As a result, the original value is eventually written in scientific notation, like 2.2072213393213062e+21, instead of preserving the original string format. Is there a way to ensure that SchemaScanner correctly detects the field as varchar(22) to prevent this issue? Any suggestions would be appreciated!

627
jugoslaviaa
Enthusiast
chelseawu
Contributor
chelseawuContributor
asked in Automation
Has anyone ever created Flow APP for public survey purpose?

I am doing proof-of-concept testing to create a FLOW APP to collect public input data (public survey).. It’s simple survey, just a few questions. Everything seems working (I published workspace for ‘job submitter’.. but Is it possible to modify the ‘Run’ button in the App? e.g. as ‘Submit’. 2. disable the ‘Run Again’ after a run? After run complete, is it possible to return some text message? e.g. ‘Your inputs has been recorded. Thank you for your help!...” or a bit more advanced to return the summary of data input by user? Not sure if I am heading a wrong direction. Any help is appreciated.

537
j.botterill
Influencer
ebygomm
Influencer
ebygommInfluencer
asked in Automation
Trigger automation to run once at a specified time

I want a workspace to run on FME Flow at 11pm with a user initiating it at some point within the working day. Currently thinking of having the workspace run within an automation, which is scheduled to run daily at 11pm. User would enable the automation, workspace would run at 11pm and then trigger a second workspace which makes a http call to stop the automation. So the workspace is only run once and won’t run again until the process is repeated. Any ideas of a better way to do this?

517
birgit
Influencer
scarter
Contributor
scarterContributor
asked in Automation
API end points, or equivalent from FME Flow

Hello Forum, Is is possible within FME Flow to post a dataset (e.g.: a geojson) to an API endpoint, or equivalent function. I would then pass the API details to an external partner, from where they would download the full geojson file. Thanks,

404
s.jager
Influencer
jackyd
Contributor
jackydContributor
asked in Automation
Getting a list of items, workspaces, automations etc from fme flow

Hi everyone, We are planning an fme upgrade shortly and I want to compile a list of the workspaces, automations and other items we have on our FME Flow instance to help plan for testing, and determining the amount of effort etc we will need to plan for. Is there a way of doing this? Does anyone have a process they can share? Have had a look at using the api interface and http callers and could set something up with this, but hoping someone might have already done this that I could adapt for my systems. Or that there is a simpler native way that i have missed. TIA Jacky

594
redgeographics
Celebrity
_jacques_
Supporter
_jacques_Supporter
asked in Automation
Edit log filters in FME Flow

Hi, every day I monitor hundreds of jobs on an instance of FME Flow. Whenever an error occurs, I look in the log file of that job to figure out what went wrong. Now the problem is that sometimes that log file is empty, or only consists of a few warnings. I found out that it is related to which log-filters was configured when the workspace was uploaded to FME Flow. Is there any way to change the global log-filters on FME Flow, to make sure every workspace uses the same filter? Best regards, Jacques

374
_jacques_
Supporter
limo
Supporter
limoSupporter
asked in Automation
How to generate download link for a workspace app?

Hi, we are using an fme flow app do to some export jobs for us. When the job is done, a mail is sent tot he user. This is done by using the transformer “emailer” after FeatureWriter. The mail contains the link to download the data. To generatet he download link we have oriented ourselves here: https://community.safe.com/automation-13/download-urlfrom-server-app-11037 Our download link looks like: {FME Server Web URL}/fmedatadownload/results/{zip file name from FME_SERVER_DEST_DIR} But when I click on the link the message „Download Dataset Expired“ appears Can anyone help us?

645
mattmatsafe
Safer
arnaud974
Contributor
arnaud974Contributor
asked in Automation
Error with SharepointOnlineConnector When Running FME from Bash

Hello, I have an FME workflow that runs perfectly when executed with the FME GUI open, but it fails when launched via a Windows bash script. The error message generated is: SharepointOnlineConnector: Connection 'SharePoint0Online08safe.microsoft-sharepoint9' does not exist. Check connection parameter and connection definitions in FME options and try again Is the SharepointOnlineConnector connection only valid when the graphical interface is active? Do you know how to keep this connection active even when running the workspace from a script? Thank you in advance !

111
arnaud974
Contributor
hkingsbury
Celebrity
hkingsburyCelebrity
asked in Automation
Email Results To in a Workspace App

Before I get into the details I see there have been a couple of similar questions asked it the past, specifically As well as this idea What I’m wanting to be able to do is have a process, specifically one run with the Data Download Service, that has been run through a Workspace App to post to the DATADOWNLOAD_ASYNC_JOB_SUCCESS Topic. Effectively replicating the ‘Email Result To’ functionality of the Run Workspace interface. Now, I know how you could achieve this by modifying the workspace and include the email functionality there, but that means updating a significant number of workspaces, and ensuring that future workspaces are built with that functionality included. Does anyone have any ideas? Could an automation app be a solution (don’t have much experience with them)?

301
j.botterill
Influencer
snusmumriken
Contributor
snusmumrikenContributor
asked in Automation
Microsoft 365 / Exchange Online shared mailbox with OAuth in IMAP/SMTP automations

Greetings! I have a question, is it possible to utilize Microsoft 365 / Exchange Online shared mailboxes in IMAP/SMTP automations, in conjunction with OAuth? This question applies to System Email as well. All our research points towards no at the moment, so this might be an Idea post rather than a Question. At least within FME Flow 2024.1.3 (Build 24627) that we are currently running. Background:Exchange Online shared mailboxes cannot be interacted with directly. Their accounts are technically disabled, they have no valid logon credentials nor any mailbox licenses. Instead, you grant Send as and Full permission to other licensed accounts in Exchange Online, who act on behalf of the shared mailboxes. Therefore, in addition to the shared mailbox (fme@our-company.com) we intend to use for automations, we created a licensed service account (account@our-microsoft-tenant.com) that will act on behalf of the shared mailbox. The problem:Now, provided that all we have for Email automations is a

572
snusmumriken
Contributor

Helpful Members This Week

Badge Winners

Show all badges

Popular Tags

Community Stats

31,074
Posts
117,804
Replies
38,834
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.