- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow
Automation

Automation

Schedules, triggers, events, alerts, and notifications.

820 Posts
2,763 Replies

When you subscribe we will email you when there is a new topic in this category

820 Posts

Most replies

Most views

Newest first

nathanherzogContributor

asked in Automation

IMAP email automation trigger - message body sent as HTML via Event As JSON

I’m using an IMAP email trigger for an automation where I’m using the content of the email in a workbench with the goal of delivering a JSON payload to Cityworks to automatically create a new Work Order.I’ve set up a User Parameter in the workbench to receive data from the the email. When I use the “Event as JSON” option for the parameter in FME Flow, the message body is being delivered to the workbench as HTML. This crashes the JSON being delivered. Everything up to the body is fine, but the message body doesn’t make it over, and everything that follows the body is also lost.I’ve been able to get the message content into a workbench by using the individual headings such as “Email Body”, “Email Subject”, “Sent from Address” headings in Flow as the parameters to pass, but doing it this way does not allow you to use the JSON transformers in the workbench.Essentially what I am needing to do is receive JSON formatted data in a workbench from the IMAP email trigger, create attributes from

220

2 days ago

sunnywaygisContributor

asked in Automation

Extract Detailed Job messages from FME Flow Successful/Failed Jobs

Hi All, I want to extract detailed log messages from FME job running on FME Flow (Ver 2021.2.3). What options are available to extract this information along with basic job information like Workspace, Repository, user, source, start and end time. etc. Appreciate any feedback. Jay

354

3 days ago

mbaumgartnerContributor

asked in Automation

issue with component "Trigger". Publisher dirwatch does not exist

I am trying to create an automation using a trigger that watches a directory. If a file in the directory is added/created it launches an FME Workspace. However I keep getting the following error:2024-12-14T20:10:08Z | 410109 : (Automations) Creating link from trigger...3 2024-12-14T20:10:08Z | 410108 : (Automations) Creating dirwatch trigger...4 2024-12-14T20:10:08Z | 410112 : (Automations) Unable to assemble automation. There was an issue with component "Trigger". Publisher dirwatch does not exist.The same thing happens when I try add a trigger that watches an FTP? and I get the same error when trying to add a Publication under the Notification.What am I missing? Do I need to add something special for a trigger to work? is it possible that I am missing some part of FME?I am working with a FME FLOW 2024.1that is in a Azure Kubernetes cluster.Any help or hint that could explain the error is highly appreciated.

434

5 days ago

hawaiialexContributor

asked in Automation

Trigger Python Script upon GIS Feature Class Update

Hi everyone,I’ve created a python script that has the docx library and arcpy library imported in it that takes field values from a GIS feature class and writes it to a docx document successfully. I would like to trigger the python script to run every time that feature class in an enterprise geodatabase is updated.I am working in the 11.3 Enterprise Environment and have come across this support page regarding implementing webhooks and FMEhttps://support.safe.com/hc/en-us/articles/25407414850061-Integrating-ArcGIS-Enterprise-Feature-Service-Webhooks-With-FMEI will attempt to do the above, but I have a simple question regarding the FME workspace itself.I have read up on the PythonCreator and PythonCaller transformers, with the PythonCreator not requiring an inpput. If all I want is an update to the GIS feature class to trigger the python script to run, would the FME workspace just have a PythonCreator with the python script in it and a logger? Or would it be more beneficial to have a Crea

341

6 days ago

wisegisContributor

asked in Automation

FMEFlow Job Submitter using an RCaller

I have a process that writes a number of graphs to a folder on the network. It works great in FME Form. If I attempt to publish this workspace to FME Flow as a Job Submitter it doesn’t write the files to the folder at all like the same file does at the desktop level. The output path is set up in an RCaller so there isn’t a Writer in the .fmw script like normal. There are zero errors on the desktop side, and I have made sure the FME Flow portion no R packages are causing errors. When I run this process, I receive zero errors in Flow, but none of the files write to the directory. The end process would be that a person could upload a number of spreadsheets run this process from a webpage (Flow) and the output would show up in their department’s folder. I read in the community about it possibly writing to another directory and I attempted to check that out without success. Any help or guidance would be appreciated.

263

12 days ago

snehaContributor

asked in Automation

I am trying to do a pg_dump using command line in the system caller. It is failing, when i implemented the same command in the linux terminal, it is prompting for the password. I tried all the ways to pass the password value, nothing has worked out.

I tried to find an alternative transformer for the system caller to do the pg_dump, but even that did not work out.

7658

23 days ago

sam_appletonContributor

asked in Automation

Workbench fails when run from Flow Apps - Runs fine with "Run Workspace"

Hi,When I run a workspace via an App I get the following error:Microsoft Azure SQL Database Non-Spatial Writer: A suitable Microsoft SQL Server OLE Driver is not found. Install Microsoft OLE DB Driver for SQL Server from http://www.microsoft.com/en-ca/download/details.aspx?id=56730 I can see from earlier on in the logs that it failed to connect :Microsoft Azure SQL Database Non-Spatial Writer: Failed to connect using Microsoft OLE DB Driver 19 for SQL Server. Provider error ''. When I run the same workspace from “Run workspace” it connects and runs fine:Microsoft Azure SQL Database Non-Spatial Writer: Trying to connect using Microsoft OLE DB Driver 19 for SQL Server…Microsoft Azure SQL Database Non-Spatial Writer: Starting execution of BEGIN_SQL commands I tried deleting the app and creating it again but that didn’t seem to work. TIA

383

24 days ago

bdotfdotfmeContributor

asked in Automation

fme flow automation: how to run a workspace (name decided at runtime) if it exists?

I am sure that there is a solution within fme flow automation, but meanwhile I am pulling my hair for not finding it…The scenario:Through a directory watcher triggered automation, I import the content of a variety of geopackage files into postgis tables with corresponding names. This part runs well.For some of these tables, I have ElasticSearch indices, which have to be rebuilt after table import. For the indexing, I have a repo on the flow server named Elastic-Indexer, and therein are workspaces with names corresponding to some of the tables. (n.b. not all tables have corresponding indexer workspaces)Now I try to build up a dynamic system that gets notified with the schema.tablename after import and runs - if it exists - a workspace with a matching name from the Elastic-Indexer repository. My first idea was to read the workspace names from that repository and call the workspace if the name matches, but a) I was not able to read the workspace names and b) this solution looks clunky whe

374

25 days ago

vanessarapiorContributor

asked in Automation

Error on FME Server 2022

Hello :) I have some workbenches on the FME Server 2022 and I get for all of them the error:2024-12-11 13:37:46 | java.sql.SQLException: Query failed (#20241211_123746_28965_mxxee): Unknown transaction ID: f6d2afb3-c2fa-4417-970c-375bf47d1c9f. Possibly expired? Commands ignored until end of transaction blockIs that something I can fix or is it a Server error that only admins can fix? It is some time ago I was running the workbench. I tested one on my Laptop for a small country and it went good. all other countries are too big that is why I choose the FME Server. Any suggestions of what I can do?Vanessa

262

1 month ago

kyle_fiaccoObserver

asked in Automation

Automation vs Workspace App User Parameter Upload File

We are running into issues with the user parameter file inputs for Automation Apps. In this case our end user wants to upload a new csv file every time they run the automation app, and they want to upload it from their local computer/machine. Right now the only way to accept this user input is to have the csv file uploaded to a data store in FME Server, prior to selecting it as a user parameter, and then running the automation app. We noticed that this problem doesn't happen for workspace applications and they can upload local files directly as the end user, with no need to upload it to the data store in fme server prior. Is it possible to have our end user run an automation app and upload the user parameter directly from their local machine?

231

1 month ago

chelseawuContributor

asked in Automation

How to stop automation to send out error emails after it exceed a certain number?

I have a flow automation runs every 5 minutes, and will send out a notification email if a job failed. That becomes an issue if a problem that caused the job to fail hasn’t been resolved soon since the automation will continue to send out error email every 5 minutes.Is there any way to stop sending email after e.g. 10 emails or to reduce the frequency for sending error emails? I still want the automation to run every 5 minutes, even some job failed, but want to get just reasonable amount of error emails.

253

1 month ago

mpittingerContributor

asked in Automation

Provide specific response body to Webhook POST from 3rd party app

Hello everyone-Hoping that someone may be able to help with this question!Is there a way to provide a specific required JSON Response body (for example: {“status”:”OPERATION_OK} ) to a 3rd party application in response to a successful post to an FME Flow Automation with a Webhook trigger? I feel like I’m missing something obvious here….Any help would be greatly appreciated!Mike

784

1 month ago

sigtillContributor

asked in Automation

Datadownload - change filename on ZIP

I have looked at this: https://knowledge.safe.com/articles/678/create-a-custom-download-link-for-results-from-dat.htmlI want to be able to set the exact-filename of the zip-file within FME Workbench for the download service. Si instead of the URL like this: http://fmeserver/fmedatadownload/FME_2D764B0C_1515155526785_73956.zipI want to be able to define a parameter in a workspace called:ZIPFILENAME = myfilename.zipSo the Datadownloadservice serves the file:http://fmeserver/fmedatadownload/myfilename.zipIn other workspaces I will have completely different zip-filenames.Any way to do this? I manage to create all the data within the correct file and use the filecopy to copy the file to the correct place (within fmedatadownload/) but I can not persuade the fME Datadownloadservice to use that zipfile and not create a random-zipfile.

1436

1 month ago

nedwatermanContributor

asked in Automation

Alter FME Flow App webpage

Hi there,Successfully created an FME Flow Automation App (2023.1.1.1) that allows the user to upload files. However the customer doesn’t like the fact that the + Enter URL/Path link is shown.Where are the webpages stored on FME Flow? Can the html be modified to hide this link?

281

1 month ago

sossie07Participant

asked in Automation

IMAP oauth2 for Office365

Hi all, We currently use imap to connect to office365. The FME Imap process currrently uses basic auth which will be disabled my Microsoft in October this year. I understand that imap with Office365 will still work, but only with modern auth OAuth2. Does anyone have any experience with how to enable Oauth2 for FME IMAP, and can run thorugh how to do this. Thanks,

1366

1 month ago

jaygrg111_Contributor

asked in Automation

How to fix the HTTP run time error ?

Hi everybody! How can I fix the HTTP run time error? We have Publication that monitors and email Inbox. A service request on Cityworks is created when an email is received with a GIFF attachment. SR created should have the GIFF attachment but it randomly fails to attach the GIFF for some SRs. And gives HTTP time out error. I have checked the API calls and they look good in Postman. I checked with my network team as well, no issue on that side either. The log file indicates that it is 401 error- but Authentication is also intact as other SRs gets created successfully with GIFF attached. Please see the image below for errors. Any insights is highly appreciated. Thank you!

Problems using Microsoft Modern Authentication with FME Flow Email Action

FME has the capability to send email notifications to an external client and this can either be done using the Emailer transformer in FME Form or using the Email Action in Automations on FME Flow.This article https://support.safe.com/hc/en-us/articles/25407404506253-How-to-use-Microsoft-Modern-Authentication-with-FME provided by Safe Software outlines the necessary steps to enable Microsoft modern authentication for use with FME.A colleague from our IT department created an Azure AD app and assigned the necessary permissions to it. I edited the Microsoft Mail (safe.emailer) web service template according to the instructions and verified that the web connection is working as intended (by pressing the "Test" Button in the "Manage Web Service" Dialog). We can use this web connection to send emails via the Emailer transformer. Locally in FME Form as well as in workspaces running on FME Flow.Now i want to configure the email action to use the same Azure AD Tenant. Unfortunately, I'm a bit s

511

1 month ago

gorangoContributor

asked in Automation

FME 2024 1.2.1 Esri SDE Writter

Hi everyone,I am having an Issue which is hard to provoke (because it dies not happen always) and our FME support is also not getting further.We are experiencing in FME Form und Flow Version 1.2.1 in Test and Production Environment that the Workspaces with Esri Writer (after our own analysis) are failing. Also after our analysis I changed the option from persistent connection from no to yes and also installed ArcGIS Pro 3.3.2 only on test Environment.On Test Environment I have Oracle 19.24 and on Productive 19.21. with Spatial Addon and when it occurs both are sending an exception (ORA-24550: signal received: Unhandled exception: Code=c0000005 Flags=0) and FMEEngine.exe and Form exe is shutting down with Kernel Failure (windows server 2022 VM).Talked with Windows server Team - they are saying it is FME Issue caused.Talked with DB Admins - they are saying it is FME Application Issue.Talked with FME Support - they are saying it is Oracle.So hopefully someone has an Idea and can give me a

250

1 month ago

fme_can_do_itSupporter

asked in Automation

FME Flow 2023.2.2; Where to locate runtime error for the job on FME flow

We have recently upgraded FME flow to the latest 2023.2.2. I am having difficulty locating runtime errors for the job because when you click these runtime errors it will take you to the logs section where you have multiple logs. It's difficult to find which log file has this error. Previous versions directly took you to the error description while this version is not. Please guide me if I am doing anything wrong.Thank you,

1524

1 month ago

scottsContributor

asked in Automation

Kick off Workspace after fails - FME Flow

I have workspaces that are run from a job submitter in an automation. Is there away to kick off another workspace if it fails? I want to send an SQS message back to our SQS Queue with success or failure messaging. The successful message is easy but I can’t figure out how to send a failure message unless it fails though a specific transformer.

183

1 month ago

bruceharoldContributor

asked in Automation

Bulk metadata update - the full story

HiIn our recent webinar about streamlining metadata automation we got a survey question which showed I didn’t make the functionality clear:“I am not seeing how this will help. We have over 500 different layers, the bulk example showed over a hundred layers being updated but they were all the exact same layer, which is a situation in my opinion that doesn't exist for most people.”My demo indeed showed 145 portal items of the same type having their metadata updated according to some admittedly bogus business rules. I failed to make the point that any number of any item type could be handled. For example if contact detail changes meant a phone number or email contact needed to be changed you might search all items for the string to replace, or if you knew only shared items of a particular type needed license terms changed then operate on only those.Sorry for the confusion.

320

1 month ago

vishnuiamContributor

asked in Automation

I'm unable to see/select GoogleBigQuery as Reader in FME

I’m new to FME tool and I wanted to pull data from Google BigQuery tables and convert into GeoDatabase and shapefile. I'm using FME Workbench version 2024.1.1 and I'm experiencing an issue with using Google BigQuery as a reader. But I’ve installed Google BigQuery as a transformer and attempted to pull data, but no data is being retrieved. I’ve also authenticated using a service account key file, but the data still isn’t showing up.

432

1 month ago

nicholasContributor

asked in Automation

How does SystemCaller trigger a Failure in Automation?

I have an Automation on FME Server, which runs a workbench and that workbench runs a SystemCaller which runs a python script.Occasionally, the python script fails to run, and I want this failure to be recognised by the Automation, so that it sends me an email stating that it has failed.How do I do this?I can see how to set up the SystemCaller so that the Output Exit Code Attribute has a value of nonzero (representing failure)But how does this trigger the workbench to fail inside the Automation?I need the Automation to recognise the failure event so that it can generate an email stating that.

262

1 month ago

offi24Contributor

asked in Automation

Automatic Rotation of 3D Objects

Hello,I have a question on the automatic rotation of 3D objects with FME. First I placed my 3D object on different points with the workflow explained in the following tutorial: https://support.safe.com/hc/en-us/articles/25407425765133-Creating-and-Using-Geometry-Instances. Now I want to rotate the 3D objetcs (electric poles railway) in the direction of a 2D Polyline (rail axis). Is there a possibility to rotate the 3D poles rectangular to the rail axis? Best regardsEric

1 month ago

nordpilContributor

posted in Automation

Crashing the FME Server REST api v3

I am on FME Server 2022.2.8, and I have a quite big automation where the workspaces communicate through json messages. Now I have been able to replicate a crash in too machines, but I haven’t been able to isolate the exact problems. I think it might be related to https://support.safe.com/hc/en-us/articles/25407442818189-Known-Issue-FME-Server-Core-java-lang-OutOfMemoryError-Java-heap-spaceIf I start processing that involves some 100 workspaces queued and running with quite long json messages the rest api stops responding eventually (about 30 minutes in, returning 500 errors). Processing seems to continue and automation is running fine, the Server ui seems ok (I think it is relying on REST API v4).Restarting the FME (or the server) does not help the problem, but cleaning up rows in the fme_job_history table seems to help.I have worked around the problem by re-architecting the Automation to make the messages smaller, so we are in the clear now.Just if anyone else have similar problems!

170

1 month ago

Page 1 / 33

Badge winners

mpsimshas earned the badge FME Flow Authoring Training
boostpadhas earned the badge FME Form Advanced Training
boubcherhas earned the badge Welcome Back
anandakundu.scehas earned the badge Welcome Back
arun5has earned the badge Expert (Grey)

Show all badges

30,425: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.