- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow
Automation

Automation

Schedules, triggers, events, alerts, and notifications.

817 Posts
2,754 Replies

When you subscribe we will email you when there is a new topic in this category

817 Posts

snehaContributor

I am trying to do a pg_dump using command line in the system caller. It is failing, when i implemented the same command in the linux terminal, it is prompting for the password. I tried all the ways to pass the password value, nothing has worked out.

I tried to find an alternative transformer for the system caller to do the pg_dump, but even that did not work out.

7298

1 day ago

sunnywaygisParticipant

asked in Automation

Extract Detailed Job messages from FME Flow Successful/Failed Jobs

Hi All, I want to extract detailed log messages from FME job running on FME Flow (Ver 2021.2.3). What options are available to extract this information along with basic job information like Workspace, Repository, user, source, start and end time. etc. Appreciate any feedback. Jay

1 day ago

sam_appletonContributor

asked in Automation

Workbench fails when run from Flow Apps - Runs fine with "Run Workspace"

Hi,When I run a workspace via an App I get the following error:Microsoft Azure SQL Database Non-Spatial Writer: A suitable Microsoft SQL Server OLE Driver is not found. Install Microsoft OLE DB Driver for SQL Server from http://www.microsoft.com/en-ca/download/details.aspx?id=56730 I can see from earlier on in the logs that it failed to connect :Microsoft Azure SQL Database Non-Spatial Writer: Failed to connect using Microsoft OLE DB Driver 19 for SQL Server. Provider error ''. When I run the same workspace from “Run workspace” it connects and runs fine:Microsoft Azure SQL Database Non-Spatial Writer: Trying to connect using Microsoft OLE DB Driver 19 for SQL Server…Microsoft Azure SQL Database Non-Spatial Writer: Starting execution of BEGIN_SQL commands I tried deleting the app and creating it again but that didn’t seem to work. TIA

323

2 days ago

bdotfdotfmeContributor

asked in Automation

fme flow automation: how to run a workspace (name decided at runtime) if it exists?

I am sure that there is a solution within fme flow automation, but meanwhile I am pulling my hair for not finding it…The scenario:Through a directory watcher triggered automation, I import the content of a variety of geopackage files into postgis tables with corresponding names. This part runs well.For some of these tables, I have ElasticSearch indices, which have to be rebuilt after table import. For the indexing, I have a repo on the flow server named Elastic-Indexer, and therein are workspaces with names corresponding to some of the tables. (n.b. not all tables have corresponding indexer workspaces)Now I try to build up a dynamic system that gets notified with the schema.tablename after import and runs - if it exists - a workspace with a matching name from the Elastic-Indexer repository. My first idea was to read the workspace names from that repository and call the workspace if the name matches, but a) I was not able to read the workspace names and b) this solution looks clunky whe

324

3 days ago

mbaumgartnerParticipant

asked in Automation

issue with component "Trigger". Publisher dirwatch does not exist

I am trying to create an automation using a trigger that watches a directory. If a file in the directory is added/created it launches an FME Workspace. However I keep getting the following error:2024-12-14T20:10:08Z | 410109 : (Automations) Creating link from trigger...3 2024-12-14T20:10:08Z | 410108 : (Automations) Creating dirwatch trigger...4 2024-12-14T20:10:08Z | 410112 : (Automations) Unable to assemble automation. There was an issue with component "Trigger". Publisher dirwatch does not exist.The same thing happens when I try add a trigger that watches an FTP? and I get the same error when trying to add a Publication under the Notification.What am I missing? Do I need to add something special for a trigger to work? is it possible that I am missing some part of FME?I am working with a FME FLOW 2024.1that is in a Azure Kubernetes cluster.Any help or hint that could explain the error is highly appreciated.

262

3 days ago

vanessarapiorContributor

asked in Automation

Error on FME Server 2022

Hello :) I have some workbenches on the FME Server 2022 and I get for all of them the error:2024-12-11 13:37:46 | java.sql.SQLException: Query failed (#20241211_123746_28965_mxxee): Unknown transaction ID: f6d2afb3-c2fa-4417-970c-375bf47d1c9f. Possibly expired? Commands ignored until end of transaction blockIs that something I can fix or is it a Server error that only admins can fix? It is some time ago I was running the workbench. I tested one on my Laptop for a small country and it went good. all other countries are too big that is why I choose the FME Server. Any suggestions of what I can do?Vanessa

232

9 days ago

kyle_fiaccoObserver

asked in Automation

Automation vs Workspace App User Parameter Upload File

We are running into issues with the user parameter file inputs for Automation Apps. In this case our end user wants to upload a new csv file every time they run the automation app, and they want to upload it from their local computer/machine. Right now the only way to accept this user input is to have the csv file uploaded to a data store in FME Server, prior to selecting it as a user parameter, and then running the automation app. We noticed that this problem doesn't happen for workspace applications and they can upload local files directly as the end user, with no need to upload it to the data store in fme server prior. Is it possible to have our end user run an automation app and upload the user parameter directly from their local machine?

221

9 days ago

chelseawuContributor

asked in Automation

How to stop automation to send out error emails after it exceed a certain number?

I have a flow automation runs every 5 minutes, and will send out a notification email if a job failed. That becomes an issue if a problem that caused the job to fail hasn’t been resolved soon since the automation will continue to send out error email every 5 minutes.Is there any way to stop sending email after e.g. 10 emails or to reduce the frequency for sending error emails? I still want the automation to run every 5 minutes, even some job failed, but want to get just reasonable amount of error emails.

243

10 days ago

mpittingerContributor

asked in Automation

Provide specific response body to Webhook POST from 3rd party app

Hello everyone-Hoping that someone may be able to help with this question!Is there a way to provide a specific required JSON Response body (for example: {“status”:”OPERATION_OK} ) to a 3rd party application in response to a successful post to an FME Flow Automation with a Webhook trigger? I feel like I’m missing something obvious here….Any help would be greatly appreciated!Mike

774

10 days ago

sigtillContributor

asked in Automation

Datadownload - change filename on ZIP

I have looked at this: https://knowledge.safe.com/articles/678/create-a-custom-download-link-for-results-from-dat.htmlI want to be able to set the exact-filename of the zip-file within FME Workbench for the download service. Si instead of the URL like this: http://fmeserver/fmedatadownload/FME_2D764B0C_1515155526785_73956.zipI want to be able to define a parameter in a workspace called:ZIPFILENAME = myfilename.zipSo the Datadownloadservice serves the file:http://fmeserver/fmedatadownload/myfilename.zipIn other workspaces I will have completely different zip-filenames.Any way to do this? I manage to create all the data within the correct file and use the filecopy to copy the file to the correct place (within fmedatadownload/) but I can not persuade the fME Datadownloadservice to use that zipfile and not create a random-zipfile.

1436

11 days ago

nedwatermanContributor

asked in Automation

Alter FME Flow App webpage

Hi there,Successfully created an FME Flow Automation App (2023.1.1.1) that allows the user to upload files. However the customer doesn’t like the fact that the + Enter URL/Path link is shown.Where are the webpages stored on FME Flow? Can the html be modified to hide this link?

271

11 days ago

sossie07Participant

asked in Automation

IMAP oauth2 for Office365

Hi all, We currently use imap to connect to office365. The FME Imap process currrently uses basic auth which will be disabled my Microsoft in October this year. I understand that imap with Office365 will still work, but only with modern auth OAuth2. Does anyone have any experience with how to enable Oauth2 for FME IMAP, and can run thorugh how to do this. Thanks,

1296

15 days ago

jaygrg111_Contributor

asked in Automation

How to fix the HTTP run time error ?

Hi everybody! How can I fix the HTTP run time error? We have Publication that monitors and email Inbox. A service request on Cityworks is created when an email is received with a GIFF attachment. SR created should have the GIFF attachment but it randomly fails to attach the GIFF for some SRs. And gives HTTP time out error. I have checked the API calls and they look good in Postman. I checked with my network team as well, no issue on that side either. The log file indicates that it is 401 error- but Authentication is also intact as other SRs gets created successfully with GIFF attached. Please see the image below for errors. Any insights is highly appreciated. Thank you!

Problems using Microsoft Modern Authentication with FME Flow Email Action

FME has the capability to send email notifications to an external client and this can either be done using the Emailer transformer in FME Form or using the Email Action in Automations on FME Flow.This article https://support.safe.com/hc/en-us/articles/25407404506253-How-to-use-Microsoft-Modern-Authentication-with-FME provided by Safe Software outlines the necessary steps to enable Microsoft modern authentication for use with FME.A colleague from our IT department created an Azure AD app and assigned the necessary permissions to it. I edited the Microsoft Mail (safe.emailer) web service template according to the instructions and verified that the web connection is working as intended (by pressing the "Test" Button in the "Manage Web Service" Dialog). We can use this web connection to send emails via the Emailer transformer. Locally in FME Form as well as in workspaces running on FME Flow.Now i want to configure the email action to use the same Azure AD Tenant. Unfortunately, I'm a bit s

441

21 days ago

gorangoContributor

asked in Automation

FME 2024 1.2.1 Esri SDE Writter

Hi everyone,I am having an Issue which is hard to provoke (because it dies not happen always) and our FME support is also not getting further.We are experiencing in FME Form und Flow Version 1.2.1 in Test and Production Environment that the Workspaces with Esri Writer (after our own analysis) are failing. Also after our analysis I changed the option from persistent connection from no to yes and also installed ArcGIS Pro 3.3.2 only on test Environment.On Test Environment I have Oracle 19.24 and on Productive 19.21. with Spatial Addon and when it occurs both are sending an exception (ORA-24550: signal received: Unhandled exception: Code=c0000005 Flags=0) and FMEEngine.exe and Form exe is shutting down with Kernel Failure (windows server 2022 VM).Talked with Windows server Team - they are saying it is FME Issue caused.Talked with DB Admins - they are saying it is FME Application Issue.Talked with FME Support - they are saying it is Oracle.So hopefully someone has an Idea and can give me a

210

22 days ago

fme_can_do_itSupporter

asked in Automation

FME Flow 2023.2.2; Where to locate runtime error for the job on FME flow

We have recently upgraded FME flow to the latest 2023.2.2. I am having difficulty locating runtime errors for the job because when you click these runtime errors it will take you to the logs section where you have multiple logs. It's difficult to find which log file has this error. Previous versions directly took you to the error description while this version is not. Please guide me if I am doing anything wrong.Thank you,

1494

22 days ago

scottsContributor

asked in Automation

Kick off Workspace after fails - FME Flow

I have workspaces that are run from a job submitter in an automation. Is there away to kick off another workspace if it fails? I want to send an SQS message back to our SQS Queue with success or failure messaging. The successful message is easy but I can’t figure out how to send a failure message unless it fails though a specific transformer.

163

23 days ago

bruceharoldContributor

asked in Automation

Bulk metadata update - the full story

HiIn our recent webinar about streamlining metadata automation we got a survey question which showed I didn’t make the functionality clear:“I am not seeing how this will help. We have over 500 different layers, the bulk example showed over a hundred layers being updated but they were all the exact same layer, which is a situation in my opinion that doesn't exist for most people.”My demo indeed showed 145 portal items of the same type having their metadata updated according to some admittedly bogus business rules. I failed to make the point that any number of any item type could be handled. For example if contact detail changes meant a phone number or email contact needed to be changed you might search all items for the string to replace, or if you knew only shared items of a particular type needed license terms changed then operate on only those.Sorry for the confusion.

310

24 days ago

vishnuiamContributor

asked in Automation

I'm unable to see/select GoogleBigQuery as Reader in FME

I’m new to FME tool and I wanted to pull data from Google BigQuery tables and convert into GeoDatabase and shapefile. I'm using FME Workbench version 2024.1.1 and I'm experiencing an issue with using Google BigQuery as a reader. But I’ve installed Google BigQuery as a transformer and attempted to pull data, but no data is being retrieved. I’ve also authenticated using a service account key file, but the data still isn’t showing up.

412

25 days ago

nicholasContributor

asked in Automation

How does SystemCaller trigger a Failure in Automation?

I have an Automation on FME Server, which runs a workbench and that workbench runs a SystemCaller which runs a python script.Occasionally, the python script fails to run, and I want this failure to be recognised by the Automation, so that it sends me an email stating that it has failed.How do I do this?I can see how to set up the SystemCaller so that the Output Exit Code Attribute has a value of nonzero (representing failure)But how does this trigger the workbench to fail inside the Automation?I need the Automation to recognise the failure event so that it can generate an email stating that.

242

25 days ago

offi24Contributor

asked in Automation

Automatic Rotation of 3D Objects

Hello,I have a question on the automatic rotation of 3D objects with FME. First I placed my 3D object on different points with the workflow explained in the following tutorial: https://support.safe.com/hc/en-us/articles/25407425765133-Creating-and-Using-Geometry-Instances. Now I want to rotate the 3D objetcs (electric poles railway) in the direction of a 2D Polyline (rail axis). Is there a possibility to rotate the 3D poles rectangular to the rail axis? Best regardsEric

29 days ago

nordpilContributor

posted in Automation

Crashing the FME Server REST api v3

I am on FME Server 2022.2.8, and I have a quite big automation where the workspaces communicate through json messages. Now I have been able to replicate a crash in too machines, but I haven’t been able to isolate the exact problems. I think it might be related to https://support.safe.com/hc/en-us/articles/25407442818189-Known-Issue-FME-Server-Core-java-lang-OutOfMemoryError-Java-heap-spaceIf I start processing that involves some 100 workspaces queued and running with quite long json messages the rest api stops responding eventually (about 30 minutes in, returning 500 errors). Processing seems to continue and automation is running fine, the Server ui seems ok (I think it is relying on REST API v4).Restarting the FME (or the server) does not help the problem, but cleaning up rows in the fme_job_history table seems to help.I have worked around the problem by re-architecting the Automation to make the messages smaller, so we are in the clear now.Just if anyone else have similar problems!

150

1 month ago

epro_adminContributor

asked in Automation

Emailer > How to include FME Feature Attributes from workspace

Hello, I’m new to working with Flow automations and still fairly beginner level with FME. I appreciate any guidance you can provide.The WorkspaceI am working with ArcGIS Online and Field Maps. We have teams in the field everyday collecting data. At the end of the day I run a workspace that tidies up their tracklogs and calculates how many km they covered and hours spent.I’m using 2024.2 build 24783 for both Form and Flow.What I want to achieveHaving this data in the feature service isn’t enough. I also want an email summarising this information.How can I do this with Flow Automations?What I’ve triedWith the Email action I see options to send basic information like attaching the log, how much time it took to run, what time it ran, but I want more detailed information to show in the email. The information is an FME Feature Attribute created in the workspace pictured below.One colleague said it wasn’t possible in Flow and is better to do in Form using the Emailer transformer. Is that corr

261

1 month ago

xtian79Contributor

asked in Automation

FME Server 2022.2.3 is not able to run workspace with ArcGIS Pro 3.1.3

In a experimental environment I have set FME server in a machine with ArcGIS Pro. (I want to verify some expected behaviors in FME Server, with out the trouble to install ArcGIS Server)It has ArcGIS Pro 3.1.3, As the document https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility states: When I try to run the workspace, it fails, and do not even creates a log file. In the fmeprocessmonitorinengine.log I find this: Wed-13-Nov-2024 03:44:01.898 PM INFORM Thread-19972 ALGTRCPIMSDM01_Engine1 Translation Finished (service '7070'). Return message is '370430:The workspace has Python Compatibility set to 'Esri ArcGIS Python 3.7+', which requires an appropriate version of ArcGIS Pro or ArcGIS Server. If ArcGIS is not required by this workspace, then update Python Compatibility to a non-Esri-ArcGIS Python. Otherwise, please install the required ArcGIS product. Please visit https://community.safe.com/s/article/notes-on-fme-and-esri-vers

131

1 month ago

joaniegeo99Contributor

asked in Automation

FME Flow: monitor network for addition of a file geodatabase

Hi,I am trying to trigger an action on FME Flow when a new file geodatabase is added to my network. So I set up a Network or Resource directory trigger to monitor for CREATE events, but when I test it it fires once for each of the files contained in my geodatabase, or about 70 times.Ultimately I want to receive the path to the geodatabase in the File Path automation attribute, in just one trigger. Any suggestions are appreciated, thanks.

242

1 month ago

Page 1 / 33

Badge winners

gazmanhas earned the badge Welcome Back
miguelhacarhas earned the badge Spanish Speaker
miguelhacarhas earned the badge Student (Grey)
miguelhacarhas earned the badge Expert (Grey)
miguelhacarhas earned the badge Teacher (Grey)

Show all badges

30,351: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.