Automation

FME Flow 2024.1 Build 24612 - distributed setup I’m raising with Safe but if anyone has any bright ideas before Vancouver wakes up :-) Recently upgraded our pre-production environment to the above version. Noticed an issue however with some jobs getting stuck in a queued state and never moving on. The jobs are triggered by automation that runs every 10 minutes and assigns the jobs to a specific queue which in turn has two engines available. Sometimes the job gets submitted and runs successfully, sometimes the job gets put in a queue where it remains forever. e.g. the job triggered at 11:20 was processed successfully, the job triggered at 11:30 ended up in the queue, the job triggered at 11:40 was processed as expected The automation log (running in debug mode) doesn’t show any errors or warnings, the queued jobs show as submitted but with no other information Other perhaps relevant information, the jobs should also expire once in the queue beyond a certain length of time and that is no

I have an workbench published in FME Flow which gathers parameters then passes them in an automation to workbenches which use them. I am using an Automations writer in it. When I try to run it in FLOW it gives the error: AUTOMATIONS writer: FME Flow error: `FME Flow error: `UNPROCESSABLE_REQUEST(Automations) Route "NewFeatureType" does not exist'' I have never used this writer type before. Does it need to be registered on the server or something?

I’m using an IMAP email trigger for an automation where I’m using the content of the email in a workbench with the goal of delivering a JSON payload to Cityworks to automatically create a new Work Order. I’ve set up a User Parameter in the workbench to receive data from the the email. When I use the “Event as JSON” option for the parameter in FME Flow, the message body is being delivered to the workbench as HTML. This crashes the JSON being delivered. Everything up to the body is fine, but the message body doesn’t make it over, and everything that follows the body is also lost. I’ve been able to get the message content into a workbench by using the individual headings such as “Email Body”, “Email Subject”, “Sent from Address” headings in Flow as the parameters to pass, but doing it this way does not allow you to use the JSON transformers in the workbench. Essentially what I am needing to do is receive JSON formatted data in a workbench from the IMAP email trigger, create attributes fro

Hi, is it possible to upload a file to the FME Flow shared resource folder through the Flow REST API? I tried to setup a POST request for fmerest/v3/resources/connections /<resource>/filesys/<path> but get a 415 Unsupported Media Type Response. I used the following parameters in Postman: In this example I want to upload the text file “test.txt” to the shared resource folder “Test”. Is there a problem with the request, or is this the wrong approach for uploading a file via the REST API? The goal would be to provide a means for external applications to upload files that are then processed by FME Flow. Thank you for your help!

hello all, I have 2 sets of data with no fields which I can join on (for Feature Merger transformer) I would like to keep the 1 set of data (ieqm2023) with its geometry and attributes and add to it the attributes ONLY from the 2nd dataset (ieqm2025) where geometry overlaps with the (ieqm2023) geometry. so for instance I want the same numbers of records (ieqm2023 - 1,880,638 ) afterwards only with more fields (from 2nd dataset) (see attached) I was thinking an Aggregator or an area on areaOverlayer transformer might work? but I have had no luck getting the correct result so far. thanks and much appreciated for any help!!

Hey. I need some directions, please. I currently have several workspaces that I need to run chronologically. They are workspaces that process data, and they include WS that perform operations on the database. What is important is that each subsequent workspace is run based on the previous ws running correctly. My idea would be a sort of queue where each succesfly status of the previous ws would trigger the ws following it. This whole thing should then run on the server. Maybe a workspacerunner? Or something else? Thanks

Hi All, I want to extract detailed log messages from FME job running on FME Flow (Ver 2021.2.3). What options are available to extract this information along with basic job information like Workspace, Repository, user, source, start and end time. etc. Appreciate any feedback. Jay

I am trying to create an automation using a trigger that watches a directory. If a file in the directory is added/created it launches an FME Workspace. However I keep getting the following error: 2024-12-14T20:10:08Z | 410109 : (Automations) Creating link from trigger...3 2024-12-14T20:10:08Z | 410108 : (Automations) Creating dirwatch trigger...4 2024-12-14T20:10:08Z | 410112 : (Automations) Unable to assemble automation. There was an issue with component "Trigger". Publisher dirwatch does not exist. The same thing happens when I try add a trigger that watches an FTP? and I get the same error when trying to add a Publication under the Notification. What am I missing? Do I need to add something special for a trigger to work? is it possible that I am missing some part of FME? I am working with a FME FLOW 2024.1that is in a Azure Kubernetes cluster. Any help or hint that could explain the error is highly appreciated.

Hi everyone, I’ve created a python script that has the docx library and arcpy library imported in it that takes field values from a GIS feature class and writes it to a docx document successfully. I would like to trigger the python script to run every time that feature class in an enterprise geodatabase is updated. I am working in the 11.3 Enterprise Environment and have come across this support page regarding implementing webhooks and FME https://support.safe.com/hc/en-us/articles/25407414850061-Integrating-ArcGIS-Enterprise-Feature-Service-Webhooks-With-FME I will attempt to do the above, but I have a simple question regarding the FME workspace itself. I have read up on the PythonCreator and PythonCaller transformers, with the PythonCreator not requiring an inpput. If all I want is an update to the GIS feature class to trigger the python script to run, would the FME workspace just have a PythonCreator with the python script in it and a logger? Or would it be more beneficial to have a

I have a process that writes a number of graphs to a folder on the network. It works great in FME Form. If I attempt to publish this workspace to FME Flow as a Job Submitter it doesn’t write the files to the folder at all like the same file does at the desktop level. The output path is set up in an RCaller so there isn’t a Writer in the .fmw script like normal. There are zero errors on the desktop side, and I have made sure the FME Flow portion no R packages are causing errors. When I run this process, I receive zero errors in Flow, but none of the files write to the directory. The end process would be that a person could upload a number of spreadsheets run this process from a webpage (Flow) and the output would show up in their department’s folder. I read in the community about it possibly writing to another directory and I attempted to check that out without success. Any help or guidance would be appreciated.

I tried to find an alternative transformer for the system caller to do the pg_dump, but even that did not work out.

Hi, When I run a workspace via an App I get the following error: Microsoft Azure SQL Database Non-Spatial Writer: A suitable Microsoft SQL Server OLE Driver is not found. Install Microsoft OLE DB Driver for SQL Server from http://www.microsoft.com/en-ca/download/details.aspx?id=56730 I can see from earlier on in the logs that it failed to connect : Microsoft Azure SQL Database Non-Spatial Writer: Failed to connect using Microsoft OLE DB Driver 19 for SQL Server. Provider error ''. When I run the same workspace from “Run workspace” it connects and runs fine: Microsoft Azure SQL Database Non-Spatial Writer: Trying to connect using Microsoft OLE DB Driver 19 for SQL Server… Microsoft Azure SQL Database Non-Spatial Writer: Starting execution of BEGIN_SQL commands I tried deleting the app and creating it again but that didn’t seem to work. TIA

I am sure that there is a solution within fme flow automation, but meanwhile I am pulling my hair for not finding it… The scenario: Through a directory watcher triggered automation, I import the content of a variety of geopackage files into postgis tables with corresponding names. This part runs well. For some of these tables, I have ElasticSearch indices, which have to be rebuilt after table import. For the indexing, I have a repo on the flow server named Elastic-Indexer, and therein are workspaces with names corresponding to some of the tables. (n.b. not all tables have corresponding indexer workspaces) Now I try to build up a dynamic system that gets notified with the schema.tablename after import and runs - if it exists - a workspace with a matching name from the Elastic-Indexer repository. My first idea was to read the workspace names from that repository and call the workspace if the name matches, but a) I was not able to read the workspace names and b) this solution looks clunky

Hello :) I have some workbenches on the FME Server 2022 and I get for all of them the error: 2024-12-11 13:37:46 | java.sql.SQLException: Query failed (#20241211_123746_28965_mxxee): Unknown transaction ID: f6d2afb3-c2fa-4417-970c-375bf47d1c9f. Possibly expired? Commands ignored until end of transaction block Is that something I can fix or is it a Server error that only admins can fix? It is some time ago I was running the workbench. I tested one on my Laptop for a small country and it went good. all other countries are too big that is why I choose the FME Server. Any suggestions of what I can do? Vanessa

We are running into issues with the user parameter file inputs for Automation Apps. In this case our end user wants to upload a new csv file every time they run the automation app, and they want to upload it from their local computer/machine. Right now the only way to accept this user input is to have the csv file uploaded to a data store in FME Server, prior to selecting it as a user parameter, and then running the automation app. We noticed that this problem doesn't happen for workspace applications and they can upload local files directly as the end user, with no need to upload it to the data store in fme server prior. Is it possible to have our end user run an automation app and upload the user parameter directly from their local machine?

I have a flow automation runs every 5 minutes, and will send out a notification email if a job failed. That becomes an issue if a problem that caused the job to fail hasn’t been resolved soon since the automation will continue to send out error email every 5 minutes. Is there any way to stop sending email after e.g. 10 emails or to reduce the frequency for sending error emails? I still want the automation to run every 5 minutes, even some job failed, but want to get just reasonable amount of error emails.

Hello everyone- Hoping that someone may be able to help with this question! Is there a way to provide a specific required JSON Response body (for example: {“status”:”OPERATION_OK} ) to a 3rd party application in response to a successful post to an FME Flow Automation with a Webhook trigger? I feel like I’m missing something obvious here…. Any help would be greatly appreciated! Mike

I have looked at this: https://knowledge.safe.com/articles/678/create-a-custom-download-link-for-results-from-dat.html I want to be able to set the exact-filename of the zip-file within FME Workbench for the download service. Si instead of the URL like this: http://fmeserver/fmedatadownload/FME_2D764B0C_1515155526785_73956.zip I want to be able to define a parameter in a workspace called: ZIPFILENAME = myfilename.zip So the Datadownloadservice serves the file: http://fmeserver/fmedatadownload/myfilename.zip In other workspaces I will have completely different zip-filenames. Any way to do this? I manage to create all the data within the correct file and use the filecopy to copy the file to the correct place (within fmedatadownload/) but I can not persuade the fME Datadownloadservice to use that zipfile and not create a random-zipfile.

Hi there, Successfully created an FME Flow Automation App (2023.1.1.1) that allows the user to upload files. However the customer doesn’t like the fact that the + Enter URL/Path link is shown.Where are the webpages stored on FME Flow? Can the html be modified to hide this link?

Hi all, We currently use imap to connect to office365. The FME Imap process currrently uses basic auth which will be disabled my Microsoft in October this year. I understand that imap with Office365 will still work, but only with modern auth OAuth2. Does anyone have any experience with how to enable Oauth2 for FME IMAP, and can run thorugh how to do this. Thanks,

Hi everybody! How can I fix the HTTP run time error? We have Publication that monitors and email Inbox. A service request on Cityworks is created when an email is received with a GIFF attachment. SR created should have the GIFF attachment but it randomly fails to attach the GIFF for some SRs. And gives HTTP time out error. I have checked the API calls and they look good in Postman. I checked with my network team as well, no issue on that side either. The log file indicates that it is 401 error- but Authentication is also intact as other SRs gets created successfully with GIFF attached. Please see the image below for errors. Any insights is highly appreciated. Thank you!

FME has the capability to send email notifications to an external client and this can either be done using the Emailer transformer in FME Form or using the Email Action in Automations on FME Flow.This article https://support.safe.com/hc/en-us/articles/25407404506253-How-to-use-Microsoft-Modern-Authentication-with-FME provided by Safe Software outlines the necessary steps to enable Microsoft modern authentication for use with FME. A colleague from our IT department created an Azure AD app and assigned the necessary permissions to it. I edited the Microsoft Mail (safe.emailer) web service template according to the instructions and verified that the web connection is working as intended (by pressing the "Test" Button in the "Manage Web Service" Dialog). We can use this web connection to send emails via the Emailer transformer. Locally in FME Form as well as in workspaces running on FME Flow. Now i want to configure the email action to use the same Azure AD Tenant. Unfortunately, I'm a bit

Hi everyone,I am having an Issue which is hard to provoke (because it dies not happen always) and our FME support is also not getting further.We are experiencing in FME Form und Flow Version 1.2.1 in Test and Production Environment that the Workspaces with Esri Writer (after our own analysis) are failing. Also after our analysis I changed the option from persistent connection from no to yes and also installed ArcGIS Pro 3.3.2 only on test Environment.On Test Environment I have Oracle 19.24 and on Productive 19.21. with Spatial Addon and when it occurs both are sending an exception (ORA-24550: signal received: Unhandled exception: Code=c0000005 Flags=0) and FMEEngine.exe and Form exe is shutting down with Kernel Failure (windows server 2022 VM).Talked with Windows server Team - they are saying it is FME Issue caused.Talked with DB Admins - they are saying it is FME Application Issue.Talked with FME Support - they are saying it is Oracle. So hopefully someone has an Idea and can give me

We have recently upgraded FME flow to the latest 2023.2.2. I am having difficulty locating runtime errors for the job because when you click these runtime errors it will take you to the logs section where you have multiple logs. It's difficult to find which log file has this error. Previous versions directly took you to the error description while this version is not. Please guide me if I am doing anything wrong. Thank you,

I have workspaces that are run from a job submitter in an automation. Is there away to kick off another workspace if it fails? I want to send an SQS message back to our SQS Queue with success or failure messaging. The successful message is easy but I can’t figure out how to send a failure message unless it fails though a specific transformer.