- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow
Automation

Automation

Schedules, triggers, events, alerts, and notifications.

803 Posts
2,719 Replies

When you subscribe we will email you when there is a new topic in this category

803 Posts

Recently active

Most replies Most views Newest first

nordpilContributor

posted in Automation

Crashing the FME Server REST api v3

I am on FME Server 2022.2.8, and I have a quite big automation where the workspaces communicate through json messages. Now I have been able to replicate a crash in too machines, but I haven’t been able to isolate the exact problems. I think it might be related to https://support.safe.com/hc/en-us/articles/25407442818189-Known-Issue-FME-Server-Core-java-lang-OutOfMemoryError-Java-heap-spaceIf I start processing that involves some 100 workspaces queued and running with quite long json messages the rest api stops responding eventually (about 30 minutes in, returning 500 errors). Processing seems to continue and automation is running fine, the Server ui seems ok (I think it is relying on REST API v4).Restarting the FME (or the server) does not help the problem, but cleaning up rows in the fme_job_history table seems to help.I have worked around the problem by re-architecting the Automation to make the messages smaller, so we are in the clear now.Just if anyone else have similar problems!

1 day ago

epro_adminContributor

asked in Automation

Emailer > How to include FME Feature Attributes from workspace

Hello, I’m new to working with Flow automations and still fairly beginner level with FME. I appreciate any guidance you can provide.The WorkspaceI am working with ArcGIS Online and Field Maps. We have teams in the field everyday collecting data. At the end of the day I run a workspace that tidies up their tracklogs and calculates how many km they covered and hours spent.I’m using 2024.2 build 24783 for both Form and Flow.What I want to achieveHaving this data in the feature service isn’t enough. I also want an email summarising this information.How can I do this with Flow Automations?What I’ve triedWith the Email action I see options to send basic information like attaching the log, how much time it took to run, what time it ran, but I want more detailed information to show in the email. The information is an FME Feature Attribute created in the workspace pictured below.One colleague said it wasn’t possible in Flow and is better to do in Form using the Emailer transformer. Is that corr

201

5 days ago

xtian79Contributor

asked in Automation

FME Server 2022.2.3 is not able to run workspace with ArcGIS Pro 3.1.3

In a experimental environment I have set FME server in a machine with ArcGIS Pro. (I want to verify some expected behaviors in FME Server, with out the trouble to install ArcGIS Server)It has ArcGIS Pro 3.1.3, As the document https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility states: When I try to run the workspace, it fails, and do not even creates a log file. In the fmeprocessmonitorinengine.log I find this: Wed-13-Nov-2024 03:44:01.898 PM INFORM Thread-19972 ALGTRCPIMSDM01_Engine1 Translation Finished (service '7070'). Return message is '370430:The workspace has Python Compatibility set to 'Esri ArcGIS Python 3.7+', which requires an appropriate version of ArcGIS Pro or ArcGIS Server. If ArcGIS is not required by this workspace, then update Python Compatibility to a non-Esri-ArcGIS Python. Otherwise, please install the required ArcGIS product. Please visit https://community.safe.com/s/article/notes-on-fme-and-esri-vers

101

7 days ago

vishnuiamContributor

asked in Automation

I'm unable to see/select GoogleBigQuery as Reader in FME

I’m new to FME tool and I wanted to pull data from Google BigQuery tables and convert into GeoDatabase and shapefile. I'm using FME Workbench version 2024.1.1 and I'm experiencing an issue with using Google BigQuery as a reader. But I’ve installed Google BigQuery as a transformer and attempted to pull data, but no data is being retrieved. I’ve also authenticated using a service account key file, but the data still isn’t showing up.

321

8 days ago

joaniegeo99Contributor

asked in Automation

FME Flow: monitor network for addition of a file geodatabase

Hi,I am trying to trigger an action on FME Flow when a new file geodatabase is added to my network. So I set up a Network or Resource directory trigger to monitor for CREATE events, but when I test it it fires once for each of the files contained in my geodatabase, or about 70 times.Ultimately I want to receive the path to the geodatabase in the File Path automation attribute, in just one trigger. Any suggestions are appreciated, thanks.

232

13 days ago

mmccartContributor

asked in Automation

FME Flow 'Debug' Log Option for Workspaces in Automations

In the ‘Run Workspace Dialog, there is a ‘Log Debug’ option under ‘Advanced’ settings here: Why isn’t there an option to enable this ‘Log Debug’ in Automations when configuring the ‘Action>Run Workspace’ interface? I need debug logging details to run my automation in ‘production’ mode. It’s not honoring the logging setting when I published from FME Form. Shouldn’t the option be here: My ultimate goal is to have log files from workspaces ran within Automation have full debug logging enabled.Is there some setting in a config file I can change?Version: FME Form/Flow 2024.1.1.0 (Build 24619)

424

14 days ago

mmccartContributor

asked in Automation

Flow 2024.1.1 Automation Emailer Not Honoring Multiple 'From' Email Addresses

Disregard...found issue

15 days ago

dellerbeckContributor

asked in Automation

Automation Parameters are Resetting

If you have an existing automation and need to make a change, you make your changes and publish \\ overwrite in FME Forms. Once you go to the automation and stop it, all parameters are reset to defaults. This happens even to workspaces that were not updated. This has happened the last 2 or 3 releases, currently we are onFME Flow 2023.1Build 23619 - win64

1385

17 days ago

markcoopersdcContributor

asked in Automation

Log file not created for jobs unless admin account is logged in to the web interface

Hi We have recenly started using FME Flow more. When someone runs a flow app no log file is created. However, if the admin user logs onto the web interface and they run the app again (on the same or different pc), a log file is created. Is this expected behaviour? If not, does anyone know how to get round this? Thanks

222

20 days ago

sameerContributor

asked in Automation

FME Workspace APP - Markdown URL / Link using Target Blank

HelloI have a Workspace App in dev phase. Since I cannot embed a HTML page by design or make use of dynamic user parameters to retrieve an event ID for now, I went with the idea of using a URL / Link within the description box, (Markdown style).URL points to SP OnlineI’d like to implement target=”blank”.[link](url){:target="_blank"} (Kramdown)Is this possible? ThanksSameer

625

20 days ago

pauldeqContributor

asked in Automation

FME Flow Automation Writer

Hello, I am needing some help quickly. I am trying to create a FME Flow Automation that passes 3 attributes to the email action. The attributes are all created inside the workbench using the FME Flow Automation Writer. Each one of the attributes passes the From, To and CC data for the email action. When I run the automation, nothing comes out and the log file says the below message. I honestly have no idea why this is not working. I have looked up many resources on this site to get this to work, but i keep getting the same message. I know there is a value, why is it not working. 65 2024-10-29 07:58:41 | PermitData: Attribute name is empty for value expression ''. Ignoring expression since unable to create a blank attribute name

363

22 days ago

smclaugh1Contributor

asked in Automation

Can't write to wwwroot

I’ve been running a script on FLOW for months that unzips and deploys apps to an IIS web server by copying them to the wwwroot folder. If the app already exists and needs updating, the script backs up the existing folder, deletes it, and then deploys the new version. However, about two weeks ago, it stopped working because the Python function in the Python caller can’t delete and replace the existing directories.I have admin permissions to the wwwroot folder, and the workbench runs correctly from my computer. But when it runs from FLOW as the application account, it fails. The app account has the same permissions on the wwwroot folder as I do, and both accounts are in the admin group.I suspect a Windows update or a policy change might be causing this issue.Any ideas?

243

23 days ago

vxn43Supporter

asked in Automation

SFTP External Action in Automation question(s)

This is my first time using the SFTP External Action in an Automation. I have previously used the FTPCaller Transformer in FME Form, but sometimes it gives an SSH error. The SSH error has occurred 2x over the past 6 months. Safe Tech Support tells me it is a generic error for which they cannot find a fix. Consequently, I am looking to use SFTP External Action in my Automation that previously used a FME Form workspace to upload to the SFTP. Questions about the SFTP External Action Details in Automation:Source Path includes the path and the file name (myspreadsheet.xlsx); Is it ok to add the name of the source file in the Source Path? Destination Path includes the path and the file name (myspreadsheet.xlsx); Is it ok to add the name of the destination file in the Destination Path? Is it correct to assume that Destination Path is the same as the Transfer URL in the FTPCaller Parameters in FME Form? The SFTP site has a password, when I enter the password in Password (optional) and choose

421

27 days ago

katie.pooleContributor

asked in Automation

How to set up Automation to run Quarterly

How to set FME Flow Schedule (under Automations) to run quarterly? I’ve tried the following CRON expressions:0 0 1 */3 *and 0 0 1 3,6,9,12 *FME throws an error for both of these expressions. Is there a known work around?Note: I do not want to use Schedules.

192

27 days ago

salah.elfarissiContributor

asked in Automation

feature.getGeometryType() returning MultiGeometry instead of direct type

Hello there,I’m looking into finding how to decide on the actual geometry type of a MultiGeometry feature using python API.How to know which OGC type it is ? MultiPoint, MulitLineString or MultiPolygon.I need this for reporting on ingested data types. class FeatureProcessor(object): """Template Class Interface: When using this class, make sure its name is set as the value of the 'Class to Process Features' transformer parameter. """ def input(self, feature: fmeobjects.FMEFeature): """This method is called for each feature which enters the PythonCaller. Processed input features can be emitted from this method using self.pyoutput(). If knowledge of all input features is required for processing, then input features should be cached to a list instance variable and processed using group processing or in the close() method. """ feature_type_name = feature.getAttribute("fme_feature_type") if feature_type_name not in self.feature_

292

1 month ago

rob_m_esriukContributor

asked in Automation

FME Flow automation losing parameters with no change to model

We have 3 automations that run in parallel (with a slight time offset) and each is identical but runs workbench(1) workbench(2) and workbench(3) so they can run without clashing.One of the parameters for these is a gdb connection file reference which is stored in Resources...Data. However to load this from a workbench we have either no value or a local file path in this parameter and this is edited in the automation to reference the resource file.Periodically one of these automations (not always the same one) will start to fail because when I look the parameter has reset to the default value. There seems to be no rhyme nor reason to this. The last one to fail was number 3 so today I’ve tried to recreate that automation from scratch. What i really need is a guaranteed fix for this so it doesn’t happen when we go to production. We are processing a large queue of data and in production need all 3 streams to be active.thanksRob

573

1 month ago

ctredinnickSupporter

asked in Automation

FME Server Schedule timezones

Hi,What timezone are FME Server Schedules supposed to be operating in?I currently have a Schedule, set to “Once a Day” at 2.00am, and the job is being triggered at 1.00am each morning. After daylight savings this year, the job on the Schedule moved backward by an hour. I also currently have an Automation Trigger schedule set to “Once a Day” at 12.30am, and the job is being triggered at 1.30am. After daylight savings this year, the job on the Schedule moved forward by an hour. Last month, these were triggering at the correct time, but not any more.The Automation is running in UTC, and the Schedule’s timezone is unknown or invalid. Time jumped forward, not backward. Can these be made to respect server local time? FME Server 2022.2Build 22765

201

1 month ago

boContributor

asked in Automation

Deployment automation of Github assets using FME Flow upon Github merge events

Our team uses GitHub, VS Code and FME Workbench for our data engineering projects with good results. Now we want to leverage FME Flow to automate the deployment of FME assets upon a GitHub merge to the Staging and Production environments. I would appreciate any suggestions or experiences in this regard.

362

1 month ago

gisbradoklaEnthusiast

asked in Automation

best method email processing fgdb

I currently have a workspace that i am turning into an automation.Current workspace runs a pathname reader and samples the latest zip file in a specific folder then sends that zipped fgdb to a featurereader using path_windows attribute to get the entire file path.In the automation i am reading the initial email with attachment. I am unfamiliar with flow processes the data from email attachments. I have the attachment contains “myfilename” (I am following this tutorial) . but i will need to completely change my current workspace.I assume i just add an automation as the initiator on my featurereader. Can anyone say this is the most proficient method? Or should i process the zip file and download it to my resource folder and then run it in the same manner i have my current workspace?I don’t have a need for saving the fgdb after processing.

datamanContributor

Hello everybody!I have a server app to calculate routes. The workspace needs about 3 minutes for that and the user get an english text during the operations (calculating or something like that). But the app is in german language. Can I change those english words into german? thanks a lot in advance!

251

1 month ago

rzel24Contributor

asked in Automation

How Can I Monitor New Files in Google Drive?

Hello,So we have been using FileExistanceChecker to monitor the addition of new files into our network folders, now we want to do the same for Google Drive Folders.We were hopping someone in the community has had any previous experience on how to do this regardless of the method used.Does anyone has any suggestions on how to do this from FME Form and FME Flow?.Thanks in advance.RZ.-

433

1 month ago

cstewartfortsasContributor

asked in Automation

FeatureReader works in Form but fails in Flow (by trying to read sidecar files)

I have a workspace that filters a folder for the newest .zip file contained within and then uses a FeatureReader to extract shapefiles out of it for further processing. This works perfectly in Form but in a Flow automation where it runs off of a folder watch, it fails with '<filename>.dbf' is not a valid Shapefile and cannot be read. So apparently when operating from Flow the FeatureReader is trying to read the sidecar files. Why? And how can I tell it to stick to .shps? Thank you

687

1 month ago

chelseawuContributor

asked in Automation

How to conditionally send out email based on output of a workspace in FME automation?

Hello,I have a flow automation set up to send out email with attachment(s) from a workspace. The output from the workspace include files: f1.xlsx, f2.kmz, and some parameter (e.g. ‘kmzneeded’ with value Yes/No).The email will always send f1.xlsx, but depends on whether or not user draw on the map, then f2.kmz need to be attached. Right now, I configured to include the two file path in server in the email attachment ("$(FME_SHAREDRESOURCE_TEMP)/F1.xlsx" "$(FME_SHAREDRESOURCE_TEMP)/F2.kmz"), so it always emails two files (with incorrect kmz from previously run). Can anyone please help point me a direction how to handle this? Any information is appreciated. 🙏

9611

1 month ago

kketolaContributor

asked in Automation

Data Streaming Service -> Notify on Completion -> Post Data from Writer -> Automation FME Flow Topic Trigger

Hello Esteemed Community,I have been banging my head on this issue and have tried the help documents, this forum and the academy training to find an answer and am still stumped. I am struggling to access data that I submit with a topic through the data streaming service inside my automation via the FME Flow Topic Trigger. I have successfully tried the FMEFlowNotifier transformer just to see if I could get that working, but it does not fit in line with what I am trying to do which is to post to topics on success or failure at the end.This is what the service properties looks like: Service PropertiesAnd the JSON writer: JSON WriterI have tried access the properties both using {job_id} and {data.job_id} but the translation log shows that it uses those values as is.Value ExampleOne of the key issues I have is that I need to set the values to a custom attributes because the parameters I am using them for are number type and it won’t let me type something non-numeric. Custom Attributes on FM

726

1 month ago

kelin84Contributor

asked in Automation

Revit files is placed different places (France, correct, out of the world) although it works in ArcGIS

Hi, I have something I can’t find my way around in.We have a whole lot of Revit files. At the end we need them at ArcGIS Online as room Polygons and ghosted facades.I created a flow, that worked on the first file, but after that some works, some don’t and I can’t see the difference.I’ve testet and added the files in ArcGIS Pro and defined the correct coordinate system, and they are all placed correctly, using the exact same method, but using FME only some are placed correctly.I’m using a Feature reader using the Danish Coordinate system ESPG 4095, since that’s what have been added to the Revit file, and I’m using a feature writer using the same coordinate system.I was playing around with the Coordinate system to read, it’s not helping me at all, and why should that make any difference when it pops in perfectly in ArcGIS PRO. I hope one can help me understand this.Thanks

141

1 month ago

Page 1 / 33

Badge winners

johnthas earned the badge Student (Bronze)
johnthas earned the badge Student (Grey)
johnthas earned the badge Teacher (Bronze)
johnthas earned the badge Teacher (Grey)
charisphhas earned the badge Welcome Back

Show all badges

30,142: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.