- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow
Automation

Automation

Schedules, triggers, events, alerts, and notifications.

803 Posts
2,719 Replies

When you subscribe we will email you when there is a new topic in this category

803 Posts

Recently active

Most replies Most views Newest first

pmcphersonContributor

asked in Automation

It is possible to set up multiple CRON triggers in a single Automation AND use JSON messages from upstream block set by an embedded Automations writer?

Is it possible to use multiple CRON triggers in the same Automation, also while "passing" values from one workspace block to another using values from an embedded Automations writer? Essentially I would like to set up a single Automation that triggers at a given time, completes a number of steps, and then "waits" for a second CRON trigger to continue with additional steps, and with the additional steps part of the routine using a value from an upstream block.

362

2 years ago

dustinInfluencer

asked in Automation

Access permissions - FME Server

I have a workbench that is reading in FFS files as source. The files are located at a network location that required permissions from IT under our logins to access, \\\\serverloc\\folder\\source.ffs. Everything works as expected from Desktop. The issue is when we upload the workbench to FME Server. The error is Invalid Dataset '\\\\serverloc\\folder\\source.ffs'. Dataset must exist prior to reading. We have spoken with the admin of FME Server, who said they added a service account that is used for the FME Services to access that network location. We are getting the same error. What steps need to be taken to allow FME Server access to read from this location?

1091

2 years ago

rishi1804Contributor

asked in Automation

I am creating an FFS after doing some filtering with a DGN file but along with the FFS file, my workbench is creating an FRS file as well. Why is this happening? And it doesn't happen with all the DGN files.

@david_r @Hans van der Maarel @safesoftware safesoftware

Workspace Apps and Gallery Apps

I have created workspace apps and then used them to create my gallery app. If I then update the original workspace and re-publish it, do I need to recreate both the workspace apps and then the gallery app to get the updated workspace?

141

2 years ago

marnickcleContributor

asked in Automation

Inability to use the output of an automations Writer as input for a password user parameter

Hi, I'm trying to use the output of an Automations Writer (workspace 0) as input for the next workspace (1). For the two 'Text' User Parameters, I can use the drop down menu and choose the 'SFTP_Username' Attribute of the Automations Writer as the input for the next Workspace. However, for the 'Password' User Parameter, the is no drop down menu to choose the 'SFTP_Password' Attribute of the Automations Writer. I have tried inserting it as '{route.ConnectionParameters.SFTP_Password}' and this did not work. Any suggestions would be highly appreciated! Regards

2 years ago

jrprororo

asked in Automation

How does passing params in a POST request to a manually triggered automation actually work?

Hello, I'm trying to set up an automation that runs a workbench that has one parameter that needs to be passed through. I am running this automation from a manual trigger. I have configured a post request that can hit the trigger successfully, however, I am having trouble getting the param value from the request into my automated workbench. I have read all of the documentation and articles on keys that I could find, but as far as I can tell it's not really clear how these values are passed through. I am currently trying to trigger through the server web UI. My manual trigger has a manual key named 'input_id', and I have mapped this to the workbench parmas on the tick branch, that shows 'manual.input_id'. However, when I trigger the workbench with valid JSON containing as below, it does run the workbench, but fails as the param is passed in as '{manual.input_id'} rather than feeding my JSON attribute value in. {"input_id":"1234567890&quot

2 years ago

louielou1234Participant

asked in Automation

Email sent already Counter?

Hi There, I have a workbench that sends an email 24 hours after a certain event occurs. However, the email gets sent everytime the workbench runs and I do not want to spam people, so I only want to send ONE email every 24 hours --but I want to be able to run the workbench often (to check for new events and send out email reminders after 24 hours to those people). --How can I check to see if an email has ALREADY been sent out? That way I only send them ONE email per time period (24 hours in this case) even if the workbench runs many times per day? THANKS FOR ANY HELP HERE! Lewis

2 years ago

rishi1804Contributor

asked in Automation

Is there any way to keep myself logged in to the FME server? It logs me out after a particular time period. Will the automation keep running even if I log out? I don't want my automation to be stopped in any condition.

@safesoftware safesoftware @keziaatsafe

2 years ago

jackydContributor

asked in Automation

Automation not Saving after upgrade to 2022.0.0.1

We updated our test server to 2022, from 2021, yesterday. Since then i have been unable to save an automation with a action to run a workspace.I noted that an automation I had set up had lost its directory watch path after the update. I added the path a tried a saving but it seems to get stuck and just sits there with the spinning wheel going round. I left it last night when I left work and it was still spinning the wheel when I logged in this morning.I have tried recreating the automation and had no trouble saving until I tried to an action to run a workspace.I have tried republishing the work space, and using a different work spaceThe automation will save with just the directory watch trigger and a series of filter actions, but fails when I try to add a Run workspace action.So I'm stumped

2510

2 years ago

annette2Contributor

asked in Automation

Automation passes through the parameter key if the parameter is not provided

I have an FME workspace on FME Server 2021 that writes a dwg file. The workspace has multiple parameters including 2 that are mandatory: FILENAME and EMAIL. We want to send an email on success or failure and I have set this up via an automation. This automation will be triggered via the rest api. In the automation 2 of the parameters are passed from the trigger via 2 manual keys. When I manually trigger the automation with a json file and only supply one mandatory parameter (EMAIL) the workspace still continues assigning the output filename to be automation key manual.FILENAME. If run manually via Run workspace it fails. What is the best way to handle this? Should I just test that the parameters are valid via the workspace? Or is there anyway to test if the parameters have been supplied via the automation. Thanks, Annette

I want to let an external source (excel-sheet) determine which attributes to write.

Though both the schemamapper and a pythoncaller can accomplish to create, map and 'remove' attributes, the newly mapped attributes are hidden and the removed attributes are still exposed (with only missing values). When I write this to excel I get empty columns but the columns are still created. I don't want to use the hide attributes option in the pythoncaller; I want the attributes to be written and not written to be dependent on a list I read from another file.

5211

2 years ago

dbryantgeoContributor

asked in Automation

SFTP Modified Automation

We've recently upgraded to FMEServer 2019.1 and are attempting to use the FTP Modified automation step to watch a data suppliers server so that our workbench runs when they drop data.Now I know there are differences between FTPES/FTPS and SFTP (which our supplier uses). Should I be able to use the FPT Modified automation to directory watch their server if we normally connect over SFTP? I am currently unable to connect and getting failures for "SSL error occurred. Verify port number and security type are correct."I know the port and host IP's are correct, as are the username and password. Is it as simple as our supplier allowing FTPS/FTPES encryption or is there another potential issue?

744

2 years ago

kbraun77Contributor

asked in Automation

How to update or refresh a materialized view?

I am trying to start a scheduled automation to run a refresh script daily, but it is just not working in FME. Trying to run:REFRESH MATERIALIZED VIEW CONCURRENTLY gis.map_filters_mvw WITH DATA; Thank you,Kevin

Automatically generating time variables

Hello. I have a workspace that runs locally, which takes two user inputs (stored as user parameters) - a start date (the first date of the PREVIOUS month) and end date (last date of the previous month). When the workspace is run it asks for each date from the user, and they would provide them as '01/03/2022', for example. The dates are then fed into an SQLExecutor and used to help query our database. The workspace is run each month. I would like to run this process automatically on FME server, but to do this obviously a user can't manually specify dates. I therefore need a way for the bench to generate the start and end dates of the previous calendar month. The bench would always be run on or after the first day of the CURRENT month, but not always on the same day (so I can't just use today's date minus a day, for example). I'd prefer to do this in FME, but if it has to be done in the SQLExecutor query that would be fine as well. Thanks in advance.Liam Riddy

1064

2 years ago

pmcphersonContributor

asked in Automation

Pass datetime value in Webhook JSON Body to datetime workspace?

I have a working Automation that is triggered by either a Schedule block or a Webhook block. It includes a number of "run workspace" actions in series, the first of which currently includes user parameters with values that are fixed in the Automation, one of which is a datetime parameter. I would like to pass a datetime value in the body of the webhook POST, but it appears the first workspace block does not show the "Use a value from upstream keys" for the datetime user parameter, presumably because it is not an ordinary string. Is there a way to accomplish this without changing the user parameter in the workspace to an ordinary string?

281

2 years ago

lancecContributor

asked in Automation

Notifications - how to run a workspace on FME Server 2018 using parameter from Directory Watch

I have a directory watch on a network folder and I can successfully trigger the subscription by adding a file to that folder. I can see that the workspace is triggered as well. However, what I'm still trying to figure out is how to pass the path and file name of the zip file placed in it to the workspace. What would the input parameter need to be set as in the workspace? Currently I have it set to a published user parameter with no default value. In the subscription configuration, the "Source Zip File" parameter is set to "Get Value from Topic Message". However, that parameter evaluations to the path of the JSON file created with the topic is published to, not the zip file path. From the log:FME Configuration: Command line arguments are `fme' `Test\\LaTaxTableImportForDirectoryWatcherWBR\\LaTaxTableImportForDirectoryWatcherWBR.fmw' `--SourceZip' `$(FME_SHAREDRESOURCE_SYSTEM)temp/subscriptions/c2177f37ebd94805bd9717d51d228e46.json' `--FME_TOP

2 years ago

lopes8

asked in Automation

FME Server Automation isn't seeing Workspace Parameters

I am trying to setup a workspace automation but when i point it to the workspace i want to run it says there are "No Parameters Available" for me to establish. However, when i navigate to the Workspace itself (outside of an automation) I see all of the parameters. I recently upgraded to FME Server 2021.2 and am using Workbench 2021.2 as well. It is an existing Workspace that was authored in a previous release. I opened it in 2021.2 and published it. I copied the contents into an entirely new workspace and published that with the same issue. I authored a simple workspace (XLS->FFS) and the Parameters showed up as expected so I think it may be something to do with the Workspace. It is rather large and I dont want to have to redo the entire thing. Any help would be much appreciated.

In my automation I want to include the server name in my success / fail emails. That way from the email you can determine if the emails is coming from the dev / test / production server. Can not find the server name as one of the keys available.

111

2 years ago

lorindaParticipant

asked in Automation

Setting Time for Trigger in an Automation

Hi All,Running an automation to pull data from an external SFTP site to be post processed with multiple other workspaces.I've set the time per my server at 4:15 am (and tried 4:30am, now trying 5am), have checked my server, it is set to EST (UTC - 4 since we are in DST now). Schedule trigger states that it uses the local time on the FME server). Looking at the SFTP thin client website, the data says that it was uploaded at 4am today. When looking at the same SFTP site via WinSCP, it says that it was uploaded at 12am today.My automation appears to be working as it should by processing all of the data. However, it is consistently having the previous week's data (it is only uploaded to the SFTP site once a week and I process only once a week). What time should I really be using for getting this data? When I trigger the automation after 8am EST it picks up the currently shown data (although it is dropping it on the server with the 12am timestamp). I would have thought that i

441

2 years ago

aguanContributor

asked in Automation

What is the best way to interrupt the start of a workspace in the automation chain?

Suppose I have two workspaces A, and B that run sequentially in a scheduled job. I want to start B if A actually runs through and writes something to the writer. If nothing writes in A, I don't want B to start at all. I could think of a few ways to do it, but all require writing intermediate status data to an external file or database. Should there be a simpler way to do this in the FME server automation (I am at 2021.1.2)? Is it possible to do this in the startup python script - if a condition is not met, terminate the workspace?

How to automate the process on retrieving attributes from CityGML

I would like to automate the following processes by a batch job or equivalent. Please advise if you have any idea. Here are the steps what I am working now. Firstly, load the CityGML to a FME workbranch by the "Reader".Secondly, select fme_basename and fme_feature_type in the "Reader" setting.Thirdly, I will select excel file in the writer and link up the "Reader" and "Writer".Finally, go to "Run" > "Run Entire Workspace" to export the result and the following is the result sample.

2 years ago

f.kemminjeContributor

asked in Automation

system caller running for ever

I used rets-connecter runner to download the source data(CSV file) from vendor , and after that fme will read this file for further process. But My System Caller running forever, it's not coming out, executing continuously.. But in command line , it executes immediately and come to the Drive prompt(i mean E:\temp>) fmw file attached.Can Anyone pls help Command line to run this workspace: "E:\Program Files\FME2021\fme.exe" E:\FME_TEMP\wb-xlate-1647675806459_11696 --FME_LAUNCH_VIEWER_APP "YES" Starting translation...Current FME version: FME 2021.2.1.0 (20211203 - Build 21797 - WIN64)FME_HOME is 'E:\Program Files\FME2021\'FME Database Edition (node locked-crc)Serial Number: Z6XB-SJY8-15LXPermanent License.Machine host name is: PXLLTPRD276Locale: en_INSystem Encoding: windows-1252FME Configuration: FME_BASE is 'no'FME Configuration: FME_MF_DIR is 'E:\FME_TEMP/'FME Configuration: FME_MF_NAME is 'wb-xlate-1647675806459_11696'FME Configuration: FME_PRODUCT_NAME is 'F

Seeking solution for Workbench STEP by STEP guidance

PROBLEM 1 if in column TYP the value is PL than do nothing (keep the cell G1, H1, I1 empty) ******************************************** PROBLEM 2 if in column TYP the value is PEthan calculate value in "x1 in (m)" check condition "F is W" or "F is E" or F is S" here the condition is "F is W" so fill in default value from "Y in (m)" to "y1 in (mm)" and from "Z in (m)" to "z1 in (m)" FORMULA to calculate/obtain value in "x1 in (m)" i.e. 1960.85 from the DIM in (mm) always select the first value before "x" for i.e. 600 and convert it from millimeter (mm) into meter (m) i.e. 600/1000 = 0.6 now add the result i.e. "X in (m)" + "0.6" ******************************************** PROBLEM 3 if in column TYP the value is HOthan calculate value in "y1 in (m)" check condition "F is W" or "F is E" or F is S" here the condition is "F

2 years ago

mustafa.salah

asked in Automation

How can I compress the output of Automation Action as zip file?

Hello I have an automation action that generates some files inside the FME Server 2021 Data folder, I need to zip the output folder after the action is complete. Can some one please advise? e.g. after the action is complete, all results will be populated in $(FME_SHAREDRESOURCE_DATA)/ALIM3263/destination/Extraction/I want to compress whatever files in the extraction folder as one single zip file and save it to:$(FME_SHAREDRESOURCE_DATA)/ALIM3263/destination/Compression/

How can we automate the process to download a specific file type from Azure Blob Storage Containers. Additionally how to create an alert when a files/containers are uploaded/downloaded/deleted.

Hi everyone,I would be happy if somebody can give a thought to address the issue on automating FME. Presently, I am processing .csv files in FME to create some spatial data (points/lines). Problem is the .csv files are located inside Azure Blob storage containers along with several datasets. I am manually finding out the latest containers to download the csv file to local directory and then processing the same using FME workbenches. I have already added a AzureBlobStorage Container in FME and connection parameters successfully, but not getting a sense how to download all the csv files automatically from all containers and store it to a local or temp directory to process further. My Flow is --Creator > AzureBlobStorageConnector Additionally trying to find out any possible way to create a mail or other alert system, so that, whenever new data would be uploaded/downloaded/deleted to Azure, it will show up in fme.

1591

2 years ago

Page 15 / 33

Badge winners

whichwayisnorthhas earned the badge Student (Grey)
gzanotto_gahas earned the badge Integrate Spatial Data
john_locushas earned the badge Welcome Back
reedwhithas earned the badge Conversationalist
mwarren_esricahas earned the badge Welcome Back

Show all badges

30,149: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.