- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow
Automation

Automation

Schedules, triggers, events, alerts, and notifications.

804 Posts
2,720 Replies

When you subscribe we will email you when there is a new topic in this category

804 Posts

Recently active

Most replies Most views Newest first

nking

asked in Automation

FME Server Automated Workflow Question

I have a workflow that consists of several different municipalities of input parcel data that will all be delivered at different times. The steps of the workflow are as follows: Load raw data into a GDBETL the data into target schema and load into municipality-specific GDBRun a validation on the dataLoad individual municipalities into an aggregated single feature class in a single gdb. I ultimately have to deploy these workspaces to FME server and have the entire workflow run for JUST a single municipality upon data delivery for that municipality. I have it set up so that the ETL and validations for each municipality are separated out into municipality specific workspaces. What I am wondering is if it is possible to build all of the different municipalities into a single initial data load ETL, and a single aggregation ETL and still ONLY have the whole process for the municipality that was delivered run (and not all of the other ones that don't have a new data delivery)? The alter

4 years ago

nic_ranContributor

asked in Automation

How to include the log file URL in an Automation email

I'd like to send an email upon completion of a workspace in an Automation. The email needs to contain a link to the log file URL.In the traditional Notification/Subscription workflow I could achieve this by using the {logUrl} email template key in the Subscription.In Automations, this key no longer exists and I only have access to the {job.log} key, which expands out to the file path and not the URL. I don't see any URL in the topic JSON if I monitor a topic sent as output from the completion of the workspace. Is the URL available at all?

How do I read multiple access database files in a workspace?

I have a workspace where I am checking to see if features exist and if not I create them. In the workspace I read one table from a database and then join it to another table in the same database (join conditions to inspections). Currently I change the name of the Database manually in the reader and rerun the entire workspace. All my database files are in the same folder but have different names. I would like to be able to run a batch process that would process each database one at a time and then move to the next. Any help is much appreciated.

How to convert a shape file to dwg file according to a dwg library

I need to convert a shape file to dwg file where each layer in the shape file has to have line style or symbol according to a library in the dwg. I see that I can use dwg styler but i need to import each layer separtely ,as i have more than 60 levels ,i need to divide my file to 60 files in order to do it also it doesn't take the color for the symbol from the dwg template file.Is there a way to do it in one file?thanks in advance

4 years ago

1spatialmary

asked in Automation

Is there a way to control order of processing/dependency within an automation?

I have an automation workflow (FME Server 2019) built from a number of workspaces that process an input file. The automation is triggered by a file landing in a directory (directory watch), and the data passes through the workspaces and gets loaded to the database at the end (if follows the happy path), else someone gets notified for a fail, etc. This works great for 1 file end-to-end, but when multiple files land in the directory, the first file runs through workspace A, then second file runs through workspace A,.. rather than first file runs through workspace A, then workspace B,.. completing all before second file runs. Is there a way to include this dependency? I've tried adding a merge action, but this doesn't accept it as everything is in sequence there are no parallel streams, and I'm asking it to run/continue regardless of pass or fail of workspace action.Is this possible within latest version?The reason I need one file to be processed end-to-end is because some of

AreaGapAndOverlapCleaner

HI, I have couple of elements in microstation DGN, there is overlap error in a element (x=105676.2218, y=64384.1729 ) . I need to remove that overlap automatically. Both elements are of type Complexshape. I tried the transformer AreaGapAndOverlapCleaner but ended up with failure . I am sending the DGN file as well as workbench. Kindly help me to resolve this issue.

Get info from all unknown addresses from API.

I want to get all data in the API, which I do not know what is. For example, i know that there is one package with information at this address:https://objektkatalog.geonorge.no/api/package/EAID_A408BF17_3017_41c7_BC37_D6AADDD6634B But I do not know the EAID for all packages, so I want to get everything from:https://objektkatalog.geonorge.no/api/package/ I'm currently using the httpCaller. Does someone know how to do this? Thanks a lot!

4 years ago

pascalmortz

asked in Automation

run a workspace in response to an incoming email

HII m trying to experiment "run a workspace in response to an incoming email, i have a problem with the IMAP configuration.although i use the template (for gmail for instance) and enter my email address and password) my automation do not work i have this message :809009 : pascal.mortz@gmail.com : Failed to connect to email server. Please check IMAP settings, and ensure IMAP is enabled for the email account. Error message: [AUTHENTICATIONFAILED] Invalid credentials (Failure)this is my configuration :I authorize IMAP Access in gmail account parameters.Mays someone help ?Regards

4 years ago

mackenziebudda

asked in Automation

I'm looking to iterate through a transformer that only accepts one input at a time.

I'm trying to compute a CHM (canopy height model) by using the rastercellcalc transformer by having it subtract a DEM from a DSM. The process works fine when only one DEM and DSM are passed through to the transformer at a time however I have these DEM/DSM's clipped to multiple smaller files. The CHM produced should have the same boundaries as the inputted DEM and DSM. I've tried using the group by parameter in the transformer however it doesn't work for some reason and still tells me that the raster rows and columns don't match. See images below:The attribute manager and trimmer transformers just create a shared attribute between the correct DSM and DEM tiffs tiffs so that the rastercell transformer can do group by "Tile_name). See below:

4 years ago

geomaxContributor

asked in Automation

Reading and add in my automated process a shapefile and .dbf present on line and zipped.

I would to read a shapefile and .dbf present in the url http://www.sardegnageoportale.it/index.php?xsl=2425&s=325563&v=2&c=14414&t=1&tb=14401 and zippedI read that using a reader I can do it (https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Workbench/Workbench/zip_files_url.htm), but I don't understand where I am wrong and I am not able to set the correct string in the reader. Please, can you help me?Thanks Max

4 years ago

matija

asked in Automation

How to conflate value based on matching ID

So, I have two datasets:Linear - contains names - short linear segments in close proximity to polygonsPolygons - unnamed The goal is to conflate names from linear to polygonal. I have buffered to lines to conflate names from linear to polygonal data and it worked fine. The problem is that the linear segments are short and only capture the feature where they are located and one river can contain up to 50 individual features. All of these features (polygonal) have a unique Feature_ID but more importantly, they have a RIVER_ID. The RIVER_ID is the same for one water body (river). For example, 30 differing individual features will have the same RIVER_ID since they are representing the same river. So, let's say that the river in question is Danube and it has 20 features. Now, only 13 of them were captured by the linear segments and are now named whilst the rest are unnamed. How can I use that RIVER_ID to transfer the name from the named ones to the unnamed ones? I have tried aggregatin

131

4 years ago

vkiContributor

asked in Automation

Reset Status of automations

In the "Automations > Manage"-list theres a column "Status", where the number of errors / warnings in the automations are listed. In FME-Server 2019.2.1 it was possible to remove those numbers by clearing the automation-logfile.In FME-Server 2020 it's not possible to clear the logfile anymore. So how can I remove the numbers of errors/warnings in the Automations-List?The "clear Log"-button has gone, but there's a new "Log action" button instead. What is this for? It doesn't seem to do anything...? Thanks, Vera

303

4 years ago

lazarlubomirContributor

asked in Automation

FME Server - automations - how to attach CSV to e-mail?

Hello everyone, Im little bit confused , or perhaps my mind is frozen.Im setting the automation for XML -> CSV file conversion. But, I cant find possibility, how to specify CSV file, which should be send as attachment. Its all because of CSV writer parameter - there is only definition of CSV export folder, not the CSV export file. Can anybody help me please?Thanks!Lubo

504

4 years ago

fmeuser_gcContributor

asked in Automation

Downloading multiple files using PythonCaller

Trying to download multiple files using multiple URLs in PythonCaller. I couldn't use HTTPCaller due to security issues. Please suggest. Thanks

219

4 years ago

jurgenmackContributor

asked in Automation

Is there a way to limit the directory monitoring automation to fire when the files i am interested in changes?

I am monitoring several directories that have multiple files in them. Whenever any file changes my automation runs. Example Directory contains the files that make up a shape file. The automation will fire for every file in the directory that changes.(5)

4 years ago

imrans

asked in Automation

Adding multiple tabular data to single geometry in shape file

I have two sets of input data.World graphic data in polygonWorld tabular data in CSV I want to add multiple tabular data in country wise graphical polygon data by putting a join on country name. The desired output will be each single polygon with multiple attribute data from CSV. I have used "Feature_Merger" & "Feature_Joiner" but the output is not as per expectations. The feature merger adds all the attributes in a list file which I am finding it difficult to write in shapefile as attribute data. The feature joiner just add polygon data to all the CSV records. Please suggest if someone has done anything in such condition. Thanks in advance.

174

4 years ago

asked in Automation

Does the XSLTProcessor support XSLT stylesheets of version 2.0?

Hello everyone, A customer of mine has created a lot of XSLT stylesheets which we want to apply to our XML documents. We would like to use FME for the automation part (download XML, apply stylesheet, write result and push to server). However I seem to receive an error when applying XSLT stylesheets of version 2.0. Version 1.0 stylesheets work as expected but the workflow throws an error as soon as it encounters a function that is only present in XSLT 2.0 (like lower-case or upper-case).The stylesheets that I used to test the workflow both work as expected outside of the FME workflow. Is XSLT 2.0 currently not supported? Or am I missing something?I am using FME 2020.0 - Build 20238 - WIN64.

FME Server Automation w/ Autodesk Vault

Does anyone have experience building out a FME Server Automation with a trigger based on changes in Autodesk Vault? I was thinking a Directory Watch would be the way to go, but my IT group doesn't seem to think a directory path exists for the files in Vault. If it matters, Vault and the files therein are stored on local servers (not on the cloud). Any information is appreciated.

4 years ago

asellarsParticipant

asked in Automation

Send notification when 0 features are written

Hi everyone and thank you in advance! I currently have a job set up on the server where data is being written to an ArcGIS Portal service from multiple outside sources using Topics/Notifications/Subscriptions. I would like to find a way to set it up to send a notification when the job runs and 0 features are written. The job does not fail when 0 features are written so I would like to find a way to notify me (probably using another topic/notification setup) when nothing is written to the service. Let me know what you think!

FME Server Directory Update

How do I set the reader parameter to read the correct data directory on the server where the data is to be placed?

4 years ago

davebarter

asked in Automation

Emailer Mime Type - Custom filename

I want to email a file attachment but the filename is passed through a custom value:-@Value(_dataset)/litmap-@DateTimeFormat(@DateTimeNow(), %B-%d-%Y).csvWhen I enter this in the Emailer transformer it goes red as per the screenshot but I cannot see how to read the error. And also cannot see how to set mime type as text/csv

When does the unzip process take place when using unzip parameter opt_extractarchive in Data Upload Service

We are uploading large zip files containing a folder structure like this, but much more folders and files in it.Folder1- file1- file 2Folder 2:-file3- file4 The upload is done with the Data Upload Service and we are using the parameter opt_extractarchive to automatically unzip all files.In a next step, a FME service will go through the unzipped file structure on the server and process these files. We have realized that FME does not process part of the uploaded files, there is always a list of files which are not processed. But with every upload, the files not processed are changing, sometimes the first 30 files are processed well and the next 25 are missing, sometimes the first 35 files are ok...Could it be that the unzip happens after the upload, and when we start the processing job, maybe not all files are unzipped yet?We have this issue only with large zip folder structures (they contain a lot of pdf files and images in it).

4 years ago

f.kemminjeContributor

asked in Automation

How to find out which subscription is connected to fme server's topic ?

Is there any way ?, that I can find out the subscription connected to topic. from subscription , i can see the topic name. but not other way. in my case , there are many subscriptions and topics. So from fme workbench i get topic name, but from the topic name , i cannot extract / know the subscription name

153

4 years ago

dbaldacchino1Contributor

asked in Automation

Automation Logs - filtered data

Hi,So I've been experimenting with this automation where an external application triggers a webhook and passes a message. I then filter the content by looking for the existence of a string and then trigger a topic if found and also log it. If it fails, another filter is applied and another topic is triggered and logged. And finally the same happens with another topic if all filtering fails. The goal of the log at each stage was to help in debugging but I'm finding that ALL logs are identical and that was definitely not my expectation. Shouldn't log actions only work and store data if actually triggered through a connection? Or am I misunderstanding how the new log action works? This is in FME Server 2020.1 beta. Thanks.

update hundreds of schedules' parameter value

Hello, I need to update one parameter for all my schedules (about 300 active schedules). I'm looking for the easiest way for that. I tried to do it manually on FME configuration DB but I can see then even though parameters are updated still schedule is executed with old values. It takes effect only after editing schedule using FME Web Portal, then I can see updated value and when I click save schedule is updated. I believe that this is because of some kind of cache mechanism on fme scheduling system. So is there any way to force FME to reread values of parameters (for example by restarting some components?). Please keep in ming that I have a lot of engines on different machines. Second option that comes to my ming is to use REST API but it is not as easy as executing update script on DB. And executing script on DB has advantage that it can be a transaction so either I have all schedules updated or none. Using REST API doesn't give me that out of the box. Thanks for any hints!

4 years ago

Page 22 / 33

Badge winners

dvattelanahas earned the badge Integrate Spatial Data
dvattelanahas earned the badge FME Form Basic Training
wdfitouthas earned the badge English Speaker
aurelienhas earned the badge Welcome Back
aurelienhas earned the badge FME Form Basic Training

Show all badges

30,152: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.