Skip to main content

Automation

Schedules, triggers, events, alerts, and notifications.

  • 871 Posts
  • 2,926 Replies
871 Posts
anteboy65
Contributor
anteboy65Contributor
asked in Automation
Best way of syncronizing job between 2 servers?

We are slowly moving from an old platform to a newer, in this case FME 2018 to FME 2023. We cant move all our scripts at the same time so we need to find a solution that can be handled over a period of time. We have a lot of flows which uses a startscript and a lot of subscripts. Each flow is dependent on that specific other flows has ended before next one starts. Example: We have three flows, A, B and C. A must be done before B can start. B must be done before C can start and so on. In todays solution we run the flows on the same engine which will secure that some flows has ended before next one starts. All our jobs are scheduled but it doesn’t matter if flow A is taken a little longer time than normal because even if flow B is scheduled to run 02:00 AM but flow A finishes at 02:25 AM, flow B is queued and will start as soon as flow A ends. But if we just move flow B to the new server we have a little problem. It can’t start before flow A is finished which runs on the old server. What

485
anteboy65
Contributor
stezi
Contributor
steziContributor
asked in Automation
Rerun canceled job automatically

In FME Flow, you can set up automation so that a workspace restarts if the job fails. However, if a job is canceled (for instance, it exceeds the max. queue time), this is not possible. Or have I missed something?

675
keziaatsafe
Safer
albjoh
Contributor
albjohContributor
asked in Automation
Let end users decide whether to trigger a second workspace based on results form first workspace?

Hi, I’m looking for the best way to let end users decide whether to trigger a second workspace based on result (html data stream service) from first workspace. Is it possbile at all using eg. an automation app? If possible I also want to make use of the same parameters in both workspaces to make sure the geographic extent is the same. My case is that workspace 1 runs some calculations to get costs. These costs need to be accepted by end user (Yes/No) before ruinning next workspace which produces som files. If possible I want to make use of the same parameters in both workspaces since it should make use om the same geographic extent. Thanks for any ideas

12212
siennaatsafe
Safer
ryanuthoff
Contributor
ryanuthoffContributor
asked in Automation
Why was the "Reset" button removed from FME Flow Schedules?

I’m not sure what version of FME Flow this feature was removed in, but in versions prior to 2023.1, there used to be a “Reset” button on the Schedules page so if any parameters were changed in the FME Workspace, you can just press the “Reset” button and it would automatically update the parameters based on the workspace. That functionality is now gone, which makes it slightly more difficult and inconvenient to update schedules. You can see in the screenshot below, that I took from an FME Server 2018 training manual, that the “Reset” button exists. But in this screenshot below in our FME Flow 2023.1 environment, the “Reset” button is not there. While it’s not a big deal, it is a minor inconvenience and I’d like to understand the logic behind Safe removing this functionality.

633
sleschi
Contributor
mechomicky_bmcd
Contributor
mechomicky_bmcdContributor
asked in Automation
Sending an HTTP Response to a Webhook in Automations

Is there any way possible to send an HTTP Response after receiving a webhook trigger in FME Flow Hosted Automations? I am attempting to set up an automation that runs in response to webhooks coming from Monday.com, however before I can start configuring the actual webhooks, monday.com requires verification that I have control of the endpoint. I need to do this by having the platform send a JSON challenge to the endpoint URL, which must then be responded to with an identical JSON POST body. I believe it must also be returned with a status of 200. Documentation on setting up monday.com webhooks here. I have tried to accomplish this by adding a workspace after the webhook trigger to pull the IP address that the challenge request was sent from from the HTTP headers, and then using an HTTPCaller to send a POST request with the JSON challenge body to that IP address, but this is not working - the request just times out.

2795
ridleyj
Contributor
serg42932
Contributor
serg42932Contributor
asked in Automation
Can't open Demos Toturials.

Good morning, I am trying to open tutorials for the Demos using this link: https://engage.safe.com/demos/ When I am truing to go to the Tutorial, I have this browser window opening up: https://community.safe.com/ Can someone let me know if this is an issue or there might be a different link? Thank you.

763
donalmateer
Safer
clemensb
Contributor
clemensbContributor
asked in Automation
Using Arcpy python3.x and additional libraries like pymssql

Hello. We were using some extra libraries like pymssql and Arcpy in some shutdownscripts/startupscripts on our FME Server 2021 with python2.7 and integrated the libraries with sys.path.append ("C:\\Python27\\ArcGISXX.X\\Lib\\site-packages") like in this article https://support.safe.com/s/article/importing-arcpy-troubleshooting-ideas This was working fine. Now we should upgrade to python3.x and arcgis pro with a new Server/Flow Version. I tried the old method but this isn’t working anymore. I found this article but for the server it’s a dead link https://support.safe.com/s/article/choosing-a-different-python-interpreter-installati Is there a similar way for arcgis pro and python3 to use pymssql in FME Server/Flow?

885
lifalin2016
Contributor
dms2
Contributor
dms2Contributor
asked in Automation
Deployment parameters and external actions in automations

FME Flow 2023.2.2. We are modifying most of our workspaces and automations to take advantage of deployment parameters but we are finding some difficulties to fully use them inside automations. As an example, we often write data to SFTP directories both inside workspaces and automations. FTPCaller URL, user and password can easily be configured through deployment parameters but I can’t see how to use deployment params to configure SFTP Directory external action host, port, user and password. Is there any trick to do so? If there’s no possibility to do so we’ll have to rebuild a number of workflows to write data to SFTP together with other related actions inside workspaces instead and I’d prefer to keep the SFTP Directory actions and error control inside the automations as they make the whole thing more graphic and manageable.

474
dms2
Contributor
gisbradokla
Enthusiast
gisbradoklaEnthusiast
asked in Automation
How to stop an automation when no features are left?

I have automations that read sql tables an read the filenames in specific tables. in order to iterate through the records the automation updates a flag (i.e. PF = 0, 1, 2, 3) The automation runs on an interval and gets the next record PF=0 and sets the flag according to how far it gets through the automation. It’s seems like it would take quite a bit to rig a method to get the PF=0 count and corelate that to how many times the automation runs. I am looking for suggestions on how i could determine there are no more pf=0 records and stop the automation. Is there a transformer for Flow that will use data to stop the automation? Probably with python (right?) non python?

414
lifalin2016
Contributor
hermann
Contributor
hermannContributor
asked in Automation
Error: Failed to update definition of database type 'Microsoft SQL Server (JDBC)'

The connection works in FME Form, but while uploading the workspace I get the following error: Failed to update definition of database type 'Microsoft SQL Server (JDBC)' - FME Flow encountered an error and reported the following message.Database type Microsoft SQL Server (JDBC) cannot be edited.Request to https://xxxxxxxxxxxxxx/fmeapiv4/databasetypes/Microsoft SQL Server (JDBC) returned status code 422. Any tips and help greatly appreciated.

892
steveatsafe
Safer
naveen
Contributor
naveenContributor
asked in Automation
FME flow - Jobs Queueing

Hello All, We are currently using FME server as an integration platform. There are many FME jobs (triggered via external system call) that writes data in to database via ArcGIS portal service. Is it possible to (hold)queue all the jobs in FME server when ArcGIS enterprise will be down ? Also, would like to know if there is a provision to hold all the jobs that is directed to a specific queue? Thanks, Naveen

441
virtualcitymatt
Celebrity
keithhastings
Contributor
keithhastingsContributor
asked in Automation
Flow App users accessing database connections

Hi all, I’m having an issue getting some Flow App users to be able to successfully write to an ArcGIS SDE database. I am getting the following error. “An error occurred while attempting to retrieve the connection parameters from the connection file ‘SDE Connection’” This had previously been working fine, but with the upgrade from 2022 to 2023, connecting to SDE now requires a stored database connection, which then gets uploaded when it is published. Previously, at 2022, I think it was just storing the UNC pathing to the SDE connection file, and as long as FME Flow had access to this folder, everything was fine. Initially the App users were set up with Access permission to the Flow Workspace Apps, and nothing else. After a bit of hunting around I then added Access permission to the Connections, as this seemed like it might be necessary. But unfortunately this seems to have made no difference, and the users are still getting the same error. Are there any other permission requirements tha

916
keithhastings
Contributor
gyulafekete
Participant
gyulafeketeParticipant
asked in Automation
Road clearance based on potincloud

Hi All, I am seeking assistance in developing an FME workflow to perform clearance analytics for both roads and power lines in terms of trees - utility vegetation management. Our source data includes: Mobile Laser Scanner (MLS) Point Clouds: Representing the surrounding environment. The data includes the canopy and branch classification of each individual trees. Pre-defined Clearance Profiles (Vectors): Defining the acceptable clearance zones for roads and power lines. Linear Reference Data (Polylines): Representing the road edges or power line geometry. Workflow Goal: The objective is to identify and classify obstacles within the pre-defined clearance profiles. This involves: Spatial Analysis: Identify point cloud data falling within the designated clearance profiles. Obstacle Classification: Classify the identified points as potential obstacles. Obstacle Dimensioning: Measure the dimensions of the classified obstacles. Risk Assessment Output: Based on the identified obstacles, we aim

652
danilo_fme
Evangelist
lifalin2016
Contributor
lifalin2016Contributor
asked in Automation
FME fails to catch failure of MS/SQL Server INSERT statements

Hi. I’ve encountered this before, but now it blocks the saving of a 28K large table, and is so no more a mere nuisance. It seems that FME fails to catch that SQL statements fails typically due to constraints in the database. FME happily reports that all posts were saved, although none were in this case. My latest error message from the log file looks like this: Microsoft SQL Server Spatial Writer: Failed to write a feature of type `VEJLE_GADELYS.Elledning' to the database. Provider error `(-2147217873) The INSERT statement conflicted with the FOREIGN KEY constraint ... Because FME fails to catch these errors, and thus not failing in the automation, we’re putting invalid datasets into production. This is bad.

1715
lifalin2016
Contributor
arepsherbentear
Contributor
arepsherbentearContributor
asked in Automation
FME Workbench on Server Missing Python SLL Module?

Hi All, First, I am an ArcGIS Pro/Enterprise user with the “Data Interoperability Extension” for both Pro and Enterprise. I do not believe that I have access to FME Flow (Server). My installs on the server are ArcGIS Portal/Server and Data Interoperability at v11.3 - which installs FME… Edition: Data Interoperability, Fixed OEM LicenseVersion: FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64) I want to automate a Spatial ETL tool that reads GeoJSON from a URL and ends up writing the results to an ArcGIS Online Feature Service. I thought, why not just do it on the server and skip the exporting/importing the Web Connection from my laptop to the server? (from reading Schedule Spatial ETL tools on a server—ArcGIS Data Interoperability | Documentation for ArcGIS Enterprise) When I created the workspace on the server with FME Workbench, everything seemed fine. I could insert an Esri ArcGIS Online (AGOL) Feature Service writer and connect to the feature service that I wanted to write to.But

1082
arepsherbentear
Contributor
bkgg
Contributor
bkggContributor
asked in Automation
Placing a link on a webpage to download data

Hey everyone, On FME Server (2021.2.6) I have resources that I want to make available on an HTML page. I want users to be able click on the link and immediately download the data that's in the resource folder: https://fmeserver.EXAMPLE.com/fmeserver/#/resources/browse/FME_SHAREDRESOURCE_DATA/EXAMPLE?name=Data Seems like a pretty standard deal.

3284
andrewj74
Supporter
egge
Contributor
eggeContributor
asked in Automation
Adding URL of FME Flow server to Email from Automation?

Hi, Just a quick question about this scenario: we are going to send an Email from an Automation in the case that a translation fails. To populate the body of this Email we can use several parameters (workspace name, automation name, repository name, job id, start and end time of the job, etc.). Now we would also like to add the URL of the FME Flow server to the Email body. Why? Two reasons: We have got 4 different FME Flow environments - D, T, A & Production - and we want the server who sends the email to identify itself It would be cool to add a hyperlink to the job log to the Email body and with the URL and the Job ID we would be able to compile such a link So, the question is: would this be possible? Where and how could we retrieve this URL? It is not a parameter in the list provided, as far as I know. Any ideas would be greatly appreciated. TIA, Egge-Jan

927
redgeographics
Celebrity
cstewartfortsas
Contributor
cstewartfortsasContributor
asked in Automation
Monitoring an Esri Hosted layer

Is it possible to construct an FME Flow/Server (I currently have Server 2022.2) process that can monitor an Esri Enterprise (10.8.1) hosted layer? We are trying to build something that notifies particular people when changes are made. Thanks Carl

714
cstewartfortsas
Contributor
parke372
Contributor
parke372Contributor
asked in Automation
API Call Concurrency issue

I have an automation with several workspaces in series, the last one taking results from the previous and sending them as a series of API requests to a software. general outline the software has an antiforgery token that has to first be requested, then updated, so the final POST ends up being the 4th HTTP Caller. API Call Workspace The problem i’m having is slowing down the rate at which concurrent API calls are happening, so if multiple requests hit at approximately the same time, one of them will fail due to not receiving a new antiforgery token. High priority has a second engine assigned only to it, and this is the only workspace that utilizes that job queue Retry Settings i have added a queue to the workspace runner, with it’s own engine, I also added a decelerator to the beginning of the workspace with a 20 second delay in the hopes that the “first” API workspace would complete before the second one started, but, so far it has not been effective. when it fails, it fails with an em

1142
parke372
Contributor
changge
Contributor
changgeContributor
asked in Automation
Find CAD coordinates in FME and use CAD to build a 3D model

Can anyone help me, I am going to build an indoor 3D model in FME through CAD floor plan, when I import the CAD drawing into FME and execute the stretch command, open the inspector I find the coordinates, and find that the values related to the coordinates are all 0, and the coordinate system is also the location, in addition, after finally converting the CAD file to CityGml format, I opened it with Notepad and found that it was all null values, how to solve it

1045
evieatsafe
Safer
resch
Contributor
reschContributor
asked in Automation
How to use an Websocket-API-URL in FME Flow?

Hello! i have an URL from a WebSocket API:wss://[IP]/api/v1/devices/[DEVICE_ID]/readings/socket?auth=[KEY] The output is a json.In the documentation of the WebSocket API is no port mentioned. I only have the URL above - that's it. Is it possible to use the trigger "WebSocket Message (received)" (Automation in FME Flow) with this URL to constantly receive data? What exactly is the stream ID in this context?Or is this the wrong way? Sorry, i'm new to this and i can't find any up-to-date guidance which gets me on the right track. We are using FME Flow 2023.2.2. Thank you very much in advance!

1251
steveatsafe
Safer
nwisla_fness
Participant
nwisla_fnessParticipant
asked in Automation
Logging changes only when data is read

Hello, I am performing a data stream in FME Flow that reads two independent datasets with the same schema from the BC Wildfire Service’s (BCWS) Public ArcGIS Online Feature Service. These datasets are the BCWS current fires found on their Wildfire Dashboard: Known fire start locations (points) Wildfire perimeters (polygons) What my data stream does: (Read) Read both points and polygons of current wildfires, also read a previous copy of both datasets merged as a PostGIS table → (FeatureJoiner) Join and overwrite points where polygons exist → (ChangeDetector) Detect major changes from the PostGIS table: point-to-polygon updates, polygon area increases, and fire status indicators → (Write) Write all changes to the saved copy in PostGIS, and write the major changes to a PostgreSQL update logging table. This workflow runs fine when performed manually. However I noticed when I apply the workbench to run as a data stream, my logging table will go crazy every once in a while and log every feat

290
nwisla_fness
Participant
lifalin2016
Contributor
lifalin2016Contributor
asked in Automation
How to transfer a single automation to another server ?

Y’all. I thought it was possible to export a single automation, and install it on another server ? But now I can’t seem to find this feature anywhere (on 2022.6). They’re backed up in the general configuration backup, but you can’t restore parts like a single automations from a backup. Am I missing something ? What to do ? Cheers.

892
lifalin2016
Contributor
evagardner
Contributor
evagardner
asked in Automation
Fme flow - pointing to old server

Hi - We recently set up a new server for fmeflow for a test environment. As the jobs are running, fme flow is opening source files like csv files or trying to create a new directory on the old server. The old server has the FME services turned off but it still seems like it’s reading from the old server with the old server folder path for the source location. The path of the source file is in the Resources on the new server. I’m afraid once we shutdown the old server completely, the new server with fmeflow is going to fail all the jobs. Is there a setting to change to the new server for all the path locations in Resources or something? Thanks, Eva

576
hkingsbury
Celebrity
muditagarwal100
Contributor
muditagarwal100Contributor
asked in Automation
FME geometry wiring issues for AGOL feature service data loading in to SQL Server feature class

Hello, I want to read AGOL polygon feature service and write in SQL server feature class. Reading is not problem, I can see the geometry but writer is only writing attributes and not geom in SQL. I am using feature writer (SQL Server Spatial) and want to understand how I can write geom in SQL table “GDB_GEOMATTR_DATA” column. Any help is appreciated. TIA

441
trentatsafe
Safer

Helpful Members This Week

Badge Winners

Show all badges

Popular Tags

Community Stats

31,139
Posts
118,062
Replies
38,758
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.