Automation

In FME Flow, you can set up automation so that a workspace restarts if the job fails. However, if a job is canceled (for instance, it exceeds the max. queue time), this is not possible. Or have I missed something?

Hi, I’m looking for the best way to let end users decide whether to trigger a second workspace based on result (html data stream service) from first workspace. Is it possbile at all using eg. an automation app? If possible I also want to make use of the same parameters in both workspaces to make sure the geographic extent is the same.My case is that workspace 1 runs some calculations to get costs. These costs need to be accepted by end user (Yes/No) before ruinning next workspace which produces som files. If possible I want to make use of the same parameters in both workspaces since it should make use om the same geographic extent.Thanks for any ideas

I’m not sure what version of FME Flow this feature was removed in, but in versions prior to 2023.1, there used to be a “Reset” button on the Schedules page so if any parameters were changed in the FME Workspace, you can just press the “Reset” button and it would automatically update the parameters based on the workspace.That functionality is now gone, which makes it slightly more difficult and inconvenient to update schedules.You can see in the screenshot below, that I took from an FME Server 2018 training manual, that the “Reset” button exists. But in this screenshot below in our FME Flow 2023.1 environment, the “Reset” button is not there. While it’s not a big deal, it is a minor inconvenience and I’d like to understand the logic behind Safe removing this functionality.

Good morning,I am trying to open tutorials for the Demos using this link:https://engage.safe.com/demos/When I am truing to go to the Tutorial, I have this browser window opening up:https://community.safe.com/Can someone let me know if this is an issue or there might be a different link? Thank you.

Hello. We were using some extra libraries like pymssql and Arcpy in some shutdownscripts/startupscripts on our FME Server 2021  with python2.7  and integrated the libraries with sys.path.append ("C:\\Python27\\ArcGISXX.X\\Lib\\site-packages") like in this article https://support.safe.com/s/article/importing-arcpy-troubleshooting-ideasThis was working fine.Now we should upgrade to python3.x and arcgis pro with a new Server/Flow Version.I tried the old method but this isn’t working anymore. I found this article but for the server it’s a dead link https://support.safe.com/s/article/choosing-a-different-python-interpreter-installati Is there a similar way for arcgis pro and python3 to use pymssql in FME Server/Flow?

FME Flow 2023.2.2.We are modifying most of our workspaces and automations to take advantage of deployment parameters but we are finding some difficulties to fully use them inside automations.As an example, we often write data to SFTP directories both inside workspaces and automations. FTPCaller URL, user and password can easily be configured through deployment parameters but I can’t see how to use deployment params to configure SFTP Directory external action host, port, user and password. Is there any trick to do so?If there’s no possibility to do so we’ll have to rebuild a number of workflows to write data to SFTP together with other related actions inside workspaces instead and I’d prefer to keep the SFTP Directory actions and error control inside the automations as they make the whole thing more graphic and manageable. 

I have automations that read sql tables an read the filenames in specific tables. in order to iterate through the records the automation updates a flag (i.e. PF = 0, 1, 2, 3) The automation runs on an interval and gets the next record PF=0 and sets the flag according to how far it gets through the automation. It’s seems like it would take quite a bit to rig a method to get the PF=0 count and corelate that to how many times the automation runs. I am looking for suggestions on how i could determine there are no more pf=0 records and stop the automation. Is there a transformer for Flow that will use data to stop the automation?Probably with python (right?) non python?

The connection works in FME Form, but while uploading the workspace I get the following error: Failed to update definition of database type 'Microsoft SQL Server (JDBC)' - FME Flow encountered an error and reported the following message.Database type Microsoft SQL Server (JDBC) cannot be edited.Request to https://xxxxxxxxxxxxxx/fmeapiv4/databasetypes/Microsoft SQL Server (JDBC) returned status code 422. Any tips and help greatly appreciated.

Hello All, We are currently using FME server as an integration platform. There are many FME jobs (triggered via external system call) that writes data in to database via ArcGIS portal service. Is it possible to (hold)queue all the jobs in FME server when ArcGIS enterprise will be down  ? Also, would like to know if there is a provision to hold all the jobs that is directed to a specific queue? Thanks,Naveen

Hi all,I’m having an issue getting some Flow App users to be able to successfully write to an ArcGIS SDE database. I am getting the following error.“An error occurred while attempting to retrieve the connection parameters from the connection file ‘SDE Connection’”This had previously been working fine, but with the upgrade from 2022 to 2023, connecting to SDE now requires a stored database connection, which then gets uploaded when it is published. Previously, at 2022, I think it was just storing the UNC pathing to the SDE connection file, and as long as FME Flow had access to this folder, everything was fine.Initially the App users were set up with Access permission to the Flow Workspace Apps, and nothing else. After a bit of hunting around I then added Access permission to the Connections, as this seemed like it might be necessary.But unfortunately this seems to have made no difference, and the users are still getting the same error.Are there any other permission requirements that are

Hi All,  I am seeking assistance in developing an FME workflow to perform clearance analytics for both roads and power lines in terms of trees - utility vegetation management. Our source data includes:Mobile Laser Scanner (MLS) Point Clouds: Representing the surrounding environment. The data includes the canopy and branch classification of each individual trees. Pre-defined Clearance Profiles (Vectors): Defining the acceptable clearance zones for roads and power lines. Linear Reference Data (Polylines): Representing the road edges or power line geometry.Workflow Goal:The objective is to identify and classify obstacles within the pre-defined clearance profiles. This involves:Spatial Analysis: Identify point cloud data falling within the designated clearance profiles. Obstacle Classification: Classify the identified points as potential obstacles. Obstacle Dimensioning: Measure the dimensions of the classified obstacles.Risk Assessment Output:Based on the identified obstacles, we aim to g

Hi.I’ve encountered this before, but now it blocks the saving of a 28K large table, and is so no more a mere nuisance.It seems that FME fails to catch that SQL statements fails typically due to constraints in the database. FME happily reports that all posts were saved, although none were in this case.My latest error message from the log file looks like this:Microsoft SQL Server Spatial Writer: Failed to write a feature of type `VEJLE_GADELYS.Elledning' to the database. Provider error `(-2147217873) The INSERT statement conflicted with the FOREIGN KEY constraint ...Because FME fails to catch these errors, and thus not failing in the automation, we’re putting invalid datasets into production.This is bad.

Hi All,First, I am an ArcGIS Pro/Enterprise user with the “Data Interoperability Extension” for both Pro and Enterprise.  I do not believe that I have access to FME Flow (Server).My installs on the server are ArcGIS Portal/Server and Data Interoperability at v11.3 - which installs FME…Edition: Data Interoperability, Fixed OEM LicenseVersion: FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)I want to automate a Spatial ETL tool that reads GeoJSON from a URL and ends up writing the results to an ArcGIS Online Feature Service.  I thought, why not just do it on the server and skip the exporting/importing the Web Connection from my laptop to the server? (from reading Schedule Spatial ETL tools on a server—ArcGIS Data Interoperability | Documentation for ArcGIS Enterprise)  When I created the workspace on the server with FME Workbench, everything seemed fine.  I could insert an Esri ArcGIS Online (AGOL) Feature Service writer and connect to the feature service that I wanted to write to.But

Hey everyone, On FME Server (2021.2.6) I have resources that I want to make available on an HTML page. I want users to be able click on the link and immediately download the data that's in the resource folder: https://fmeserver.EXAMPLE.com/fmeserver/#/resources/browse/FME_SHAREDRESOURCE_DATA/EXAMPLE?name=Data Seems like a pretty standard deal.

Hi,Just a quick question about this scenario:we are going to send an Email from an Automation in the case that a translation fails. To populate the body of this Email we can use several parameters (workspace name, automation name, repository name, job id, start and end time of the job, etc.). Now we would also like to add the URL of the FME Flow server to the Email body.Why? Two reasons:We have got 4 different FME Flow environments - D, T, A & Production - and we want the server who sends the email to identify itself It would be cool to add a hyperlink to the job log to the Email body and with the URL and the Job ID we would be able to compile such a linkSo, the question is: would this be possible? Where and how could we retrieve this URL? It is not a parameter in the list provided, as far as I know.Any ideas would be greatly appreciated.TIA,Egge-Jan

Is it possible to construct an FME Flow/Server (I currently have Server 2022.2) process that can monitor an Esri Enterprise (10.8.1) hosted layer?  We are trying to build something that notifies particular people when changes are made. ThanksCarl

I have an automation with several workspaces in series, the last one taking results from the previous and sending them as a series of API requests to a software. general outlinethe software has an antiforgery token that has to first be requested, then updated, so the final POST ends up being the 4th HTTP Caller. API Call WorkspaceThe problem i’m having is slowing down the rate at which concurrent API calls are happening, so if multiple requests hit at approximately the same time, one of them will fail due to not receiving a new antiforgery token.High priority has a second engine assigned only to it, and this is the only workspace that utilizes that job queueRetry Settingsi have added a queue to the workspace runner, with it’s own engine, I also added a decelerator to the beginning of the workspace with a 20 second delay  in the hopes that the “first” API workspace would complete before the second one started, but, so far it has not been effective. when it fails, it fails with an empty

Can anyone help me, I am going to build an indoor 3D model in FME through CAD floor plan, when I import the CAD drawing into FME and execute the stretch command, open the inspector I find the coordinates, and find that the values related to the coordinates are all 0, and the coordinate system is also the location, in addition, after finally converting the CAD file to CityGml format, I opened it with Notepad and found that it was all null values, how to solve it

Hello!i have an URL from a WebSocket API:wss://[IP]/api/v1/devices/[DEVICE_ID]/readings/socket?auth=[KEY]The output is a json.In the documentation of the WebSocket API is no port mentioned. I only have the URL above - that's it.Is it possible to use the trigger "WebSocket Message (received)" (Automation in FME Flow) with this URL to constantly receive data? What exactly is the stream ID in this context?Or is this the wrong way?Sorry, i'm new to this and i can't find any up-to-date guidance which gets me on the right track.We are using FME Flow 2023.2.2.Thank you very much in advance!

Hello,I am performing a data stream in FME Flow that reads two independent datasets with the same schema from the BC Wildfire Service’s (BCWS) Public ArcGIS Online Feature Service. These datasets are the BCWS current fires found on their Wildfire Dashboard:Known fire start locations (points) Wildfire perimeters (polygons)What my data stream does:(Read) Read both points and polygons of current wildfires, also read a previous copy of both datasets merged as a PostGIS table →  (FeatureJoiner) Join and overwrite points where polygons exist →  (ChangeDetector) Detect major changes from the PostGIS table: point-to-polygon updates, polygon area increases, and fire status indicators →  (Write) Write all changes to the saved copy in PostGIS, and write the major changes to a PostgreSQL update logging table.This workflow runs fine when performed manually. However I noticed when I apply the workbench to run as a data stream, my logging table will go crazy every once in a while and log every featur

Y’all.I thought it was possible to export a single automation, and install it on another server ?But now I can’t seem to find this feature anywhere (on 2022.6).They’re backed up in the general configuration backup, but you can’t restore parts like a single automations from a backup.Am I missing something ? What to do ?Cheers.

Hi - We recently set up a new server for fmeflow for a test environment. As the jobs are running, fme flow is opening source files like csv files or trying to create a new directory on the old server. The old server has the FME services turned off but it still seems like it’s reading from the old server with the old server folder path for the source location. The path of the source file is in the Resources on the new server. I’m afraid once we shutdown the old server completely, the new server with fmeflow is going to fail all the jobs. Is there a setting to change to the new server for all the path locations in Resources or something?  Thanks,Eva

Hello, I want to read AGOL polygon feature service and write in SQL server feature class. Reading is not problem, I can see the geometry but writer is only writing attributes and not geom in SQL.I am using feature writer (SQL Server Spatial) and want to understand how I can write geom in SQL table “GDB_GEOMATTR_DATA” column. Any help is appreciated. TIA 

Hello,Seeking your help, please.I have published the workbench from Desktop to FME Flow. It should extract files from S3 and do further manipulations. It works good on the desktop. But when I published it on FME Flow, I am getting an error:S3 AccessKey and Secret key are stored in the workbench as User Parameters.What is missing to make it work on FME Flow?

Hello fellow FME enthousiasts, I've run into an issue with a FME Flow parameter in FME Flow 2024.0.1:We have a automation that uses an Email-IMAP trigger to scan an email-box.Whenever a new email with a certain text in the subject gets detected, the automation get's triggered and any attachments are saved to a designated folder under 'Recources/Data’.Since the e-mail box is being used for several projects i've build in a small workspace that checks the sender, if it is from an unexpected sender the attachments and folder they are in get deleted and the automation stops.Workspaces that checks for sender, if failed deletes attachmentsAs input I use the ‘Send from Address’ and ‘Email Attachments Folder’ from the automation. With a logger in the automation i checked what the content of the ‘Email Attachments Folder’ is: $(FME_SHAREDRESOURCE_DATA)Bijlagen POC A5H\20240517134534-POC_dashboard_A5H-Fwd__Jeroen__test_bijlagen-0ac262ed-55a4-4301-b0cc-3a2e53ae76a1.When I run this through the Syst