Automation

Hi all. I am working on an automation triggered by Survey123 submissions based on webhooks. The initial part is working ok, but I am running into some strange behaviour:As it is now I have an automation with a webhook trigger that starts an action to run a workspace. This workspace parses the data from the webhook, sorts the input into various outputs depending on choices made in Survey123 and sent data to separate FME Flow Automations.Each of the outputs contain two attributes; one with a code for how the registration will be handled further downstream and one with the globalid for the Survey123 submission. To check the output I have set up one message logger and one emailer on the output route in my automation. The message definition to the logger and the email body are identical, but the globalid is only written to the log, not to the email (where I get _undefined_) 

We recently upgraded to FME Flow 2024.0 and have been struggling with an issue where access to a number of our ArcGIS Server services is being denied at the Flow level.  We were first able to circumvent this by using on-network calls using HTTP however a recent job where we use a PythonCaller to geocode addresses is failing when we attempt to hit our Address Point Locator.  Job works as expected in Form, and we have ArcGIS Server working on the FME hosts, in addition to the ArcGIS Server host that has our working services. Has anyone else experienced this so we might know where to look?  Sounds like HTTPS/SSL but I am not sure where to begin to work with our Network Engineers.  Thank you,Nicholas 36 2024-4-2 14:19:09 | Message Type: fme::internal::_v0::py::Exception 237 2024-4-2 14:19:09 | Python Exception <ExecuteError>: Failed to execute. Parameters are not valid. 238 2024-4-2 14:19:09 | ERROR 000005: Could not open the address locator. 239 2024-4-2 14:19:09 | Failed

Hello, I would like to automate a process on IFC files analysis in order to generate an Excel report per IFC file. To do this, I use the workspacerunner by giving a directory which contains all the IFC files to analyze. But I can't write Excel files in this same directory. I created an attribute containing the target directory name, but I cannot give it to my "destination data" transformer.How is it possible to customize the "destination data" transformer ?Thank in advanceBest regardsBruno

Hi, is it possible to upload a file to the FME Flow shared resource folder through the Flow REST API? I tried to setup a POST request for https://fme.oebb.at/fmerest/v3/resources/connections/<resource>/filesys/<path> but get a 415 Unsupported Media Type Response. I used the following parameters in Postman:In this example I want to upload the text file “test.txt” to the shared resource folder “Test”. Is there a problem with the request, or is this the wrong approach for uploading a file via the REST API? The goal would be to provide a means for external applications to upload files that are then processed by FME Flow. Thank you for your help!

Hi!I need help in configuring FME Form to run RCaller.FME is not local in my machine; instead, I'm remoting in to a server to run Form from there. It's prompting me this error message:    RCaller (InlineQueryFactory): Failed with exit code 1 when executing R script. Output was: Error in library("sqldf") : there is no package called 'sqldf'    Execution halted    Failed to execute scripted code.I followed the steps indicated in https://docs.safe.com/fme/2017.0/html/FME_Desktop_Documentation/FME_Transformers/Transformers/rcaller.htm. I configured the default paths and R Plugin files in: "C:\Program Files\R\R-4.4.1\bin\Plugins" and the Plugins folder contains the following files:    assertthat    BH    bit    bit64    blob    chron    DBI    digest    gsubfn    magrittr    memoise    pkgconfig    plogr    prettyunits    proto    RCpp    RSQLite    sqldfI am not sure what's causing the error. Any help or piece of advice greatly appreciated.Thanks,Wilfredo 

Hello Forum., This sounds like it’s a straightforward function. I’ve looked but can’t see an obvious way of doing it. I’m looking at FME Flow>Schedules>Manage Schedules. I want to be able to see the last time that a selected schedule item actually run. A bonus would be to see a successful/not successful flag too. Alternatively, this information could be captured in a log. But there doesn’t appear to be log option on that page, nor is there a column stating last time run. Or am I just missing it? Thanks,Stuart   

Hi,  I am using FME Flow (desktop) and I need to make workspace for producing map reports (image or PDF) like a layout in QGIS or ArcGIS, but as I know it is not so easy. What I need:a basemap (preferred areal, but standard would be good as well)  visualize my line layer georeferenced on the top of it some additional informations (tables, map legend etc.) around the map Does anyone know an easy solution/approach fir this, or FME is simply not for such a visualization and I should search for other tools to do it?  Thanks for the help!  

Hello,I’m trying to write files into a Shared Network Folders via an automation in FME Flow running a workspace.The Shared Network Folders were mounted onto the VM Server and then added to the Resources in the FME Flow app with the credentials from “user1”.After adding the shared network folders to the Resources in FME Flow I can see the files and folders inside them and I can download and read the files and folders via the FME Flow interface without problems. But when I’m trying to upload files/folders or create a folder directly in the share it gives me an error indicating issues with access rights. I find it weird that I can see, read and download folders but not upload them, but I guess it is because the credentials used by FME Flow to access the shared network folders are not the ones from “user1” but from the service user account that FME Flow uses, like “fmflow” user or something like that.Question is how can I find out what is the user used by FME Flow to access the shared netw

We are slowly moving from an old platform to a newer, in this case FME 2018 to FME 2023. We cant move all our scripts at the same time so we need to find a solution that can be handled over a period of time. We have a lot of  flows which uses a startscript and a lot of subscripts. Each flow is dependent on that specific other flows has ended before next one starts. Example:We have three flows, A, B and C. A must be done before B can start. B must be done before C can start and so on. In todays solution we run the flows on the same engine which will secure that some flows has ended before next one starts. All our jobs are scheduled but it doesn’t matter if flow A is taken a little longer time than normal because even if flow B is scheduled to run 02:00 AM but flow A finishes at 02:25 AM, flow B is queued and will start as soon as flow A ends. But if we just move flow B to the new server we have a little problem. It can’t start before flow A is finished which runs on the old server. What

In FME Flow, you can set up automation so that a workspace restarts if the job fails. However, if a job is canceled (for instance, it exceeds the max. queue time), this is not possible. Or have I missed something?

Hi, I’m looking for the best way to let end users decide whether to trigger a second workspace based on result (html data stream service) from first workspace. Is it possbile at all using eg. an automation app? If possible I also want to make use of the same parameters in both workspaces to make sure the geographic extent is the same.My case is that workspace 1 runs some calculations to get costs. These costs need to be accepted by end user (Yes/No) before ruinning next workspace which produces som files. If possible I want to make use of the same parameters in both workspaces since it should make use om the same geographic extent.Thanks for any ideas

I’m not sure what version of FME Flow this feature was removed in, but in versions prior to 2023.1, there used to be a “Reset” button on the Schedules page so if any parameters were changed in the FME Workspace, you can just press the “Reset” button and it would automatically update the parameters based on the workspace.That functionality is now gone, which makes it slightly more difficult and inconvenient to update schedules.You can see in the screenshot below, that I took from an FME Server 2018 training manual, that the “Reset” button exists. But in this screenshot below in our FME Flow 2023.1 environment, the “Reset” button is not there. While it’s not a big deal, it is a minor inconvenience and I’d like to understand the logic behind Safe removing this functionality.

Good morning,I am trying to open tutorials for the Demos using this link:https://engage.safe.com/demos/When I am truing to go to the Tutorial, I have this browser window opening up:https://community.safe.com/Can someone let me know if this is an issue or there might be a different link? Thank you.

Hello. We were using some extra libraries like pymssql and Arcpy in some shutdownscripts/startupscripts on our FME Server 2021  with python2.7  and integrated the libraries with sys.path.append ("C:\\Python27\\ArcGISXX.X\\Lib\\site-packages") like in this article https://support.safe.com/s/article/importing-arcpy-troubleshooting-ideasThis was working fine.Now we should upgrade to python3.x and arcgis pro with a new Server/Flow Version.I tried the old method but this isn’t working anymore. I found this article but for the server it’s a dead link https://support.safe.com/s/article/choosing-a-different-python-interpreter-installati Is there a similar way for arcgis pro and python3 to use pymssql in FME Server/Flow?

FME Flow 2023.2.2.We are modifying most of our workspaces and automations to take advantage of deployment parameters but we are finding some difficulties to fully use them inside automations.As an example, we often write data to SFTP directories both inside workspaces and automations. FTPCaller URL, user and password can easily be configured through deployment parameters but I can’t see how to use deployment params to configure SFTP Directory external action host, port, user and password. Is there any trick to do so?If there’s no possibility to do so we’ll have to rebuild a number of workflows to write data to SFTP together with other related actions inside workspaces instead and I’d prefer to keep the SFTP Directory actions and error control inside the automations as they make the whole thing more graphic and manageable. 

I have automations that read sql tables an read the filenames in specific tables. in order to iterate through the records the automation updates a flag (i.e. PF = 0, 1, 2, 3) The automation runs on an interval and gets the next record PF=0 and sets the flag according to how far it gets through the automation. It’s seems like it would take quite a bit to rig a method to get the PF=0 count and corelate that to how many times the automation runs. I am looking for suggestions on how i could determine there are no more pf=0 records and stop the automation. Is there a transformer for Flow that will use data to stop the automation?Probably with python (right?) non python?

The connection works in FME Form, but while uploading the workspace I get the following error: Failed to update definition of database type 'Microsoft SQL Server (JDBC)' - FME Flow encountered an error and reported the following message.Database type Microsoft SQL Server (JDBC) cannot be edited.Request to https://xxxxxxxxxxxxxx/fmeapiv4/databasetypes/Microsoft SQL Server (JDBC) returned status code 422. Any tips and help greatly appreciated.

Hello All, We are currently using FME server as an integration platform. There are many FME jobs (triggered via external system call) that writes data in to database via ArcGIS portal service. Is it possible to (hold)queue all the jobs in FME server when ArcGIS enterprise will be down  ? Also, would like to know if there is a provision to hold all the jobs that is directed to a specific queue? Thanks,Naveen

Hi all,I’m having an issue getting some Flow App users to be able to successfully write to an ArcGIS SDE database. I am getting the following error.“An error occurred while attempting to retrieve the connection parameters from the connection file ‘SDE Connection’”This had previously been working fine, but with the upgrade from 2022 to 2023, connecting to SDE now requires a stored database connection, which then gets uploaded when it is published. Previously, at 2022, I think it was just storing the UNC pathing to the SDE connection file, and as long as FME Flow had access to this folder, everything was fine.Initially the App users were set up with Access permission to the Flow Workspace Apps, and nothing else. After a bit of hunting around I then added Access permission to the Connections, as this seemed like it might be necessary.But unfortunately this seems to have made no difference, and the users are still getting the same error.Are there any other permission requirements that are

Hi All,  I am seeking assistance in developing an FME workflow to perform clearance analytics for both roads and power lines in terms of trees - utility vegetation management. Our source data includes:Mobile Laser Scanner (MLS) Point Clouds: Representing the surrounding environment. The data includes the canopy and branch classification of each individual trees. Pre-defined Clearance Profiles (Vectors): Defining the acceptable clearance zones for roads and power lines. Linear Reference Data (Polylines): Representing the road edges or power line geometry.Workflow Goal:The objective is to identify and classify obstacles within the pre-defined clearance profiles. This involves:Spatial Analysis: Identify point cloud data falling within the designated clearance profiles. Obstacle Classification: Classify the identified points as potential obstacles. Obstacle Dimensioning: Measure the dimensions of the classified obstacles.Risk Assessment Output:Based on the identified obstacles, we aim to g

Hi.I’ve encountered this before, but now it blocks the saving of a 28K large table, and is so no more a mere nuisance.It seems that FME fails to catch that SQL statements fails typically due to constraints in the database. FME happily reports that all posts were saved, although none were in this case.My latest error message from the log file looks like this:Microsoft SQL Server Spatial Writer: Failed to write a feature of type `VEJLE_GADELYS.Elledning' to the database. Provider error `(-2147217873) The INSERT statement conflicted with the FOREIGN KEY constraint ...Because FME fails to catch these errors, and thus not failing in the automation, we’re putting invalid datasets into production.This is bad.

Hi All,First, I am an ArcGIS Pro/Enterprise user with the “Data Interoperability Extension” for both Pro and Enterprise.  I do not believe that I have access to FME Flow (Server).My installs on the server are ArcGIS Portal/Server and Data Interoperability at v11.3 - which installs FME…Edition: Data Interoperability, Fixed OEM LicenseVersion: FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)I want to automate a Spatial ETL tool that reads GeoJSON from a URL and ends up writing the results to an ArcGIS Online Feature Service.  I thought, why not just do it on the server and skip the exporting/importing the Web Connection from my laptop to the server? (from reading Schedule Spatial ETL tools on a server—ArcGIS Data Interoperability | Documentation for ArcGIS Enterprise)  When I created the workspace on the server with FME Workbench, everything seemed fine.  I could insert an Esri ArcGIS Online (AGOL) Feature Service writer and connect to the feature service that I wanted to write to.But

Hey everyone, On FME Server (2021.2.6) I have resources that I want to make available on an HTML page. I want users to be able click on the link and immediately download the data that's in the resource folder: https://fmeserver.EXAMPLE.com/fmeserver/#/resources/browse/FME_SHAREDRESOURCE_DATA/EXAMPLE?name=Data Seems like a pretty standard deal.

Hi,Just a quick question about this scenario:we are going to send an Email from an Automation in the case that a translation fails. To populate the body of this Email we can use several parameters (workspace name, automation name, repository name, job id, start and end time of the job, etc.). Now we would also like to add the URL of the FME Flow server to the Email body.Why? Two reasons:We have got 4 different FME Flow environments - D, T, A & Production - and we want the server who sends the email to identify itself It would be cool to add a hyperlink to the job log to the Email body and with the URL and the Job ID we would be able to compile such a linkSo, the question is: would this be possible? Where and how could we retrieve this URL? It is not a parameter in the list provided, as far as I know.Any ideas would be greatly appreciated.TIA,Egge-Jan

Is it possible to construct an FME Flow/Server (I currently have Server 2022.2) process that can monitor an Esri Enterprise (10.8.1) hosted layer?  We are trying to build something that notifies particular people when changes are made. ThanksCarl