- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow

FME Flow

A space to discuss FME Flow

2326 Posts

Recently active

Most replies Most views Newest first

jhawksContributor

asked in Deployment

Upgrade? How do we know how pre upgrade how many Transforms will need to be upgraded?

2022.0.0.2 > Flow 2024.1 Is there a way to tell how many transformers will need to be upgraded?

383

1 month ago

raymondbrunnerContributor

asked in Deployment

SQL Creator/Executor using an ArcSDE connection works in FME Form but is unsuccessful when published to FME Flow

Our FME Form installations are able to establish ArcSDE connections with a SQL creator to our enterprise SQL Server geodatabase and perform SQL Select statements.When these workspaces are published to Flow the following warnings are received and the records are not read:“Esri Geodatabase: ArcMap has limited SQL functionality and may not be able to process query 'SELECT CPSUPV,CPTECH FROM AICC.GLP_BDinfo'. Consider installing ArcGIS Pro for broader SQL functionality”FME Flow is able to use the same ArcSDE connections, and read records with an ArcSDE Reader from our enterprise SQL Server geodatabase. It only seems to complain when we attempt to execute SQL through the connection with a SQL Creator or Executor.Additionally, FME Flow successfully executes SQL statements using SQL Creators/Executors against the enterprise geodatabase when connecting via a Microsoft SQL Server Non-Spatial format connection.Is there a configuration that could be addressed on the Flow Servers to enable SQL Cr

744

1 month ago

joaniegeo99Contributor

asked in Automation

Scripted parameter values _undefined_ in FME Flow emailer

FME Flow 2023.1.1, Build 23631 - win64Hello FMEers,I have a simple workspace that is hooked up to a Resource or Network Directory trigger in FME Flow. I connected an emailer to the success port of the action, like so: The workspace contains scripted parameters which get written to an Automations writer called ScriptedParams. I want to get the values of some of the scripted parameters in the email, so through the text editor interface I navigate toWorkspace > ScriptedParams > MyParam and it drops{route.ScriptedParams.MyParam} into the body of the email.But when the automation runs I only get the value _undefined_ in the resulting email. If I ONLY connect the emailer to the ScriptedParams port (i.e. delete the success port connection) the values are correctly passed. But of course I want the email to be sent when the workspace runs successfully.So what is the correct way to configure this automation to get the scripted parameters from the workspace into the success email?Thanks!

402

1 month ago

joschObserver

asked in Deployment

FME Remote Engine Services - How to build Docker Image and Container?

Hey!I’m faced with the challenge of deploying FME Remote Engine Services (RES) in a hybride cloud scenario. In this scenario, Windows/Linux VMs are not an option and I came up with the idea of packaging RES in a Ubuntu-based Docker Image for a containerized deployment.My approach is to use silent install with a cfg-file like officially supported for FME Flow installation on a Ubuntu base image. However, I’m adapting it for the Remote Engine Services, which are shipped as a *.run file.Unfortunately, there is no official documentation/support for the Docker part and I had to build my custom image. However, I was wondering if anyone out there has tried something like this?Why is this not officially supported by @safe @safesoftware (yet)? Seems like a low hanging fruit - for FME Flow dockerfile is provided officially and it is much more complex…Added this as an idea: FME Remote Engine Services as Docker/Kubernetes Deployment | SafeSoftware Community

460

1 month ago

dsign-worldContributor

asked in Architecture

FME Warning: Failed to free sufficient memory (while 30GB of memory are free)

FME shows the following warning during the translation:2023-09-06 10:24:29|5015.8| 0.3|WARN |Failed to free sufficient memory to reach the process usage limit. To improve stability and performance please increase the memory available to FME. Available memory can be increased by adding physical RAM, increasing swap space, or closing other applicationsI'm using FME(R) 2022.2.1.0 (20221202 - Build 22776 - WIN64) on Windows 10 22H2 Build 19045.2006. I have 64 GB of memory. FME uses about 10 GB during that translation and 50% of RAM are free. Why does FME show this warning when there should be enough free space? FME says it's trying to free memory because it doesn't have enough memory, right? Why does FME fail to free memory? How can FME achieve that goal? What does it do to free memory? And what is the process usage limit? Also I get these log messages and I feel like optimizing memory usage takes up very much time. Does the "Optimizing Memory Usage" message have to do with the warning a

2866

1 month ago

chriswilsonContributor

asked in Automation

Empty Survey123 Webhook Payload Received by Flow

In the past couple of weeks two previously-reliable webhooks from separate Survey123 surveys to Flow have received empty JSON payloads, or possibly no payload at all, whilst still triggering our respective webhook automations and email actions. Below is what the automation log is showing with nothing seemingly coming through for the feature object:I’m curious as to whether others have observed this recently and whether there may have been a change in the JSON provided by Survey123 - I will enquire to our ESRI vendor/Geonet about that - but thought it also worth posting here from a Flow point of view, not least if we unearth a solution that helps us all.Webhooks were set up following this Safe article https://support.safe.com/hc/en-us/articles/25407775273101-Push-Data-from-ArcGIS-Survey123-to-an-Application-in-Real-time-with-WebhooksWe are on Flow Hosted 2023.1.11 Build 23636 - linux-x64

574

1 month ago

annette2Contributor

asked in Deployment

If we upgrade the current license manager will it still work with 2022.2

Hi all,We are planning the release of our upgrade FME 2024 package and the upgrade of our license manager.If we go ahead and upgrade the license manager will it still work with the older 2022 clients?We have a short overlap period during testing where both versions are in use.Thanks,Annette

371

1 month ago

swachContributor

asked in General

Error retrieving Job History

My FME Server dashboards are not working. When I try to run JobHistoryStatisticsGathering.fmw, it fails with:Terminator (TestFactory): Terminator: Termination Message: 'Translation Terminated: There was an error getting job history.Error Message: HTTP/1.1 404 - http://v01w-app-p0427/fmeserver/fmerest/v3/transformations/jobs/completed?limit=1000&offset=0'What file is it looking for?

1284

1 month ago

ecxContributor

asked in Deployment

How to extract FeatureReader/Writer parameters using FMEFlow Rest API v3

Hello, I currently have a workbench that extracts all of my job history, auotmations, dataEndpoints (readers/writers) which I feed into a powerBI dashboard so I can more easily track data i/o, and jobs via using httpcallers and the fme flow rest api v3.I have just realised there is a issue with this, FeatureReaders, FeatureWriters, SQLExecutors and SQLCreators are excluded when using get “/repositories/{repository}/items/{item}/datasets/{dtype}”… to extract my readers/writers, dtype refers to source or destination, which is only assigned to readers and writers.The issue is FeatureReaders and FeatureWriter are transformers, they are not included in this output!What other methods can I use to extract these parameters from the FeatureReaders/FeatureWriters? (source/destination datasets specifically)

384

1 month ago

jbradforContributor

asked in Automation

On Call Incident management software integration

We would like to convert a large number of scheduled FME flows we execute today via Autosys. Autosys has built-in integration with our Incident Management system (ServiceNow). So if any FME wokspace fails in the flow, it creates an incident in ServiceNow and our on call person is notified by ServiceNow.Automations in FME Flow have the ability to execute a workspace on failure of a workspace, which could use the ServiceNow API. However, we have many flows with many workspace executions in each flow. We run 15 min, 30 min, hrly and daily flows.What is the recommended best practice to integrate our incident management system into FME Flow. Some of the items:When we publish a workspace to flow what are the recommended services (ie Job submitter, Notification Service)? Flow - in the automation do we connect every workspace failure to a Topic then to a ServiceNow API call workspace to send info like workspace name and error code/msg info too? Or do we call the ServiceNow API call works

684

1 month ago

ebygommContributor

asked in Deployment

Upgrading FME Flow - dropping database configured on own server

Is there a reason the FME database user has to be dropped and recreated when upgrading FME Flow, as opposed to just dropping all the schema objects? Is it just because it’s simpler to drop and recreate?

241

1 month ago

vanessarapiorContributor

asked in Automation

FME server 2022 Some or all of the input parameters are invalid

HelloI get this message on FME Server 2022 and I do not know what is wrong.

487

1 month ago

thomas89Contributor

asked in Security

Is it possible to make a FME web connection to Azure File Storage with Oauth ?

Dear reader, I want to know if it is possible (if yes, how) to connect FME with an Azure File Storage with OAuth. The Azure connection transformer, AzureFileStorageConnector seem to not have a Oauth connection possible. Is this true and are there other ways to make an Oauth connection to Azure File Storage in FME Desktop?

422

1 month ago

evoteckContributor

asked in Automation

issue performing this (FME Flow Connection dialog opens, and he fills it out to connect to FME Flow running on his own machine:)

I am finding it difficult completing the task’s above on the image. how can I check my own username and password set during installation . Get the connection details from your FME Flow Administrator. If you are using FME Flow on your own machine, use http://localhost and your own username and password set during installation.

377

1 month ago

ecxContributor

asked in Security

FME Server: How to Determine what Web Connections are Authorised As

On fme server, web connections we can authorise the named connections as various accounts. How can we check what accounts these are currently authorised as? Thanks

415

1 month ago

mmccartContributor

asked in Deployment

Changing FME Flow .war Files for URL Change

This is what I was going to post in FME Communities. Please change anything that doesn't make sense as I may have used terminology wrong:We are currently deploying FME Flow 2024.1.1 and will need to run FME Server 2022.2 in parallel for the next few months while we migrate workspaces/solutions over to Flow. With that in mind, we were curious about changing the URL of FME Flow from https://DOMAIN/fmeserver to https://DOMAIN/fmeflow by changing the fmeserver.war file name to fmeflow.war and redeploying Tomcat. Note: We’re using our own version of Tomcat and have a distributed deployment setup. We were able to get the new ‘fmeflow’ URL to work with this new .war file and subsequent folders. Our question is: Are there hard-coded elements that we would need to look out for and change to ensure all functions/elements work in FME Flow?

512

1 month ago

gis_midwestContributor

asked in Deployment

FME Flow v2023.2 fails to overwrite existing version of file previously uploaded

I’ve just upgraded FME Flow to v2023.2 Build 23774. One of my users found that they were not getting any results for a workbench that was working before the upgrade and had been run by others users, including themselves, after the upgrade. In researching this particular case I found that the user was had uploaded a file as an input for the workbench, that was the same as an existing uploaded file, however in this case the naming of the files were the same except that one had the filename in all UPPER case, while the other filename was in a mix of UPPER and LOWER case. Upon running the workbench the user is not made aware that the upload of the file has in fact failed (the original version on Flow is maintained as it was) but sees that the workbench has failed with an error indicating the file could not be located. Has anyone else seen this or can replicate it.It seems like there is a different set of rules in place for uploading files as opposed to reading files. The reading of file

654

1 month ago

swachContributor

asked in Automation

FME Flow Automation parameters changing by themselves

I have an automation which has a few workbenches which are SQLExectutors that gather parameters and write to automation writers. There are then workbenches which consume these parameters and use them for processing.. In the automation setup I assign the parameters to the incoming attributes. This process runs weekly. It runs successfully but occasionally it starts failing, when I go into the automation it is failing because these parameters have reverted to their default values. I have to re-assign them back to attribute values. How is this happening by itself? This process isn’t being touched by anyone else and will run successfully for months. This is in FME Flow 2023.2.1

373

1 month ago

mtdObserver

asked in Architecture

looking for installation architecture suggestions

Installing FME flow for the first time. Looking at it from IT perspective, not an FME user myself. Current users are using FME Form on Windows, and I’m upgrading this FME Flow server. We have very low load, but growing and so I’m moving our “operations” from under a user’s desk to our data center. We mange a lot of Windows and Linux systems, but prefer Linux when there’s a choice, and Linux is genuinely fully supported by vendor. Initially I thought it had to run on Windows do to ArcGIS jobs which apparently requires Windows ESRI DLLs. But upon closer read of docs, it appears that a distributed install allows all components on Linux except engine(s) for ArcGIS jobs. While I lean toward Linux, I also favor simplicity and eschew unnecessary complexity, and obviously a distributed install is more complex, but depending on the specific software, more complex doesn’t necessarily mean that much more work. I don’t however need fault-tolerantAny recommendations? Windows single-system

211

1 month ago

brian.atuhContributor

asked in Deployment

FME Flow 2023.2.1 - 'FME Flow is not ready yet. Try again later.'

Seeing the message ‘FME Flow is not ready yet. Try again later.’ after installing FME Flow 2023.2.1.Tried restarting services and server but no luck.Has anyone else seen this, and found the cause/solution?

3386

1 month ago

bjoernContributor

asked in Deployment

FME Flow HTML report after translation

Hello FME community,I have a workspace that uses the FileCopyWriter to move files from folder a to folder b. After that, FME Flow should show the user an HTML report showing which files were moved and the path.I thought I could use data streaming service for this. But then the files are written to a ZIP file instead of being moved to the correct folder. The HTML-report is in this ZIP file too.So is there a way to achieve my goal or is this impossible?Thanks for any help

272

1 month ago

paalpedersenContributor

asked in Deployment

Another parameter bug

Ok,So we are still using FME flow 2023.2. And its been a while since making those choice parameters. So I thought I would make one to select environment. So the display settings is important to be short and cool, while the value can be long and hard. so I published the workspace as a datastreaming service, and thought for sure my param value should be that of the display values. but no, datastreaming wants my full grose value as an input. This is so annoying, is this fixed in 2024 version? and where is the bug report form?I dont like negative posts, but I have no choice now..

Running Workspaces as different users

Is it possible to run workspaces in FME Server as different user accounts i.e. service accounts? I am aware of running FME Services Engine as a different account. The issue there is that over time you will have to grant this account access to a lot of different resources and this would not be good cyber-security practice.

Unable to download workspaces due to Javascript 500 and Null error

On FME Server 2022.1.1, me and a fellow colleague noticed we cannot download any FMW files from the Workspaces page.Upon opening a Chrome console, we both get the following errors when trying: Failed to load resource: the server responded with a status of 500 ()main-es2015.4568b5467a926bd0ac9b.js:1 ERROR TypeError: Cannot read properties of null (reading 'body') at HTMLIFrameElement.j [as __zone_symbol__ON_PROPERTYload] (safe-software-app.22623.min.js:10:16906) at HTMLIFrameElement.w (polyfills-es2015.e7ece7f15ffd343d735b.js:1:35186) at u.invokeTask (polyfills-es2015.e7ece7f15ffd343d735b.js:1:25728) at Object.onInvokeTask (main-es2015.4568b5467a926bd0ac9b.js:1:526473) at u.invokeTask (polyfills-es2015.e7ece7f15ffd343d735b.js:1:25649) at a.runTask (polyfills-es2015.e7ece7f15ffd343d735b.js:1:21137) at l.invokeTask [as invoke] (polyfills-es2015.e7ece7f15ffd343d735b.js:1:26778) at p (polyfills-es2015.e7ece7f15ffd343d735b.js:1:39061) at HTMLIFrameElement.h (polyfills-es2015

565

2 months ago

kevin_bourrandParticipant

asked in Security

Is there a way to configure automatically permission for running a specific workspace ?

Hi everyone, This question is about the detailed permissions user/role management interface.We’ve been facing issues finding all permissions required to run a specific workspace, like allowing services, access to shared ressources data and to specific connexions. The question is: Is there a hint to grant or list all these needed permissions to run a specific workspace ? Thank’s in advance. Kevin

623

2 months ago

Page 3 / 94

Badge winners

sameerbajracharhas earned the badge Teacher (Grey)
sameerbajracharhas earned the badge Conversationalist
fmetutorialhas earned the badge Teacher (Grey)
disco2000has earned the badge Student (Grey)
disco2000has earned the badge Expert (Grey)

Show all badges

30,108: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.