Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Flow

FME Flow

A space to discuss FME Flow

2295 Posts

Recently active

Most replies Most views Newest first

chelseawuContributor

asked in Automation

How to conditionally send out email based on output of a workspace in FME automation?

Hello,I have a flow automation set up to send out email with attachment(s) from a workspace. The output from the workspace include files: f1.xlsx, f2.kmz, and some parameter (e.g. ‘kmzneeded’ with value Yes/No).The email will always send f1.xlsx, but depends on whether or not user draw on the map, then f2.kmz need to be attached. Right now, I configured to include the two file path in server in the email attachment ("$(FME_SHAREDRESOURCE_TEMP)/F1.xlsx" "$(FME_SHAREDRESOURCE_TEMP)/F2.kmz"), so it always emails two files (with incorrect kmz from previously run). Can anyone please help point me a direction how to handle this? Any information is appreciated. 🙏

rzel24Contributor

asked in Automation

How Can I Monitor New Files in Google Drive?

Hello,So we have been using FileExistanceChecker to monitor the addition of new files into our network folders, now we want to do the same for Google Drive Folders.We were hopping someone in the community has had any previous experience on how to do this regardless of the method used.Does anyone has any suggestions on how to do this from FME Form and FME Flow?.Thanks in advance.RZ.-

asked in General

Health check failures after 24hrs when running FME Server in AWS using Aurora PostgreSQL Serverless for the FME Server Database

I'm running FME Server in AWS using Aurora PostgreSQL Serverless for the FME Server Database and I check the health of the server by calling the fmerest/v3/healthcheck?textResponse=true&ready=true REST API periodically. Everything runs ok for 24hrs but after that, the health checks start to fail and do not recover again. From the errors logged (below), I think it might be a connection pooling issue. I don't get the same issues on an Express install and there's a line on https://aws.amazon.com/blogs/database/best-practices-for-working-with-amazon-aurora-serverless/ that says "Aurora Serverless closes connections that are older than 24 hours. Make sure that your connection pool refreshes connections frequently.", so I think this might be the cause. I've copied some errors from the logs (can provide full logs if required), am I right in thinking this is caused by Aurora Serverless killing the connections or is this something else? Is there a setting anywhere that will force FME to ref

sameerContributor

asked in Security

Pen test Remediation required - Enable HSTS and Hide Email server type / version

FME Flow 2023.2.1Build 23774 I’m planning on upgrading FME Form / Flow this weekend which includes fixing the following vulnerabilities detected from our internal Pen Test. USR-640 Email Servers Advertise Software Type and Version Removing the software banner from the email server is typically done in the configuration file, for example sendmail.cf or postfix.conf.Is it possible to fix this and where would the file(s) be located?What change should take place? USR-622 HSTS Missing from HTTPS ServerIs it simply enough to add the following to the web.xml config file? <filter> <filter-name>httpHeaderSecurity</filter-name> <filter-class>org.apache.catalina.filters.HttpHeaderSecurityFilter</filter-class> <init-param> <param-name>hstsEnabled</param-name> <param-value>true</param-value> </init-param> <init-param> <param-name>hstsMaxAgeSeconds</param-n

cstewartfortsasContributor

asked in Automation

FeatureReader works in Form but fails in Flow (by trying to read sidecar files)

I have a workspace that filters a folder for the newest .zip file contained within and then uses a FeatureReader to extract shapefiles out of it for further processing. This works perfectly in Form but in a Flow automation where it runs off of a folder watch, it fails with '<filename>.dbf' is not a valid Shapefile and cannot be read. So apparently when operating from Flow the FeatureReader is trying to read the sidecar files. Why? And how can I tell it to stick to .shps? Thank you

djmcdermottContributor

asked in Deployment

Unable to connect to FME Flow

Hello FME’ers.We recently upgraded our FME Flow and FME Form instances from 2023.1 to 2024.1 (Build 24622). FME Flow is installed as an express installation on single Windows Server 2016 and is configured to use HTTPS and Azure AD. FME Form is also installed on the server and my laptop. When testing the connection from Form to Flow on my laptop everything was fine. I way able to connect and upload/download workbenches. However, I am unable to do the same on the server itself. When connecting as Admin, I get:Login failed (Connection Error) - Unable to connect to FME Flow.When trying to connect was my user I get:Connection Storage: Request to update access token failed. (HTTP Error 'HTTP/1.1 400')I then went to refresh the Azure AD connection and got the following error:Server's certificate does not match the URL.Client does not have access to any certificates from the following issuers:Go Daddy Secure Certificate Authority - G2Go Daddy Root Certificate Authority - G2I am able to get to

salah.elfarissiContributor

asked in Automation

feature.getGeometryType() returning MultiGeometry instead of direct type

Hello there,I’m looking into finding how to decide on the actual geometry type of a MultiGeometry feature using python API.How to know which OGC type it is ? MultiPoint, MulitLineString or MultiPolygon.I need this for reporting on ingested data types. class FeatureProcessor(object): """Template Class Interface: When using this class, make sure its name is set as the value of the 'Class to Process Features' transformer parameter. """ def input(self, feature: fmeobjects.FMEFeature): """This method is called for each feature which enters the PythonCaller. Processed input features can be emitted from this method using self.pyoutput(). If knowledge of all input features is required for processing, then input features should be cached to a list instance variable and processed using group processing or in the close() method. """ feature_type_name = feature.getAttribute("fme_feature_type") if feature_type_name not in self.feature_

kketolaContributor

asked in Automation

Data Streaming Service -> Notify on Completion -> Post Data from Writer -> Automation FME Flow Topic Trigger

Hello Esteemed Community,I have been banging my head on this issue and have tried the help documents, this forum and the academy training to find an answer and am still stumped. I am struggling to access data that I submit with a topic through the data streaming service inside my automation via the FME Flow Topic Trigger. I have successfully tried the FMEFlowNotifier transformer just to see if I could get that working, but it does not fit in line with what I am trying to do which is to post to topics on success or failure at the end.This is what the service properties looks like: Service PropertiesAnd the JSON writer: JSON WriterI have tried access the properties both using {job_id} and {data.job_id} but the translation log shows that it uses those values as is.Value ExampleOne of the key issues I have is that I need to set the values to a custom attributes because the parameters I am using them for are number type and it won’t let me type something non-numeric. Custom Attributes on FM

kelin84Contributor

asked in Automation

Revit files is placed different places (France, correct, out of the world) although it works in ArcGIS

Hi, I have something I can’t find my way around in.We have a whole lot of Revit files. At the end we need them at ArcGIS Online as room Polygons and ghosted facades.I created a flow, that worked on the first file, but after that some works, some don’t and I can’t see the difference.I’ve testet and added the files in ArcGIS Pro and defined the correct coordinate system, and they are all placed correctly, using the exact same method, but using FME only some are placed correctly.I’m using a Feature reader using the Danish Coordinate system ESPG 4095, since that’s what have been added to the Revit file, and I’m using a feature writer using the same coordinate system.I was playing around with the Coordinate system to read, it’s not helping me at all, and why should that make any difference when it pops in perfectly in ArcGIS PRO. I hope one can help me understand this.Thanks

bjoernContributor

asked in Automation

FME Flow Automations Parameter in a Group Box

Hi,In FME Flow (2024.1.1.1) Automations, I cannot set parameter values from a trigger to a workspace when the published parameters are in a group box. There is simply no select button. On the other hand, if I bring the parameter to the first level, it works. Is this a know issue or intentional?

mmccartContributor

asked in Automation

FME Flow 'Debug' Log Option for Workspaces in Automations

In the ‘Run Workspace Dialog, there is a ‘Log Debug’ option under ‘Advanced’ settings here: Why isn’t there an option to enable this ‘Log Debug’ in Automations when configuring the ‘Action>Run Workspace’ interface? I need debug logging details to run my automation in ‘production’ mode. It’s not honoring the logging setting when I published from FME Form. Shouldn’t the option be here: My ultimate goal is to have log files from workspaces ran within Automation have full debug logging enabled.Is there some setting in a config file I can change?Version: FME Form/Flow 2024.1.1.0 (Build 24619)

jhawksContributor

asked in Deployment

Upgrade? How do we know how pre upgrade how many Transforms will need to be upgraded?

2022.0.0.2 > Flow 2024.1 Is there a way to tell how many transformers will need to be upgraded?

raymondbrunnerContributor

asked in Deployment

SQL Creator/Executor using an ArcSDE connection works in FME Form but is unsuccessful when published to FME Flow

Our FME Form installations are able to establish ArcSDE connections with a SQL creator to our enterprise SQL Server geodatabase and perform SQL Select statements.When these workspaces are published to Flow the following warnings are received and the records are not read:“Esri Geodatabase: ArcMap has limited SQL functionality and may not be able to process query 'SELECT CPSUPV,CPTECH FROM AICC.GLP_BDinfo'. Consider installing ArcGIS Pro for broader SQL functionality”FME Flow is able to use the same ArcSDE connections, and read records with an ArcSDE Reader from our enterprise SQL Server geodatabase. It only seems to complain when we attempt to execute SQL through the connection with a SQL Creator or Executor.Additionally, FME Flow successfully executes SQL statements using SQL Creators/Executors against the enterprise geodatabase when connecting via a Microsoft SQL Server Non-Spatial format connection.Is there a configuration that could be addressed on the Flow Servers to enable SQL Cr

joaniegeo99Contributor

asked in Automation

Scripted parameter values _undefined_ in FME Flow emailer

FME Flow 2023.1.1, Build 23631 - win64Hello FMEers,I have a simple workspace that is hooked up to a Resource or Network Directory trigger in FME Flow. I connected an emailer to the success port of the action, like so: The workspace contains scripted parameters which get written to an Automations writer called ScriptedParams. I want to get the values of some of the scripted parameters in the email, so through the text editor interface I navigate toWorkspace > ScriptedParams > MyParam and it drops{route.ScriptedParams.MyParam} into the body of the email.But when the automation runs I only get the value _undefined_ in the resulting email. If I ONLY connect the emailer to the ScriptedParams port (i.e. delete the success port connection) the values are correctly passed. But of course I want the email to be sent when the workspace runs successfully.So what is the correct way to configure this automation to get the scripted parameters from the workspace into the success email?Thanks!

joschObserver

asked in Deployment

FME Remote Engine Services - How to build Docker Image and Container?

Hey!I’m faced with the challenge of deploying FME Remote Engine Services (RES) in a hybride cloud scenario. In this scenario, Windows/Linux VMs are not an option and I came up with the idea of packaging RES in a Ubuntu-based Docker Image for a containerized deployment.My approach is to use silent install with a cfg-file like officially supported for FME Flow installation on a Ubuntu base image. However, I’m adapting it for the Remote Engine Services, which are shipped as a *.run file.Unfortunately, there is no official documentation/support for the Docker part and I had to build my custom image. However, I was wondering if anyone out there has tried something like this?Why is this not officially supported by @safe @safesoftware (yet)? Seems like a low hanging fruit - for FME Flow dockerfile is provided officially and it is much more complex...

dsign-worldContributor

asked in Architecture

FME Warning: Failed to free sufficient memory (while 30GB of memory are free)

FME shows the following warning during the translation:2023-09-06 10:24:29|5015.8| 0.3|WARN |Failed to free sufficient memory to reach the process usage limit. To improve stability and performance please increase the memory available to FME. Available memory can be increased by adding physical RAM, increasing swap space, or closing other applicationsI'm using FME(R) 2022.2.1.0 (20221202 - Build 22776 - WIN64) on Windows 10 22H2 Build 19045.2006. I have 64 GB of memory. FME uses about 10 GB during that translation and 50% of RAM are free. Why does FME show this warning when there should be enough free space? FME says it's trying to free memory because it doesn't have enough memory, right? Why does FME fail to free memory? How can FME achieve that goal? What does it do to free memory? And what is the process usage limit? Also I get these log messages and I feel like optimizing memory usage takes up very much time. Does the "Optimizing Memory Usage" message have to do with the warning a

chriswilsonContributor

asked in Automation

Empty Survey123 Webhook Payload Received by Flow

In the past couple of weeks two previously-reliable webhooks from separate Survey123 surveys to Flow have received empty JSON payloads, or possibly no payload at all, whilst still triggering our respective webhook automations and email actions. Below is what the automation log is showing with nothing seemingly coming through for the feature object:I’m curious as to whether others have observed this recently and whether there may have been a change in the JSON provided by Survey123 - I will enquire to our ESRI vendor/Geonet about that - but thought it also worth posting here from a Flow point of view, not least if we unearth a solution that helps us all.Webhooks were set up following this Safe article https://support.safe.com/hc/en-us/articles/25407775273101-Push-Data-from-ArcGIS-Survey123-to-an-Application-in-Real-time-with-WebhooksWe are on Flow Hosted 2023.1.11 Build 23636 - linux-x64

annette2Contributor

asked in Deployment

If we upgrade the current license manager will it still work with 2022.2

Hi all,We are planning the release of our upgrade FME 2024 package and the upgrade of our license manager.If we go ahead and upgrade the license manager will it still work with the older 2022 clients?We have a short overlap period during testing where both versions are in use.Thanks,Annette

swachContributor

asked in General

Error retrieving Job History

My FME Server dashboards are not working. When I try to run JobHistoryStatisticsGathering.fmw, it fails with:Terminator (TestFactory): Terminator: Termination Message: 'Translation Terminated: There was an error getting job history.Error Message: HTTP/1.1 404 - http://v01w-app-p0427/fmeserver/fmerest/v3/transformations/jobs/completed?limit=1000&offset=0'What file is it looking for?

ecxContributor

asked in Deployment

How to extract FeatureReader/Writer parameters using FMEFlow Rest API v3

Hello, I currently have a workbench that extracts all of my job history, auotmations, dataEndpoints (readers/writers) which I feed into a powerBI dashboard so I can more easily track data i/o, and jobs via using httpcallers and the fme flow rest api v3.I have just realised there is a issue with this, FeatureReaders, FeatureWriters, SQLExecutors and SQLCreators are excluded when using get “/repositories/{repository}/items/{item}/datasets/{dtype}”… to extract my readers/writers, dtype refers to source or destination, which is only assigned to readers and writers.The issue is FeatureReaders and FeatureWriter are transformers, they are not included in this output!What other methods can I use to extract these parameters from the FeatureReaders/FeatureWriters? (source/destination datasets specifically)

lifalin2016Contributor

asked in Deployment

FME Form 2024 fails to connect to FME Server 2022?

Hi All.Our FME servers are still running 2022.2, but I need to run a specific job in FME Form 2024.1, and have it execute a workspace on the server.But the workspace refuses to connect to the server. This happens regardless of using FMEServerJobSubmitter (as copied from an old workspace), or a brand new FMEFlowJobSubmitter.The web connection used is saved in an older version (2020-2022), and works there. I tried to create and use a new connection in 2024, but that also fails.What caveats are present when trying to connect 2024 to a 2022 server ?Any insights and experiences are welcome.Cheers, Lars I.

jbradforContributor

asked in Automation

On Call Incident management software integration

We would like to convert a large number of scheduled FME flows we execute today via Autosys. Autosys has built-in integration with our Incident Management system (ServiceNow). So if any FME wokspace fails in the flow, it creates an incident in ServiceNow and our on call person is notified by ServiceNow.Automations in FME Flow have the ability to execute a workspace on failure of a workspace, which could use the ServiceNow API. However, we have many flows with many workspace executions in each flow. We run 15 min, 30 min, hrly and daily flows.What is the recommended best practice to integrate our incident management system into FME Flow. Some of the items:When we publish a workspace to flow what are the recommended services (ie Job submitter, Notification Service)? Flow - in the automation do we connect every workspace failure to a Topic then to a ServiceNow API call workspace to send info like workspace name and error code/msg info too? Or do we call the ServiceNow API call works

ebygommContributor

asked in Deployment

Upgrading FME Flow - dropping database configured on own server

Is there a reason the FME database user has to be dropped and recreated when upgrading FME Flow, as opposed to just dropping all the schema objects? Is it just because it’s simpler to drop and recreate?

vanessarapiorContributor

asked in Automation

FME server 2022 Some or all of the input parameters are invalid

HelloI get this message on FME Server 2022 and I do not know what is wrong.

thomas89Contributor

asked in Security

Is it possible to make a FME web connection to Azure File Storage with Oauth ?

Dear reader, I want to know if it is possible (if yes, how) to connect FME with an Azure File Storage with OAuth. The Azure connection transformer, AzureFileStorageConnector seem to not have a Oauth connection possible. Is this true and are there other ways to make an Oauth connection to Azure File Storage in FME Desktop?

1
2
3
4
...
92

Page 1 / 92

Badge winners

t.yang_rmwbhas earned the badge Integrate Spatial Data
crystalatsafehas earned the badge Kanelbullens dag
ahuertahas earned the badge Welcome Back
chelseawuhas earned the badge Kanelbullens dag
dbaldacchino1has earned the badge English Speaker

Show all badges

29,799: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK