A space to discuss FME Flow
Recently active
Our team uses GitHub, VS Code and FME Workbench for our data engineering projects with good results. Now we want to leverage FME Flow to automate the deployment of FME assets upon a GitHub merge to the Staging and Production environments. I would appreciate any suggestions or experiences in this regard.
I currently have a workspace that i am turning into an automation.Current workspace runs a pathname reader and samples the latest zip file in a specific folder then sends that zipped fgdb to a featurereader using path_windows attribute to get the entire file path.In the automation i am reading the initial email with attachment. I am unfamiliar with flow processes the data from email attachments. I have the attachment contains “myfilename” (I am following this tutorial) . but i will need to completely change my current workspace.I assume i just add an automation as the initiator on my featurereader. Can anyone say this is the most proficient method? Or should i process the zip file and download it to my resource folder and then run it in the same manner i have my current workspace?I don’t have a need for saving the fgdb after processing.
Hello,I’m actually running an instance of FME Server deployed using Safe Software’s Helm chart.The core component image version is 2024.1, and the HTTP readiness probe path is the following:/fmeapiv4/healthcheck/readiness The result of a get request is the following:{ "status": "notReady", "message": "One or more essential processes are unavailable.", "components": [ { "component": "notifier", "status": "up" }, { "component": "connections", "status": "up" }, { "component": "queue", "status": "up" }, { "component": "resources", "status": "up" }, { "component": "core", "status": "up" }, { "component": "cleanup", "status": "up" }, { "component": "configuration", "status": "up" }, { "component": "relayer", "status": "up" }, { "component": "scheduler", "status": "up" } ], "initializationTasks": [ { "task": "installDefaultContent",
Hello everybody!I have a server app to calculate routes. The workspace needs about 3 minutes for that and the user get an english text during the operations (calculating or something like that). But the app is in german language. Can I change those english words into german? thanks a lot in advance!
Hello,So we have been using FileExistanceChecker to monitor the addition of new files into our network folders, now we want to do the same for Google Drive Folders.We were hopping someone in the community has had any previous experience on how to do this regardless of the method used.Does anyone has any suggestions on how to do this from FME Form and FME Flow?.Thanks in advance.RZ.-
Version: FME Flow 2024.0.1Build 24202 - win64Issue:Click “Backup & Restore - Create Backup” or “System configuration - System Cleanup” or “System configuration - Network & Email”, error message “Error communicating with FME Server host localhost” will pop up. All other functions works fine, I only noticed this when try to create a backup. FME Flow is accessible through http://localhost:8080/fmeserver/
I have a workspace that filters a folder for the newest .zip file contained within and then uses a FeatureReader to extract shapefiles out of it for further processing. This works perfectly in Form but in a Flow automation where it runs off of a folder watch, it fails with '<filename>.dbf' is not a valid Shapefile and cannot be read. So apparently when operating from Flow the FeatureReader is trying to read the sidecar files. Why? And how can I tell it to stick to .shps? Thank you
I have created an FME Server App. Is it possible to provide permission for another user to edit the App?I have granted full permission to Create Apps and also to the specific App to my other user but I get this error message when the user tries to edit the App:This Server App is owned by "admin". Only the owner or a user who can manage FME Server security permissions can edit this App.This seems to be highly restrictive.
Hello,I have a flow automation set up to send out email with attachment(s) from a workspace. The output from the workspace include files: f1.xlsx, f2.kmz, and some parameter (e.g. ‘kmzneeded’ with value Yes/No).The email will always send f1.xlsx, but depends on whether or not user draw on the map, then f2.kmz need to be attached. Right now, I configured to include the two file path in server in the email attachment ("$(FME_SHAREDRESOURCE_TEMP)/F1.xlsx" "$(FME_SHAREDRESOURCE_TEMP)/F2.kmz"), so it always emails two files (with incorrect kmz from previously run). Can anyone please help point me a direction how to handle this? Any information is appreciated. 🙏
FME Flow 2023.2.1Build 23774 I’m planning on upgrading FME Form / Flow this weekend which includes fixing the following vulnerabilities detected from our internal Pen Test. USR-640 Email Servers Advertise Software Type and Version Removing the software banner from the email server is typically done in the configuration file, for example sendmail.cf or postfix.conf.Is it possible to fix this and where would the file(s) be located?What change should take place? USR-622 HSTS Missing from HTTPS ServerIs it simply enough to add the following to the web.xml config file? <!-- Enable HSTS --><filter> <filter-name>httpHeaderSecurity</filter-name> <filter-class>org.apache.catalina.filters.HttpHeaderSecurityFilter</filter-class> <init-param> <param-name>hstsEnabled</param-name> <param-value>true</param-value> </init-param> <init-param> <param-name>hstsMaxAgeSeconds</param-n
Hi, I have something I can’t find my way around in.We have a whole lot of Revit files. At the end we need them at ArcGIS Online as room Polygons and ghosted facades.I created a flow, that worked on the first file, but after that some works, some don’t and I can’t see the difference.I’ve testet and added the files in ArcGIS Pro and defined the correct coordinate system, and they are all placed correctly, using the exact same method, but using FME only some are placed correctly.I’m using a Feature reader using the Danish Coordinate system ESPG 4095, since that’s what have been added to the Revit file, and I’m using a feature writer using the same coordinate system.I was playing around with the Coordinate system to read, it’s not helping me at all, and why should that make any difference when it pops in perfectly in ArcGIS PRO. I hope one can help me understand this.Thanks
Hi,In FME Flow (2024.1.1.1) Automations, I cannot set parameter values from a trigger to a workspace when the published parameters are in a group box. There is simply no select button. On the other hand, if I bring the parameter to the first level, it works. Is this a know issue or intentional?
2022.0.0.2 > Flow 2024.1 Is there a way to tell how many transformers will need to be upgraded?
Our FME Form installations are able to establish ArcSDE connections with a SQL creator to our enterprise SQL Server geodatabase and perform SQL Select statements.When these workspaces are published to Flow the following warnings are received and the records are not read:“Esri Geodatabase: ArcMap has limited SQL functionality and may not be able to process query 'SELECT CPSUPV,CPTECH FROM AICC.GLP_BDinfo'. Consider installing ArcGIS Pro for broader SQL functionality”FME Flow is able to use the same ArcSDE connections, and read records with an ArcSDE Reader from our enterprise SQL Server geodatabase. It only seems to complain when we attempt to execute SQL through the connection with a SQL Creator or Executor.Additionally, FME Flow successfully executes SQL statements using SQL Creators/Executors against the enterprise geodatabase when connecting via a Microsoft SQL Server Non-Spatial format connection.Is there a configuration that could be addressed on the Flow Servers to enable SQL Cr
FME Flow 2023.1.1, Build 23631 - win64Hello FMEers,I have a simple workspace that is hooked up to a Resource or Network Directory trigger in FME Flow. I connected an emailer to the success port of the action, like so: The workspace contains scripted parameters which get written to an Automations writer called ScriptedParams. I want to get the values of some of the scripted parameters in the email, so through the text editor interface I navigate toWorkspace > ScriptedParams > MyParam and it drops{route.ScriptedParams.MyParam} into the body of the email.But when the automation runs I only get the value _undefined_ in the resulting email. If I ONLY connect the emailer to the ScriptedParams port (i.e. delete the success port connection) the values are correctly passed. But of course I want the email to be sent when the workspace runs successfully.So what is the correct way to configure this automation to get the scripted parameters from the workspace into the success email?Thanks!
Hey!I’m faced with the challenge of deploying FME Remote Engine Services (RES) in a hybride cloud scenario. In this scenario, Windows/Linux VMs are not an option and I came up with the idea of packaging RES in a Ubuntu-based Docker Image for a containerized deployment.My approach is to use silent install with a cfg-file like officially supported for FME Flow installation on a Ubuntu base image. However, I’m adapting it for the Remote Engine Services, which are shipped as a *.run file.Unfortunately, there is no official documentation/support for the Docker part and I had to build my custom image. However, I was wondering if anyone out there has tried something like this?Why is this not officially supported by @safe @safesoftware (yet)? Seems like a low hanging fruit - for FME Flow dockerfile is provided officially and it is much more complex…Added this as an idea: FME Remote Engine Services as Docker/Kubernetes Deployment | SafeSoftware Community
In the past couple of weeks two previously-reliable webhooks from separate Survey123 surveys to Flow have received empty JSON payloads, or possibly no payload at all, whilst still triggering our respective webhook automations and email actions. Below is what the automation log is showing with nothing seemingly coming through for the feature object:I’m curious as to whether others have observed this recently and whether there may have been a change in the JSON provided by Survey123 - I will enquire to our ESRI vendor/Geonet about that - but thought it also worth posting here from a Flow point of view, not least if we unearth a solution that helps us all.Webhooks were set up following this Safe article https://support.safe.com/hc/en-us/articles/25407775273101-Push-Data-from-ArcGIS-Survey123-to-an-Application-in-Real-time-with-WebhooksWe are on Flow Hosted 2023.1.11 Build 23636 - linux-x64
Hi all,We are planning the release of our upgrade FME 2024 package and the upgrade of our license manager.If we go ahead and upgrade the license manager will it still work with the older 2022 clients?We have a short overlap period during testing where both versions are in use.Thanks,Annette
Hello, I currently have a workbench that extracts all of my job history, auotmations, dataEndpoints (readers/writers) which I feed into a powerBI dashboard so I can more easily track data i/o, and jobs via using httpcallers and the fme flow rest api v3.I have just realised there is a issue with this, FeatureReaders, FeatureWriters, SQLExecutors and SQLCreators are excluded when using get “/repositories/{repository}/items/{item}/datasets/{dtype}”… to extract my readers/writers, dtype refers to source or destination, which is only assigned to readers and writers.The issue is FeatureReaders and FeatureWriter are transformers, they are not included in this output!What other methods can I use to extract these parameters from the FeatureReaders/FeatureWriters? (source/destination datasets specifically)
We would like to convert a large number of scheduled FME flows we execute today via Autosys. Autosys has built-in integration with our Incident Management system (ServiceNow). So if any FME wokspace fails in the flow, it creates an incident in ServiceNow and our on call person is notified by ServiceNow.Automations in FME Flow have the ability to execute a workspace on failure of a workspace, which could use the ServiceNow API. However, we have many flows with many workspace executions in each flow. We run 15 min, 30 min, hrly and daily flows.What is the recommended best practice to integrate our incident management system into FME Flow. Some of the items:When we publish a workspace to flow what are the recommended services (ie Job submitter, Notification Service)? Flow - in the automation do we connect every workspace failure to a Topic then to a ServiceNow API call workspace to send info like workspace name and error code/msg info too? Or do we call the ServiceNow API call works
Is there a reason the FME database user has to be dropped and recreated when upgrading FME Flow, as opposed to just dropping all the schema objects? Is it just because it’s simpler to drop and recreate?
HelloI get this message on FME Server 2022 and I do not know what is wrong.
Dear reader, I want to know if it is possible (if yes, how) to connect FME with an Azure File Storage with OAuth. The Azure connection transformer, AzureFileStorageConnector seem to not have a Oauth connection possible. Is this true and are there other ways to make an Oauth connection to Azure File Storage in FME Desktop?
I am finding it difficult completing the task’s above on the image. how can I check my own username and password set during installation . Get the connection details from your FME Flow Administrator. If you are using FME Flow on your own machine, use http://localhost and your own username and password set during installation.
On fme server, web connections we can authorise the named connections as various accounts. How can we check what accounts these are currently authorised as? Thanks