- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow

FME Flow

A space to discuss FME Flow

2364 Posts

gjaguilarContributor

Error 502 Bad Gateway when trying to access https://hostname.mydomain.eu/fmeserver

Hello everyoneWe have a problem, we upgraded from FME Server 2022 to FME Flow 2024.1.1FME Flow was installed on a virtual machine in Azure, after doing the express installation it was configured to use a .pfx certificate and HTTPS according to the documentation (https://support.safe.com/hc/en-us/articles/25407434854157-Configuring-FME-Flow-for-HTTPS-Using-a-PFX-or-P12-Certificate)In the fmeServerConfig.txt file it was assigned to FME_SERVER_WEB_URL=https://<hostname>:443From that machine we tried accessing using https://<hostname>/fmeserver/ and it works fineFrom any other computer we used https://<hostname>.mydomain.eu/fmeserver/ and it worked but now this gives an error 502 Bad GatewayIs it a DNS error or are we missing something to configure in FME Flow? Thanks in advance

291

1 month ago

nordpilContributor

posted in Architecture

Restoring the server configuration database

I just had a little adventure in restoring the FME Server (we are on 2022) configuration database - that is the internal postgres database for configuration and job history. We will move it to mssql eventually...I managed to hose our test server the other day - it is this problem I wrote a post about here:Now we have had a scheduled job that creates a full pg_dump backup of the data, and the latest run was just 2 days old! We have had the backup system in place, but we have never had to do a restore - the backup is also for archiving the history.It took a lot of trial and error and experimentation to figure out how do it, but eventually I got there.* Drop the fmeserver database* Recreate the database* Restore from backup (schema + data)* Grant permissionsHere are my more detailed notes...https://lnkd.in/dz-usUSU

1 month ago

nordpilContributor

posted in Automation

Crashing the FME Server REST api v3

I am on FME Server 2022.2.8, and I have a quite big automation where the workspaces communicate through json messages. Now I have been able to replicate a crash in too machines, but I haven’t been able to isolate the exact problems. I think it might be related to https://support.safe.com/hc/en-us/articles/25407442818189-Known-Issue-FME-Server-Core-java-lang-OutOfMemoryError-Java-heap-spaceIf I start processing that involves some 100 workspaces queued and running with quite long json messages the rest api stops responding eventually (about 30 minutes in, returning 500 errors). Processing seems to continue and automation is running fine, the Server ui seems ok (I think it is relying on REST API v4).Restarting the FME (or the server) does not help the problem, but cleaning up rows in the fme_job_history table seems to help.I have worked around the problem by re-architecting the Automation to make the messages smaller, so we are in the clear now.Just if anyone else have similar problems!

connection timed out error: Postgres

I am trying to convert an old script that loads 100+ tables in Postgres to a FME Server automation. One of the things I am doing is a INSERT INTO schema1.table SELECT * FROM schema2.table with a SQLExecutor where schema2 is a Oracle foreign table. This works fine for some smaller tables, but for a large table around 33gb I eventually receive a 'could not receive data from server: Connection timed out' error whether I run it on desktop or server. This worked fine when run from the script. I'm at a loss here, what could be causing the problem?

802

1 month ago

digit42Contributor

asked in Deployment

FME FLOW Restore Backup fails after upgrade from 2023.1 to 2024.2

Hello,I just performed an upgrade from FME FLOW 2023.1 to version 2024.2 and now I have a big problem because I can’t restore the backup I made before upgrading.The restore process fails with The system restore failed for the following reason:The export location provided is invalid.The error message in the History list saysCOM.safe.fmeserver.configuration.migration.FMEConfigurationException: java.lang.NullPointerException: inputStreamin a red box just above the heading “Failure”.The log just states Unable to extract import package. The backup.fsconfig is a quite large file (15 GB) because I forgot to remove some raster files from the resources before creating the backup. I copied it manually to the resources/Backup folder so I can select it from there for restoring instead of uploading. Nonetheless it won’t restore.I can unzip the file and see its content, so the archive itself is seemingly OK. What I did try:Unzipped the file to a directory, removed the raster files from the created s

722

1 month ago

epro_adminContributor

asked in Automation

Emailer > How to include FME Feature Attributes from workspace

Hello, I’m new to working with Flow automations and still fairly beginner level with FME. I appreciate any guidance you can provide.The WorkspaceI am working with ArcGIS Online and Field Maps. We have teams in the field everyday collecting data. At the end of the day I run a workspace that tidies up their tracklogs and calculates how many km they covered and hours spent.I’m using 2024.2 build 24783 for both Form and Flow.What I want to achieveHaving this data in the feature service isn’t enough. I also want an email summarising this information.How can I do this with Flow Automations?What I’ve triedWith the Email action I see options to send basic information like attaching the log, how much time it took to run, what time it ran, but I want more detailed information to show in the email. The information is an FME Feature Attribute created in the workspace pictured below.One colleague said it wasn’t possible in Flow and is better to do in Form using the Emailer transformer. Is that corr

261

1 month ago

tb09114Supporter

asked in Deployment

Missing plugins after fresh FME Flow installation

After a fresh installation of FME Flow 2024.1.2.1 are we (at least) missing the following two libraries:DateTimeFormat_func.dll DateTimeNow_func.dllAny idea where I can get these dll’s from so I can add them to the plugin directory of the server?

281

1 month ago

vxn43Supporter

asked in Architecture

What folder are the uploaded workspaces and automations stored in?

Hello, I am using FME Flow 2021 with 2 VMs and a Load Balancer all on Windows 2016. In Windows File Explorer (not in FME Flow), what folder/subfolder(s) are the uploaded workspaces and automations stored in? Is there a link to a document that explains what files are stored in what File Explorer folders or something similar for FME Flow? Thank you in advance for your assistance.

263

1 month ago

xtian79Contributor

asked in Automation

FME Server 2022.2.3 is not able to run workspace with ArcGIS Pro 3.1.3

In a experimental environment I have set FME server in a machine with ArcGIS Pro. (I want to verify some expected behaviors in FME Server, with out the trouble to install ArcGIS Server)It has ArcGIS Pro 3.1.3, As the document https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility states: When I try to run the workspace, it fails, and do not even creates a log file. In the fmeprocessmonitorinengine.log I find this: Wed-13-Nov-2024 03:44:01.898 PM INFORM Thread-19972 ALGTRCPIMSDM01_Engine1 Translation Finished (service '7070'). Return message is '370430:The workspace has Python Compatibility set to 'Esri ArcGIS Python 3.7+', which requires an appropriate version of ArcGIS Pro or ArcGIS Server. If ArcGIS is not required by this workspace, then update Python Compatibility to a non-Esri-ArcGIS Python. Otherwise, please install the required ArcGIS product. Please visit https://community.safe.com/s/article/notes-on-fme-and-esri-vers

131

1 month ago

maadh.mamariContributor

asked in Flow Hosted

Modify the message after job is completed in FME FLow

Hi all, I am wondering if anyone has faced a similar challenge. I created an FME workbench and published it to FME Flow successfully with some user parameters. The challenge is that I would like to send a message to the user after the job has completed running (or if failed). So instead of saying the job is completed or failed, I would like to modify it to give a more meaningful message.I do not want to send emails to users, otherwise I would have tried topics or automations. I just want to send a message (from an attribute) that appears at the end of the job.Thanks for the support in advance! Regards,Maadh

846

1 month ago

tb09114Supporter

asked in Deployment

WORKSPACE_NAME dereferenced?

We just installed FME Flow 2024.1.2.1 on a Windows machine and I published a workspace. Running the workspace immediately ends in:Undefined macro `WORKSPACE_NAME' dereferenced in file `flow_testing\sqlserver_test_delete\sqlserver_test_delete.fmw' The workspace was published from an ArcGIS Interoperability Workbench [FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)], but I tried the same from FME Form 2024.2. The result is the same. The workspace is as simple as it gets. Just a reader and a writer, and the error appears independent if there is a name for the workspace set or not. Can somebody please point me the right direction to solve the issue?

1183

1 month ago

lifalin2016Contributor

asked in Deployment

FME Form 2024 fails to connect to FME Server 2022?

Hi All.Our FME servers are still running 2022.2, but I need to run a specific job in FME Form 2024.1, and have it execute a workspace on the server.But the workspace refuses to connect to the server. This happens regardless of using FMEServerJobSubmitter (as copied from an old workspace), or a brand new FMEFlowJobSubmitter.The web connection used is saved in an older version (2020-2022), and works there. I tried to create and use a new connection in 2024, but that also fails.What caveats are present when trying to connect 2024 to a 2022 server ?Any insights and experiences are welcome.Cheers, Lars I.

968

1 month ago

carmijoContributor

asked in Deployment

Compatibility of FME Flow 2024.1 with ArcGIS Enterprise 10.9.1: Arcpy and ArcGIS API Functionality

I’m considering updating FME Flow to version 2024.1 on a server where we currently have ArcGIS Enterprise 10.9.1 installed. Some of my workspaces utilize Arcpy and the ArcGIS API for Python.Based on the compatibility table, ArcGIS Enterprise 10.9.1 is compatible with FME 2021.2, but not with FME 2024.1.Can anyone clarify whether Arcpy and the ArcGIS API for Python will function properly with FME Flow 2024.1 in this setup? Are there any known issues I should be aware of?https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility

925

1 month ago

joaniegeo99Contributor

asked in Automation

FME Flow: monitor network for addition of a file geodatabase

Hi,I am trying to trigger an action on FME Flow when a new file geodatabase is added to my network. So I set up a Network or Resource directory trigger to monitor for CREATE events, but when I test it it fires once for each of the files contained in my geodatabase, or about 70 times.Ultimately I want to receive the path to the geodatabase in the File Path automation attribute, in just one trigger. Any suggestions are appreciated, thanks.

242

1 month ago

mmccartContributor

asked in Automation

FME Flow 'Debug' Log Option for Workspaces in Automations

In the ‘Run Workspace Dialog, there is a ‘Log Debug’ option under ‘Advanced’ settings here: Why isn’t there an option to enable this ‘Log Debug’ in Automations when configuring the ‘Action>Run Workspace’ interface? I need debug logging details to run my automation in ‘production’ mode. It’s not honoring the logging setting when I published from FME Form. Shouldn’t the option be here: My ultimate goal is to have log files from workspaces ran within Automation have full debug logging enabled.Is there some setting in a config file I can change?Version: FME Form/Flow 2024.1.1.0 (Build 24619)

524

1 month ago

daniel.m.getzContributor

asked in General

Can I display features on the map based AOI selector in an FME server app?

I have a workflow that allows the user to select their desired market as an AOI for a server app. See this example for what I'm referring to and how this is deployed. https://engage.safe.com/demos/map-based-data-distribution-fme-server-apps/ The workflow works just fine, but does FME server have the functionality to display features on the map when the user selects the AOI? This would help when defining the area somewhat and give the user more context to what they are selecting.

1182

1 month ago

mmccartContributor

asked in Automation

Flow 2024.1.1 Automation Emailer Not Honoring Multiple 'From' Email Addresses

Disregard...found issue

110

1 month ago

dellerbeckContributor

asked in Automation

Automation Parameters are Resetting

If you have an existing automation and need to make a change, you make your changes and publish \\ overwrite in FME Forms. Once you go to the automation and stop it, all parameters are reset to defaults. This happens even to workspaces that were not updated. This has happened the last 2 or 3 releases, currently we are onFME Flow 2023.1Build 23619 - win64

1875

1 month ago

ebygommSupporter

asked in Security

Stopping the current automation automatically - authentication

We currently have a process where an automation is stopped by any upstream failure triggering a workspace which contains a httpcaller with a call to the fme rest api to stop the automation. The request is configured to use $(FME_SERVER_WEB_URL) and an the Automation General Attribute/Key AutomationID to construct the request for the api so in this way it is generic. I’m wondering if there’s any way to use the user running the automation as authentication for the http request?

261

1 month ago

markcoopersdcContributor

asked in Automation

Log file not created for jobs unless admin account is logged in to the web interface

Hi We have recenly started using FME Flow more. When someone runs a flow app no log file is created. However, if the admin user logs onto the web interface and they run the app again (on the same or different pc), a log file is created. Is this expected behaviour? If not, does anyone know how to get round this? Thanks

242

1 month ago

sameerContributor

asked in Automation

FME Workspace APP - Markdown URL / Link using Target Blank

HelloI have a Workspace App in dev phase. Since I cannot embed a HTML page by design or make use of dynamic user parameters to retrieve an event ID for now, I went with the idea of using a URL / Link within the description box, (Markdown style).URL points to SP OnlineI’d like to implement target=”blank”.[link](url){:target="_blank"} (Kramdown)Is this possible? ThanksSameer

745

1 month ago

pauldeqContributor

asked in Automation

FME Flow Automation Writer

Hello, I am needing some help quickly. I am trying to create a FME Flow Automation that passes 3 attributes to the email action. The attributes are all created inside the workbench using the FME Flow Automation Writer. Each one of the attributes passes the From, To and CC data for the email action. When I run the automation, nothing comes out and the log file says the below message. I honestly have no idea why this is not working. I have looked up many resources on this site to get this to work, but i keep getting the same message. I know there is a value, why is it not working. 65 2024-10-29 07:58:41 | PermitData: Attribute name is empty for value expression ''. Ignoring expression since unable to create a blank attribute name

383

1 month ago

smclaugh1Contributor

asked in Automation

Can't write to wwwroot

I’ve been running a script on FLOW for months that unzips and deploys apps to an IIS web server by copying them to the wwwroot folder. If the app already exists and needs updating, the script backs up the existing folder, deletes it, and then deploys the new version. However, about two weeks ago, it stopped working because the Python function in the Python caller can’t delete and replace the existing directories.I have admin permissions to the wwwroot folder, and the workbench runs correctly from my computer. But when it runs from FLOW as the application account, it fails. The app account has the same permissions on the wwwroot folder as I do, and both accounts are in the admin group.I suspect a Windows update or a policy change might be causing this issue.Any ideas?

243

1 month ago

vxn43Supporter

asked in Automation

SFTP External Action in Automation question(s)

This is my first time using the SFTP External Action in an Automation. I have previously used the FTPCaller Transformer in FME Form, but sometimes it gives an SSH error. The SSH error has occurred 2x over the past 6 months. Safe Tech Support tells me it is a generic error for which they cannot find a fix. Consequently, I am looking to use SFTP External Action in my Automation that previously used a FME Form workspace to upload to the SFTP. Questions about the SFTP External Action Details in Automation:Source Path includes the path and the file name (myspreadsheet.xlsx); Is it ok to add the name of the source file in the Source Path? Destination Path includes the path and the file name (myspreadsheet.xlsx); Is it ok to add the name of the destination file in the Destination Path? Is it correct to assume that Destination Path is the same as the Transfer URL in the FTPCaller Parameters in FME Form? The SFTP site has a password, when I enter the password in Password (optional) and choose

461

1 month ago

katie.pooleContributor

asked in Automation

How to set up Automation to run Quarterly

How to set FME Flow Schedule (under Automations) to run quarterly? I’ve tried the following CRON expressions:0 0 1 */3 *and 0 0 1 3,6,9,12 *FME throws an error for both of these expressions. Is there a known work around?Note: I do not want to use Schedules.

212

1 month ago

Page 3 / 95

Badge winners

gazmanhas earned the badge Welcome Back
miguelhacarhas earned the badge English Speaker
miguelhacarhas earned the badge Spanish Speaker
miguelhacarhas earned the badge Student (Grey)
miguelhacarhas earned the badge Expert (Grey)

Show all badges

30,351: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.