Skip to main content
  • EN

FME Flow

A space to discuss FME Flow

2331 Posts
gjaguilar
Contributor
gjaguilarContributor
asked in Deployment
Error 502 Bad Gateway when trying to access https://hostname.mydomain.eu/fmeserver

Hello everyoneWe have a problem, we upgraded from FME Server 2022 to FME Flow 2024.1.1FME Flow was installed on a virtual machine in Azure, after doing the express installation it was configured to use a .pfx certificate and HTTPS according to the documentation (https://support.safe.com/hc/en-us/articles/25407434854157-Configuring-FME-Flow-for-HTTPS-Using-a-PFX-or-P12-Certificate)In the fmeServerConfig.txt file it was assigned to FME_SERVER_WEB_URL=https://<hostname>:443From that machine we tried accessing using https://<hostname>/fmeserver/ and it works fineFrom any other computer we used https://<hostname>.mydomain.eu/fmeserver/ and it worked but now this gives an error 502 Bad GatewayIs it a DNS error or are we missing something to configure in FME Flow? Thanks in advance

161
baileyatsafe
Safer
9 hours ago
ivanwriter
Contributor
ivanwriterContributor
asked in Security
For Added Security, Can the out-of-the-box admin Login Be Disabled?

Out-of-the-box, FME Flow has an admin login for administration (member of fmeadmin and fmesuperuser).As a measure of added security, can a different, less common, login name be used for administration? In other words, if I were to create a login for administration purpose named MickeyMouse, add MickeyMouse to fmeadmin and fmesuperuser roles, and disable admin, does that work? Are there gotcha’s with doing that? Is it a measure of added security?

111
hkingsbury
Celebrity
11 hours ago
nordpil
Contributor
nordpilContributor
posted in Architecture
Restoring the server configuration database

I just had a little adventure in restoring the FME Server (we are on 2022) configuration database - that is the internal postgres database for configuration and job history. We will move it to mssql eventually...I managed to hose our test server the other day - it is this problem I wrote a post about here:Now we have had a scheduled job that creates a full pg_dump backup of the data, and the latest run was just 2 days old! We have had the backup system in place, but we have never had to do a restore - the backup is also for archiving the history.It took a lot of trial and error and experimentation to figure out how do it, but eventually I got there.* Drop the fmeserver database* Recreate the database* Restore from backup (schema + data)* Grant permissionsHere are my more detailed notes...https://lnkd.in/dz-usUSU

50
nordpil
Contributor
21 hours ago
nordpil
Contributor
nordpilContributor
posted in Automation
Crashing the FME Server REST api v3

I am on FME Server 2022.2.8, and I have a quite big automation where the workspaces communicate through json messages. Now I have been able to replicate a crash in too machines, but I haven’t been able to isolate the exact problems. I think it might be related to https://support.safe.com/hc/en-us/articles/25407442818189-Known-Issue-FME-Server-Core-java-lang-OutOfMemoryError-Java-heap-spaceIf I start processing that involves some 100 workspaces queued and running with quite long json messages the rest api stops responding eventually (about 30 minutes in, returning 500 errors). Processing seems to continue and automation is running fine, the Server ui seems ok (I think it is relying on REST API v4).Restarting the FME (or the server) does not help the problem, but cleaning up rows in the fme_job_history table seems to help.I have worked around the problem by re-architecting the Automation to make the messages smaller, so we are in the clear now.Just if anyone else have similar problems!

80
nordpil
Contributor
21 hours ago
L
ling55
asked in General
connection timed out error: Postgres

I am trying to convert an old script that loads 100+ tables in Postgres to a FME Server automation. One of the things I am doing is a INSERT INTO schema1.table SELECT * FROM schema2.table with a SQLExecutor where schema2 is a Oracle foreign table. This works fine for some smaller tables, but for a large table around 33gb I eventually receive a 'could not receive data from server: Connection timed out' error whether I run it on desktop or server. This worked fine when run from the script. I'm at a loss here, what could be causing the problem?

722
klokker11
Participant
22 hours ago
digit42
Contributor
digit42Contributor
asked in Deployment
FME FLOW Restore Backup fails after upgrade from 2023.1 to 2024.2

Hello,I just performed an upgrade from FME FLOW 2023.1 to version 2024.2 and now I have a big problem because I can’t restore the backup I made before upgrading.The restore process fails with The system restore failed for the following reason:The export location provided is invalid.The error message in the History list saysCOM.safe.fmeserver.configuration.migration.FMEConfigurationException: java.lang.NullPointerException: inputStreamin a red box just above the heading “Failure”.The log just states Unable to extract import package. The backup.fsconfig is a quite large file (15 GB) because I forgot to remove some raster files from the resources before creating the backup. I copied it manually to the resources/Backup folder so I can select it from there for restoring instead of uploading. Nonetheless it won’t restore.I can unzip the file and see its content, so the archive itself is seemingly OK. What I did try:Unzipped the file to a directory, removed the raster files from the created s

332
digit42
Contributor
2 days ago
epro_admin
Contributor
epro_adminContributor
asked in Automation
Emailer > How to include FME Feature Attributes from workspace

Hello, I’m new to working with Flow automations and still fairly beginner level with FME. I appreciate any guidance you can provide.The WorkspaceI am working with ArcGIS Online and Field Maps. We have teams in the field everyday collecting data. At the end of the day I run a workspace that tidies up their tracklogs and calculates how many km they covered and hours spent.I’m using 2024.2 build 24783 for both Form and Flow.What I want to achieveHaving this data in the feature service isn’t enough. I also want an email summarising this information.How can I do this with Flow Automations?What I’ve triedWith the Email action I see options to send basic information like attaching the log, how much time it took to run, what time it ran, but I want more detailed information to show in the email. The information is an FME Feature Attribute created in the workspace pictured below.One colleague said it wasn’t possible in Flow and is better to do in Form using the Emailer transformer. Is that corr

201
dylan.at.safe
Safer
5 days ago
tb09114
Contributor
tb09114Contributor
asked in Deployment
Missing plugins after fresh FME Flow installation

After a fresh installation of FME Flow 2024.1.2.1 are we (at least) missing the following two libraries:DateTimeFormat_func.dll DateTimeNow_func.dllAny idea where I can get these dll’s from so I can add them to the plugin directory of the server? 

251
kate-safe
Safer
6 days ago
vxn43
Supporter
vxn43Supporter
asked in Architecture
What folder are the uploaded workspaces and automations stored in?

Hello, I am using FME Flow 2021 with 2 VMs and a Load Balancer all on Windows 2016. In Windows File Explorer (not in FME Flow), what folder/subfolder(s) are the uploaded workspaces and automations stored in? Is there a link to a document that explains what files are stored in what File Explorer folders or something similar for FME Flow? Thank you in advance for your assistance. 

233
redgeographics
Celebrity
6 days ago
xtian79
Contributor
xtian79Contributor
asked in Automation
FME Server 2022.2.3 is not able to run workspace with ArcGIS Pro 3.1.3

 In a experimental environment I have set FME server in a machine with ArcGIS Pro. (I want to verify some expected behaviors in FME Server, with out the trouble to install ArcGIS Server)It has ArcGIS Pro 3.1.3, As the document https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility states: When I try to run the workspace, it fails, and do not even creates a log file. In the fmeprocessmonitorinengine.log I find this: Wed-13-Nov-2024 03:44:01.898 PM INFORM Thread-19972 ALGTRCPIMSDM01_Engine1 Translation Finished (service '7070'). Return message is '370430:The workspace has Python Compatibility set to 'Esri ArcGIS Python 3.7+', which requires an appropriate version of ArcGIS Pro or ArcGIS Server. If ArcGIS is not required by this workspace, then update Python Compatibility to a non-Esri-ArcGIS Python. Otherwise, please install the required ArcGIS product. Please visit https://community.safe.com/s/article/notes-on-fme-and-esri-vers

101
hkingsbury
Celebrity
7 days ago
maadh.mamari
Contributor
maadh.mamariContributor
asked in Flow Hosted
Modify the message after job is completed in FME FLow

Hi all, I am wondering if anyone has faced a similar challenge. I created an FME workbench and published it to FME Flow successfully with some user parameters. The challenge is that I would like to send a message to the user after the job has completed running (or if failed). So instead of saying the job is completed or failed, I would like to modify it to give a more meaningful message.I do not want to send emails to users, otherwise I would have tried topics or automations. I just want to send a message (from an attribute) that appears at the end of the job.Thanks for the support in advance! Regards,Maadh

676
maadh.mamari
Contributor
7 days ago
tb09114
Contributor
tb09114Contributor
asked in Deployment
WORKSPACE_NAME dereferenced?

We just installed FME Flow 2024.1.2.1 on a Windows machine and I published a workspace. Running the workspace immediately ends in:Undefined macro `WORKSPACE_NAME' dereferenced in file `flow_testing\sqlserver_test_delete\sqlserver_test_delete.fmw' The workspace was published from an ArcGIS Interoperability Workbench [FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)], but I tried the same from FME Form 2024.2. The result is the same. The workspace is as simple as it gets. Just a reader and a writer, and the error appears independent if there is a name for the workspace set or not. Can somebody please point me the right direction to solve the issue? 

603
kate-safe
Safer
7 days ago
lifalin2016
Contributor
lifalin2016Contributor
asked in Deployment
FME Form 2024 fails to connect to FME Server 2022?

Hi All.Our FME servers are still running 2022.2, but I need to run a specific job in FME Form 2024.1, and have it execute a workspace on the server.But the workspace refuses to connect to the server. This happens regardless of using FMEServerJobSubmitter (as copied from an old workspace), or a brand new FMEFlowJobSubmitter.The web connection used is saved in an older version (2020-2022), and works there. I tried to create and use a new connection in 2024, but that also fails.What caveats are present when trying to connect 2024 to a 2022 server ?Any insights and experiences are welcome.Cheers, Lars I.

808
steveatsafe
Safer
7 days ago
koen
Contributor
koenContributor
asked in Deployment
Module 'realdwg/REALDWG' is unavailable for use with this FME edition (FME Flow 2024.2)

After upgrading FME Flow to 2024.2 some of our workspaces fail with the following error:WARN  |Library 'F:\FMEFlow\Server\fme\plugins/realdwg/REALDWG.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this library WARN  |Could not load module 'F:\FMEFlow\Server\fme\plugins/realdwg/REALDWG.dll' : 'The specified module could not be found' WARN  |Could not load module 'F:\FMEFlow\Server\fme\realdwg/REALDWG.dll' : 'The specified module could not be found' ERROR |Module 'realdwg/REALDWG' is unavailable for use with this FME editionSeems like RealDWG and AUTOCAD_OD readers/writers do not work anymore. -Is this a known issue/bug?-Is RealDwg not supported anymore? It does work in FME Form 2024.2

331
redgeographics
Celebrity
7 days ago
vishnuiam
Contributor
vishnuiamContributor
asked in Automation
I'm unable to see/select GoogleBigQuery as Reader in FME

I’m new to FME tool and I wanted to pull data from Google BigQuery tables and convert into GeoDatabase and shapefile. I'm using FME Workbench version 2024.1.1 and I'm experiencing an issue with using Google BigQuery as a reader. But I’ve installed Google BigQuery as a transformer and attempted to pull data, but no data is being retrieved. I’ve also authenticated using a service account key file, but the data still isn’t showing up.

321
vishnuiam
Contributor
8 days ago
carmijo
Contributor
carmijoContributor
asked in Deployment
Compatibility of FME Flow 2024.1 with ArcGIS Enterprise 10.9.1: Arcpy and ArcGIS API Functionality

I’m considering updating FME Flow to version 2024.1 on a server where we currently have ArcGIS Enterprise 10.9.1 installed. Some of my workspaces utilize Arcpy and the ArcGIS API for Python.Based on the compatibility table, ArcGIS Enterprise 10.9.1 is compatible with FME 2021.2, but not with FME 2024.1.Can anyone clarify whether Arcpy and the ArcGIS API for Python will function properly with FME Flow 2024.1 in this setup? Are there any known issues I should be aware of?https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility

695
ebygomm
Contributor
12 days ago
joaniegeo99
Contributor
joaniegeo99Contributor
asked in Automation
FME Flow: monitor network for addition of a file geodatabase

Hi,I am trying to trigger an action on FME Flow when a new file geodatabase is added to my network. So I set up a Network or Resource directory trigger to monitor for CREATE events, but when I test it it fires once for each of the files contained in my geodatabase, or about 70 times.Ultimately I want to receive the path to the geodatabase in the File Path automation attribute, in just one trigger. Any suggestions are appreciated, thanks. 

232
joaniegeo99
Contributor
13 days ago
mmccart
Contributor
mmccartContributor
asked in Automation
FME Flow 'Debug' Log Option for Workspaces in Automations

In the ‘Run Workspace Dialog, there is a ‘Log Debug’ option under ‘Advanced’ settings here:  Why isn’t there an option to enable this ‘Log Debug’ in Automations when configuring the ‘Action>Run Workspace’ interface? I need debug logging details to run my automation in ‘production’ mode. It’s not honoring the logging setting when I published from FME Form. Shouldn’t the option be here:  My ultimate goal is to have log files from workspaces ran within Automation have full debug logging enabled.Is there some setting in a config file I can change?Version: FME Form/Flow 2024.1.1.0 (Build 24619)

424
ebygomm
Contributor
14 days ago
daniel.m.getz
Contributor
daniel.m.getzContributor
asked in General
Can I display features on the map based AOI selector in an FME server app?

I have a workflow that allows the user to select their desired market as an AOI for a server app. See this example for what I'm referring to and how this is deployed. https://engage.safe.com/demos/map-based-data-distribution-fme-server-apps/ The workflow works just fine, but does FME server have the functionality to display features on the map when the user selects the AOI? This would help when defining the area somewhat and give the user more context to what they are selecting.

1152
sheree
Contributor
15 days ago
mmccart
Contributor
mmccartContributor
asked in Automation
Flow 2024.1.1 Automation Emailer Not Honoring Multiple 'From' Email Addresses

Disregard...found issue

90
mmccart
Contributor
15 days ago
djmcdermott
Contributor
djmcdermottContributor
asked in Deployment
Unable to connect to FME Flow

Hello FME’ers.We recently upgraded our FME Flow and FME Form instances from 2023.1 to 2024.1 (Build 24622). FME Flow is installed as an express installation on single Windows Server 2016 and is configured to use HTTPS and Azure AD. FME Form is also installed on the server and my laptop. When testing the connection from Form to Flow on my laptop everything was fine. I way able to connect and upload/download workbenches. However, I am unable to do the same on the server itself. When connecting as Admin, I get:Login failed (Connection Error) - Unable to connect to FME Flow.When trying to connect was my user I get:Connection Storage: Request to update access token failed. (HTTP Error 'HTTP/1.1 400')I then went to refresh the Azure AD connection and got the following error:Server's certificate does not match the URL.Client does not have access to any certificates from the following issuers:Go Daddy Secure Certificate Authority - G2Go Daddy Root Certificate Authority - G2I am able to get to

2107
tino
Contributor
16 days ago
dellerbeck
Contributor
dellerbeckContributor
asked in Automation
Automation Parameters are Resetting

If you have an existing automation and need to make a change, you make your changes and publish \\ overwrite in FME Forms. Once you go to the automation and stop it, all parameters are reset to defaults. This happens even to workspaces that were not updated. This has happened the last 2 or 3 releases, currently we are onFME Flow 2023.1Build 23619 - win64

1385
sigher
Contributor
16 days ago
ebygomm
Contributor
ebygommContributor
asked in Security
Stopping the current automation automatically - authentication

We currently have a process where an automation is stopped by any upstream failure triggering a workspace which contains a httpcaller with a call to the fme rest api to stop the automation. The request is configured to use $(FME_SERVER_WEB_URL) and an the Automation General Attribute/Key AutomationID to construct the request for the api so in this way it is generic. I’m wondering if there’s any way to use the user running the automation as authentication for the http request?

251
dylan.at.safe
Safer
19 days ago
markcoopersdc
Contributor
markcoopersdcContributor
asked in Automation
Log file not created for jobs unless admin account is logged in to the web interface

Hi We have recenly started using FME Flow more. When someone runs a flow app no log file is created. However, if the admin user logs onto the web interface and they run the app again (on the same or different pc), a log file is created. Is this expected behaviour? If not, does anyone know how to get round this? Thanks  

222
markcoopersdc
Contributor
20 days ago
sameer
Contributor
sameerContributor
asked in Automation
FME Workspace APP - Markdown URL / Link using Target Blank

HelloI have a Workspace App in dev phase. Since I cannot embed a HTML page by design or make use of dynamic user parameters to retrieve an event ID for now,  I went with the idea of using a URL / Link within the description box, (Markdown style).URL points to SP OnlineI’d like to implement target=”blank”.[link](url){:target="_blank"} (Kramdown)Is this possible? ThanksSameer

625
sameer
Contributor
20 days ago

Badge winners

Show all badges
30,141
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.