- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow
Architecture

Architecture

Installation, product configuration, and setup.

627 Posts
2,043 Replies

When you subscribe we will email you when there is a new topic in this category

627 Posts

Most replies

Most views

Newest first

eanolan2024Contributor

asked in Architecture

ADFS SAML use in FME FLOW

Hello, I am new to administering FLOW. We actually have just purchased the product and are in the process of setting everything up, and learning.I would like to integrate SAML with FLOW. It is straightforward enough with the ability to use the metadata URL or import from a xml file. All of that and actually enabling SAML under User Management was quite straightforward. We are a huge IT shop and I have to submit tickets to another department to have the applications integrated with ADFS.The software was installed as port 8080, and is accessed through an F5 (load balancer). After install, I had the F5 team set up listening on port 8080 and the software is accessible via the F5 VIP and internally. All that said, there have been a few issues. Initially the software was passing communication for ADFS over http, because that is how it was setup. So this was expected. The problem there, is the ADFS console would not allow http to be used, it only allows https. I have since used a FME article

182

4 days ago

dsign-worldContributor

asked in Architecture

FME Warning: Failed to free sufficient memory (while 30GB of memory are free)

FME shows the following warning during the translation:2023-09-06 10:24:29|5015.8| 0.3|WARN |Failed to free sufficient memory to reach the process usage limit. To improve stability and performance please increase the memory available to FME. Available memory can be increased by adding physical RAM, increasing swap space, or closing other applicationsI'm using FME(R) 2022.2.1.0 (20221202 - Build 22776 - WIN64) on Windows 10 22H2 Build 19045.2006. I have 64 GB of memory. FME uses about 10 GB during that translation and 50% of RAM are free. Why does FME show this warning when there should be enough free space? FME says it's trying to free memory because it doesn't have enough memory, right? Why does FME fail to free memory? How can FME achieve that goal? What does it do to free memory? And what is the process usage limit? Also I get these log messages and I feel like optimizing memory usage takes up very much time. Does the "Optimizing Memory Usage" message have to do with the warning a

3789

5 days ago

fred.haanContributor

asked in Architecture

API Rest FME Custom Body request and custom response

Hello, I am using the 2024 versions of FME (Form & Flow). I would like to create an FME Form workspace that will be deployed on FME Flow and later called via the FME REST API. In this API call (POST), I would like to include structured information in the request body that the FME Workbench can process. For example, the request body could look like this: ```json{ "entities": [ { "schemaName": "xxxxx", "entityName": "xxxx", "fieldNames": [ "ID", "NR_ATT" ] } ], "whereClause": "ID = 'xxxxx'", "constraint": "FIRST"}``` I would also like the response of the execution to contain structured information, which could include standard execution feedback along with additional custom data. For example, the response could look like this: ```json{ "rows": [ { "fields": [ {"schemaName": "xxxx", "entityName": "yyyy", "fieldName": "zzzz", "fieldValue":

587

6 days ago

matthewbContributor

asked in Architecture

Installing Custom Python SDK to FME Flow.

In order to pull data from one of our clients’ data repositories, we are using a custom Python SDK that they have provided. Installation and testing went smoothly for use with FME Form, but no so well with FME Flow. For FME Form, I used fme.exe python -m pip install. For FME Flow, I’ve tried navigating to Resouces>Engine>Plugins>Python>python311 and uploading the directories there, I’ve tried running fme.exe python -m pip install with the target directory set the FME Flow Resouces\Engine\Plugins\Python\python311. No matter what I do, my transformer fails with the following errors:Python Exception <ModuleNotFoundError>: No module named xxxx Any suggestions?

391

19 days ago

lifalin2016Contributor

asked in Architecture

FME Flow 2024 gets versioning wrong

Hi.I just did an engine upgrade of my 2024.0.1 Flow instance to the very latest version 2024.2.1I then created a workspace in Form version 2024.2.0, and tried to upload it to Flow to test deployment parameters.But I get a warning stating, that Flow is older than Form, and the workspace is unrunnable on Flow.This is not good, as an engine upgrade is a nice way to keep Flow running with the latest version without the hazzle of major downtime and reinstallation.Why can’t the Flow 2024 UI handle engine upgrades, and why is my workspace blocked on Flow ?

444

24 days ago

mconway

asked in Architecture

Unable to get local timestamps in a worksapce on FME Server (Docker)

I'm running FME Server 2019.2 in Docker Swarm using a fairly standard compose file. In the past, we have had some minor issues with time synching, and the containers believing they were in UTC. Most of that has been resolved, however, we noticed today that we are unable to get a local timestamp generated from within a workspace, even though FME server logs in local time, and all of the containers are pulling time from their host.Using date, echo /etc/timezone or $TZ all return PST, however the workspace always returns UTC. I've got a volume on all our containers to use local host's timezone (/etc/localtime:/etclocaltime:ro) with no effect. Does anyone know what else I can look at to fix this? To be clear - all of our job schedules run localtime, but when trying to use date/time functions inside a workspace, UTC and localtime are the same according to FME.

292

1 month ago

jaygrg111_Contributor

asked in Architecture

How to fix when BackupConfiguration.fmw fails to retrieve the Backup?

Hi everybody, Our BackupConfiguration.fmw has been failing lately. Based on the following post, I created new schedule on Flow but still having issues. With the new schedule, I am having the attached error. However, gisadmin does have a fmesuperuser role. Any insights is highly appreciated. Thanks in advance!

324

1 month ago

m.vlamingsContributor

asked in Architecture

Additional Capabilites MRFCleanFactory and MRFCleanFactory3D missing after upgrade from FME Flow 2023.1 to 2024.2

Hi Everyone,today I upgraded from FME Flow 2023.1.1.1 to 2024.2 (Express install) all went well and I do have a working environment. But I noticed something. Before the upgrade I made a screenshot of the license information and it said I had Additional Capabilities: After the upgrade (I installed a new fmelic file I received by mail from codes@safe.com ) these are missing: So, does anyone know how to fix this? If these capabilities are called upon in workbenches will they break?

261

1 month ago

bhkContributor

asked in Architecture

Compatibility Concerns with FME Desktop/Server 2021.1 and ArcGIS Enterprise 11.3 -ArcGIS Pro 3.1

Hello FME Community,We are currently using the following software versions:FME Desktop: 2021.1.0.0 (20210630 - Build 21607 - WIN64, Python 3.6-3.9) FME Server: 2021.1 (Build 21607 - win64, Python 3.6-3.9) ArcGIS Enterprise: 10.9.1 (Python 3.7.11/2.7.18) ArcGIS Pro: 2.7 (Python 3.7.9)And we did not encounter any compatibility issues with our current setup regarding Python versions (as expected).Now, we have a scheduled plan to upgrade our ArcGIS software to ArcGIS Enterprise 11.3 and ArcGIS Pro 3.1 this year, followed by an upgrade to our FME software next year.Since ArcGIS Enterprise 11.3 uses Python 3.11 and ArcGIS Pro 3.1 uses Python 3.9.16, could anyone please share if you have noticed any concerns or compatibility issues when using FME Desktop and Server 2021.1 with ArcGIS Enterprise 11.3 and ArcGIS Pro 3.1? Do we need to upgrade FME before ArcGIS, from a technical performance and issues standpoint (please disregard tech support concerns for the purpose of this post)?

1383

1 month ago

georgeblake270Contributor

asked in Architecture

Finding Rail Routes between two stations

Hey guys, stumped with this one:I’m trying to find the distance of rail tracks between two stations - I’ve got the points for the stations and lines of the railway tracks but I need to find the route between the two stations and measure its distance.I’ve been able to limit the area but finding the most direct route and not measuring the distance of extra lines coming onto the route.Thank you in advance, any help is much appreciated.

505

1 month ago

nielsgerritsVIP

asked in Architecture

3D mode not supported on this platform.

One of my teammembers suffered a hardware crash recently. He got a replacement laptop from IT but it’s performance is terrible. When opening the Inspector, 3D mode returns next image:It is a Lenovo Thinkpad P15 with an i7, 64GB ram and an NVIDEA RTX A2000 GPU. Windows 11.My machine is almost the same spec and works flawless. Windows 10.I know this question is not really FME related but what would be logical things to check / try to get it running the inspector in 3D?What we did was install the latest videocard driver, but this did not change anything. Our IT is only staffed to solve Office365 problems, no help from there.

776

1 month ago

m.vlamingsContributor

asked in Architecture

After Upgrade to 2024.2 Our 2 Engines are working, but seem to be unassigned to the server.

After I finished the installation to 2024.2 (upgrading from 2023.1) I seemed to have the same issue as described in this post: So I followed all the suggestions in the Best answer by laurawatsafe.(I blured out url's and server names in my screenshots for privacy reasons)As described by laurawatsafe I ended up with both localhost and Serverhostname. In the screenshot below you can clearly see that at the moment after I stopped the Engines and was able to remove localhost, there were 0 standard engines assigned to localhost.So at this point I thought my problem was fixed. (I am wondering why this issue is in 2024.2 as it was fixed in 2018/2019. So this bug seems to have reappeared.)But now I have some very strange behavior in the interface:I tried to assign the two engines to my server, but after the delete action of localhost is shows 2/2 engines in use: This gives error: I end up with this: When I sort on hostname on the Engines tab, there still seems to be a refference to localhost:

853

1 month ago

nordpilContributor

posted in Architecture

Restoring the server configuration database

I just had a little adventure in restoring the FME Server (we are on 2022) configuration database - that is the internal postgres database for configuration and job history. We will move it to mssql eventually...I managed to hose our test server the other day - it is this problem I wrote a post about here:Now we have had a scheduled job that creates a full pg_dump backup of the data, and the latest run was just 2 days old! We have had the backup system in place, but we have never had to do a restore - the backup is also for archiving the history.It took a lot of trial and error and experimentation to figure out how do it, but eventually I got there.* Drop the fmeserver database* Recreate the database* Restore from backup (schema + data)* Grant permissionsHere are my more detailed notes...https://lnkd.in/dz-usUSU

110

1 month ago

vxn43Supporter

asked in Architecture

What folder are the uploaded workspaces and automations stored in?

Hello, I am using FME Flow 2021 with 2 VMs and a Load Balancer all on Windows 2016. In Windows File Explorer (not in FME Flow), what folder/subfolder(s) are the uploaded workspaces and automations stored in? Is there a link to a document that explains what files are stored in what File Explorer folders or something similar for FME Flow? Thank you in advance for your assistance.

303

1 month ago

vivekdey451Participant

asked in Architecture

Running Parallel FME Server version due to Smallworld Incompatibility

Hello FME Folks, I know that we can run multiple FME Desktop version on same Windows Machine with same licence.Can we do that with FME Server on different Windows Server machines?We have a SmallWorld DB incompatibility for our FME Server upgrade and EO SmallWorld upgrade will happen later.SO, we have to run two FME Server environment. Is that a red flag ? OK?Thanks,Vivek

455

2 months ago

gjaguilarContributor

asked in Architecture

Change the disk where the results are stored

Hello everyoneIn a project I'm working on, we use the 2021 version and the results of the processes are stored on a disk so that the user can download those results to their personal computer using the URL; for example:https://<url>/download/results/110096.zipAs we understand it, download is like an alias of the path on the disk and Results is a directory on the disk, for example the results are in G:\FME\Results and 110096 is a compressed file with the resultsThese results must remain on that disk for 3 days so that the user has the opportunity to download them, but the problem is that due to the size of the results files, the disk fills up and the processes failWe have another disk with more space. How could we change it so that the results are saved on that other disk and users have access to download them?The person who did the configuration no longer works for our company but told me that to change disks it was only necessary to "expose" the directories of that disk in the T

816

2 months ago

ecxContributor

asked in Architecture

FME Workbench Metadata - does FME have a built in solution?

Does FME Flow (server) have a way to store FME workbench metadata? I can’t seem to find anything.I mean metadata about the fme workbench, for example info such as describing what it does, who its made for (customer), having some tags and a owner doesn’t cut it. Also a way to export this information would be useful. How does everyone else manage their FME Flow servers with hundreds of workbenches and automations?Open to any third party application suggestions too.Thanks.

341

2 months ago

mtdObserver

asked in Architecture

looking for installation architecture suggestions

Installing FME flow for the first time. Looking at it from IT perspective, not an FME user myself. Current users are using FME Form on Windows, and I’m upgrading this FME Flow server. We have very low load, but growing and so I’m moving our “operations” from under a user’s desk to our data center. We mange a lot of Windows and Linux systems, but prefer Linux when there’s a choice, and Linux is genuinely fully supported by vendor. Initially I thought it had to run on Windows do to ArcGIS jobs which apparently requires Windows ESRI DLLs. But upon closer read of docs, it appears that a distributed install allows all components on Linux except engine(s) for ArcGIS jobs. While I lean toward Linux, I also favor simplicity and eschew unnecessary complexity, and obviously a distributed install is more complex, but depending on the specific software, more complex doesn’t necessarily mean that much more work. I don’t however need fault-tolerantAny recommendations? Windows single-system

271

3 months ago

mechilders11Contributor

asked in Architecture

FME 2024.2 Anticipated Release Date

We are planning our 2024 upgrade and need to know when the anticipated release date is for FME 2024.2. We are looking to upgrade soon, but may delay some depending on the anticipated release date. Thank you in advance for your help!

1891

4 months ago

hedieh

asked in Architecture

FME for Home Use

Where to get the FME for Home Use, like ArcGIS Home Use license?

126517

4 months ago

missp29Contributor

asked in Architecture

Adding FME Engines on a Separate Machine

Hi All,We are working on adding new FME Engines on a Separate Linux Machine in a fault-tolerance environment where two FME Cores have been configured. Following the FME Flow Administrator’s Guidehttps://docs.safe.com/fme/html/FME-Flow/AdminGuide/Adding_FME_Engines_on_Separate_Machine.htmThe install instructions have this step on the Linux section,The installer prompts you for the name of the <coreHost>. In a fault-tolerant installation, the primary <coreHost> should always be specified. Do not specify the failover host.Here we are not very clear. We have two FME Flow Cores.first, how do we know which one is supposed to be the primary or the failover host between two Cores?Secondly, if say that the first Core to start can be considered the primary, what happens to the engines on a Separate Engine if the primary Core is down?Can anyone give us some helps on this?Thanks,-John

684

4 months ago

dbannon22Contributor

asked in Architecture

IMAP failure on FME Flow installed on Azure VM

I have an express install of FME Flow (2024.1) on a Azure VM and I am having troubles getting a stable connection to imap.gmail.com. The validation is sporadic. It will validate and be working and recieving notifications and then it will give me an error that the port or security are not correct. Thu-11-Jul-2024 06:04:41.318 AM : com.sun.mail.util.MailConnectException: Couldn't connect to host, port: imap.gmail.com, 993; timeout 15000;I have enabled inbound and outbound rules over port 993 for imap.gmail.com on Azure. I am not sure what else I could be missing. Any help is appreciated.

432

4 months ago

mattwilkieSupporter

asked in Architecture

Error 2755 installing FME Flow

I get this error installing FME Flow 2024.1 on Windows 10. I don’t believe it’s related to the only other forum thread on this error as I have 30 GB of free space on C:.

367

5 months ago

mkastelijnsContributor

asked in Architecture

Performance question fme 2024

Dear FME friends, We upgraded our fme 2023.1.1 to 2024.0.3. To test the new version, several test were done on the new environment, among which a performancetest for databases PostgreSQL and Oracle.The workspaces that are run in a automation do 3 things:Download open data en put this data in our own postgresql datase Read the data from the database Delete the data from the databaseWe saw strange things going on in the numbers for both our postgresql and Oracle test. We saw for the postgresql test that the CPU-time was longer than the elapsed time. Furthermore the running time in 2024 was generally longer than in 2021. Please find attached the examples of the runs on fme 2021 and fme 2024. It is clearly seen something is wrong. Can you explain why in the 21 runs the elapsed time seems to be more than the cpu time and in the 24 run it is the other way around. The used dataset is exacly the same in both workspaces publised on fme server/flow.We did the same experiment 5 times for several

934

5 months ago

rob_m_esriukContributor

asked in Architecture

FME server doesn't create log for failed workbench

We have a server running many jobs and one of them normally runs successfully and a log can be reviewed but at other times the job fails and when i access it i get the message Error: The log file for job ID "######" does not exist.I’ve seen the post in FME Server 2019 Error: The log file for job ID "2613" does not exist and we have plenty of disk space, the job frequently works successfully, other jobs are still creating log files. I’ve checked all the suggestions in that post.The failed job is recorded as running for a couple of seconds but without the log I have no insight into why it is failing

1377

5 months ago

Page 1 / 26

Badge winners

sam_keasthas earned the badge Welcome Back
chadprophas earned the badge Welcome Back
mpsimshas earned the badge FME Flow Authoring Training
boostpadhas earned the badge FME Form Advanced Training
boubcherhas earned the badge Welcome Back

Show all badges

30,425: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.