Architecture

Hello FME Community users, I am trying to upgrade FME FLow from 2024.0.3 to 2024.2.1. I looked into this article https://docs.safe.com/fme/html/FME-Flow/AdminGuide/Upgrade-in-Place-Same-Machine.htmJust wondering if there is a better compared to install/uninstall as mentioned above. Such as done on ESRI side.

I created an FME Flow cleanup task for a folder under Resources/Temp. However, cleanup isn’t happening on my test folder because FME Flow isn't resolving to the correct path for the FME_SHAREDRESOURCE_TEMP parameter. The path on the server is D:\ProgramData\Safe Software\FMEFlow\resources\temp\, which matches the path for the FME_SHAREDRESOURCE_TEMP parameter listed in the fmeServerConfig.txt file. The error in the system cleanup log states “Path not found for system cleanup:D:\ProgramData\Safe Software\FMEFlow\resources\system\temp\AA_Test.” - same but with “system” folder added in the path. Should I be using a different parameter? I'm unclear why the path for FME_SHAREDRESOURCE_TEMP is different in the system cleanup task from what is listed in fmeServerConfig.txt file.

We are trying to update our on-prem FLOW (from version 2023.2) and I have successfully created the backup but am unable to determine the location of where the file was saved to.  The FLOW interface does not provide any clues as it does not indicate the target directoy (please see attached screen grab).  And doing a seach on my C and D drives with keyword ‘.fsconfig’ yelds no results. Where does the backup file get saved to?  Thanks!

We have a server running many jobs and one of them normally runs successfully and a log can be reviewed but at other times the job fails and when i access it i get the message Error: The log file for job ID "######" does not exist.I’ve seen the post in FME Server 2019 Error: The log file for job ID "2613" does not exist and we have plenty of disk space, the job frequently works successfully, other jobs are still creating log files. I’ve checked all the suggestions in that post.The failed job is recorded as running for a couple of seconds but without the log I have no insight into why it is failing

We currently run all our FME jobs as an AD service account.  Unless a workspace uses SQL Authentication for DB access, all DB access occurs as this service account.  This has turned into a security concern and I’m sure others have dealt with this.  Which of the following is the best solution or what have I missed?It sounds like the new FME licensing allows unlimited engines.  Could we create a new engine for each workspace and run it as the service account with DB access, and access to network shares?  Kindly point me to steps to do this.Group Managed Service Accounts - can a FME workspace run as a gMSA? Use SQL Authentication instead of Windows Authentication for DB access.  I understand FME encrypts passwords but we’d still use the FME service account to access a ton of resources.How do others handle FME jobs and access to resources?

In order to pull data from one of our clients’ data repositories, we are using a custom Python SDK that they have provided.  Installation and testing went smoothly for use with FME Form, but no so well with FME Flow.   For FME Form, I used fme.exe python -m pip install.  For FME Flow, I’ve tried navigating to Resouces>Engine>Plugins>Python>python311 and uploading the directories there, I’ve tried running fme.exe python -m pip install with the target directory set the FME Flow Resouces\Engine\Plugins\Python\python311.   No matter what I do, my transformer fails with the following errors:Python Exception <ModuleNotFoundError>: No module named xxxx Any suggestions?

Hello, I am new to administering FLOW. We actually have just purchased the product and are in the process of setting everything up, and learning.I would like to integrate SAML with FLOW. It is straightforward enough with the ability to use the metadata URL or import from a xml file. All of that and actually enabling SAML under User Management was quite straightforward. We are a huge IT shop and I have to submit tickets to another department to have the applications integrated with ADFS.The software was installed as port 8080, and is accessed through an F5 (load balancer). After install, I had the F5 team set up listening on port 8080 and the software is accessible via the F5 VIP and internally. All that said, there have been a few issues. Initially the software was passing communication for ADFS over http, because that is how it was setup. So this was expected. The problem there, is the ADFS console would not allow http to be used, it only allows https. I have since used a FME article

Hello Forum,I am currently working on a task that involves copying files from a source server (Server 1) to a destination server (Server 2). I am new to FME and am unsure how to approach this.Could this process be achieved using an FME transformer, or would it require writing a Python script? I would greatly appreciate any guidance or suggestions on where to begin.Thank you in advance for your support!

Where can one find the system cleanup log files on FME Flow (2023.2; build 23764)? I’m testing cleaning up a folder under Resources/Temp. I don't see any corresponding logs under Jobs or System Configuration → System Cleanup. Or, is it possible to test a specific cleanup task on FME Flow? I’m currently at the mercy of whenever system cleanup runs, which is vaguely set to once a day at no set time so not ideal for testing.

FME shows the following warning during the translation:2023-09-06 10:24:29|5015.8|  0.3|WARN  |Failed to free sufficient memory to reach the process usage limit. To improve stability and performance please increase the memory available to FME. Available memory can be increased by adding physical RAM, increasing swap space, or closing other applicationsI'm using FME(R) 2022.2.1.0 (20221202 - Build 22776 - WIN64) on Windows 10 22H2 Build 19045.2006. I have 64 GB of memory. FME uses about 10 GB during that translation and 50% of RAM are free. Why does FME show this warning when there should be enough free space? FME says it's trying to free memory because it doesn't have enough memory, right? Why does FME fail to free memory? How can FME achieve that goal? What does it do to free memory? And what is the process usage limit? Also I get these log messages and I feel like optimizing memory usage takes up very much time. Does the "Optimizing Memory Usage" message have to do with the warning a

Hello,  I am using the 2024 versions of FME (Form & Flow).  I would like to create an FME Form workspace that will be deployed on FME Flow and later called via the FME REST API.  In this API call (POST), I would like to include structured information in the request body that the FME Workbench can process.  For example, the request body could look like this:  ```json{    "entities": [        {            "schemaName": "xxxxx",            "entityName": "xxxx",            "fieldNames": [                 "ID",                "NR_ATT"            ]        }    ],    "whereClause": "ID = 'xxxxx'",        "constraint": "FIRST"}```  I would also like the response of the execution to contain structured information, which could include standard execution feedback along with additional custom data.  For example, the response could look like this:  ```json{    "rows": [        {            "fields": [                {"schemaName": "xxxx", "entityName": "yyyy", "fieldName": "zzzz", "fieldValue":

Upgrading from FME Server 2022 to Flow 2024.2, Very frustrating to see no Schedule Categories in FME Flow 2024.2! WHY ? Instead of finally making the tabular Schedules page sortable (how old is that idea?) or adding some useful filtering, it’s now time for tagging? Man!All my workspaces are organized by repository. Have been for years. My Schedules were organized by Categories, which matched Repository names. What was wrong with that? Go ahead and add tagging but why remove the categories? If I’m missing something, please let me know and I will gladly stand corrected. My real concern here is not with having to invent tags and changing my ways. Rather it’s the fear that Safe is becoming more like ESRI where changes seem to get rolled out not in an effort to improve the product but to make it look like the dev teams are constantly working. Please don’t follow their lead. FME has been my haven of sanity and productivity over the years when ESRI bugs shut me down. I can ignore the silly re

I'm running FME Server 2019.2 in Docker Swarm using a fairly standard compose file. In the past, we have had some minor issues with time synching, and the containers believing they were in UTC. Most of that has been resolved, however, we noticed today that we are unable to get a local timestamp generated from within a workspace, even though FME server logs in local time, and all of the containers are pulling time from their host.Using date, echo /etc/timezone or $TZ all return PST, however the workspace always returns UTC. I've got a volume on all our containers to use local host's timezone (/etc/localtime:/etclocaltime:ro) with no effect. Does anyone know what else I can look at to fix this? To be clear - all of our job schedules run localtime, but when trying to use date/time functions inside a workspace, UTC and localtime are the same according to FME. 

Hi Everyone,today I upgraded from FME Flow 2023.1.1.1 to 2024.2 (Express install) all went well and I do have a working environment. But I noticed something. Before the upgrade I made a screenshot of the license information and it said I had Additional Capabilities: After the upgrade (I installed a new fmelic file I received by mail from codes@safe.com ) these are missing: So, does anyone know how to fix this? If these capabilities are called upon in workbenches will they break? 

Good morning. According to this article I should be able to download resources using an URL similar to:https://fmeserver.example.com/fmerest/v3/resources/connections/FME_SHAREDRESOURCE_TEMP/filesys/testSpreadsheet.xlsxBut when I try to do so, instead of getting the file I get information about the file:http://sigdesafme.dfa.es/fmerest/v3/resources/connections/FME_SHAREDRESOURCE_DATA/filesys/GASTDM01/wrapper.logWhat I get in the web explorer is this: {"date":"2024-07-17T13:04:52+02:00","path":"/GASTDM01/","size":153839356,"name":"wrapper.log","type":"FILE"}Am I missing something?I have tried to change filesys for “download” or “downloadzip”, but the ZIP it downloads is empty.The version of FME Server is 2021.1.

Hello FME Community,We are currently using the following software versions:FME Desktop: 2021.1.0.0 (20210630 - Build 21607 - WIN64, Python 3.6-3.9) FME Server: 2021.1 (Build 21607 - win64, Python 3.6-3.9) ArcGIS Enterprise: 10.9.1 (Python 3.7.11/2.7.18) ArcGIS Pro: 2.7 (Python 3.7.9)And we did not encounter any compatibility issues with our current setup regarding Python versions (as expected).Now, we have a scheduled plan to upgrade our ArcGIS software to ArcGIS Enterprise 11.3 and ArcGIS Pro 3.1 this year, followed by an upgrade to our FME software next year.Since ArcGIS Enterprise 11.3 uses Python 3.11 and ArcGIS Pro 3.1 uses Python 3.9.16, could anyone please share if you have noticed any concerns or compatibility issues when using FME Desktop and Server 2021.1 with ArcGIS Enterprise 11.3 and ArcGIS Pro 3.1? Do we need to upgrade FME  before ArcGIS, from a technical performance and issues standpoint (please disregard tech support concerns for the purpose of this post)?

Hey guys, stumped with this one:I’m trying to find the distance of rail tracks between two stations - I’ve got the points for the stations and lines of the railway tracks but I need to find the route between the two stations and measure its distance.I’ve been able to limit the area but finding the most direct route and not measuring the distance of extra lines coming onto the route.Thank you in advance, any help is much appreciated.

One of my teammembers suffered a hardware crash recently. He got a replacement laptop from IT but it’s performance is terrible. When opening the Inspector, 3D mode returns next image:It is a Lenovo Thinkpad P15 with an i7, 64GB ram and an NVIDEA RTX A2000 GPU. Windows 11.My machine is almost the same spec and works flawless. Windows 10.I know this question is not really FME related but what would be logical things to check / try to get it running the inspector in 3D?What we did was install the latest videocard driver, but this did not change anything. Our IT is only staffed to solve Office365 problems, no help from there.

After I finished the installation to 2024.2 (upgrading from 2023.1) I seemed to have the same issue as described in this post: So I followed all the suggestions in the Best answer by laurawatsafe.(I blured out url's and server names in my screenshots for privacy reasons)As described by laurawatsafe I ended up with both localhost and Serverhostname. In the screenshot below you can clearly see that at the moment after I stopped the Engines and was able to remove localhost, there were 0 standard engines assigned to localhost.So at this point I thought my problem was fixed. (I am wondering why this issue is in 2024.2 as it was fixed in 2018/2019. So this bug seems to have reappeared.)But now I have some very strange behavior in the interface:I tried to assign the two engines to my server, but after the delete action of localhost is shows 2/2 engines in use: This gives error: I end up with this:  When I sort on hostname on the Engines tab, there still seems to be a refference to localhost: 

I just had a little adventure in restoring the FME Server (we are on 2022) configuration database - that is the internal postgres database for configuration and job history. We will move it to mssql eventually...I managed to hose our test server the other day - it is this problem I wrote a post about here:Now we have had a scheduled job that creates a full pg_dump backup of the data, and the latest run was just 2 days old! We have had the backup system in place, but we have never had to do a restore - the backup is also for archiving the history.It took a lot of trial and error and experimentation to figure out how do it, but eventually I got there.* Drop the fmeserver database* Recreate the database* Restore from backup (schema + data)* Grant permissionsHere are my more detailed notes...https://lnkd.in/dz-usUSU

Hello, I am using FME Flow 2021 with 2 VMs and a Load Balancer all on Windows 2016. In Windows File Explorer (not in FME Flow), what folder/subfolder(s) are the uploaded workspaces and automations stored in? Is there a link to a document that explains what files are stored in what File Explorer folders or something similar for FME Flow? Thank you in advance for your assistance. 

Hello FME Folks, I know that we can run multiple FME Desktop version on same Windows Machine with same licence.Can we do that with FME Server on different Windows Server machines?We have a SmallWorld DB incompatibility for our FME Server upgrade and EO SmallWorld upgrade will happen later.SO, we have to run two FME Server environment. Is that a red flag ? OK?Thanks,Vivek

Hello everyoneIn a project I'm working on, we use the 2021 version and the results of the processes are stored on a disk so that the user can download those results to their personal computer using the URL; for example:https://<url>/download/results/110096.zipAs we understand it, download is like an alias of the path on the disk and Results is a directory on the disk, for example the results are in G:\FME\Results and 110096 is a compressed file with the resultsThese results must remain on that disk for 3 days so that the user has the opportunity to download them, but the problem is that due to the size of the results files, the disk fills up and the processes failWe have another disk with more space. How could we change it so that the results are saved on that other disk and users have access to download them?The person who did the configuration no longer works for our company but told me that to change disks it was only necessary to "expose" the directories of that disk in the T

Does FME Flow (server) have a way to store FME workbench metadata? I can’t seem to find anything.I mean metadata about the fme workbench, for example info such as describing what it does, who its made for (customer), having some tags and a owner doesn’t cut it. Also a way to export this information would be useful. How does everyone else manage their FME Flow servers with hundreds of workbenches and automations?Open to any third party application suggestions too.Thanks.

Installing FME flow for the first time.  Looking at it from IT perspective, not an FME user myself.  Current users are using FME Form on Windows, and I’m upgrading this FME Flow server.  We have very low load, but growing and so I’m moving our “operations” from under a user’s desk to our data center.   We mange a lot of Windows and Linux systems, but prefer Linux when there’s a choice, and Linux is genuinely fully supported by vendor.  Initially I thought it had to run on Windows do to ArcGIS jobs which apparently requires Windows ESRI DLLs.  But upon closer read of docs, it appears that a distributed install allows all components on Linux except engine(s) for ArcGIS jobs.  While I lean toward Linux, I also favor simplicity and eschew unnecessary complexity, and obviously a distributed install is more complex, but depending on the specific software, more complex doesn’t necessarily mean that much more work.  I don’t however need fault-tolerantAny recommendations?  Windows single-system