Skip to main content
  • EN

Architecture

Installation, product configuration, and setup.

  • 619 Posts
  • 2,008 Replies
619 Posts
nordpil
Contributor
nordpilContributor
posted in Architecture
Restoring the server configuration database

I just had a little adventure in restoring the FME Server (we are on 2022) configuration database - that is the internal postgres database for configuration and job history. We will move it to mssql eventually...I managed to hose our test server the other day - it is this problem I wrote a post about here:Now we have had a scheduled job that creates a full pg_dump backup of the data, and the latest run was just 2 days old! We have had the backup system in place, but we have never had to do a restore - the backup is also for archiving the history.It took a lot of trial and error and experimentation to figure out how do it, but eventually I got there.* Drop the fmeserver database* Recreate the database* Restore from backup (schema + data)* Grant permissionsHere are my more detailed notes...https://lnkd.in/dz-usUSU

50
nordpil
Contributor
21 hours ago
vxn43
Supporter
vxn43Supporter
asked in Architecture
What folder are the uploaded workspaces and automations stored in?

Hello, I am using FME Flow 2021 with 2 VMs and a Load Balancer all on Windows 2016. In Windows File Explorer (not in FME Flow), what folder/subfolder(s) are the uploaded workspaces and automations stored in? Is there a link to a document that explains what files are stored in what File Explorer folders or something similar for FME Flow? Thank you in advance for your assistance. 

233
redgeographics
Celebrity
6 days ago
nielsgerrits
VIP
nielsgerrits
asked in Architecture
3D mode not supported on this platform.

One of my teammembers suffered a hardware crash recently. He got a replacement laptop from IT but it’s performance is terrible. When opening the Inspector, 3D mode returns next image:It is a Lenovo Thinkpad P15 with an i7, 64GB ram and an NVIDEA RTX A2000 GPU. Windows 11.My machine is almost the same spec and works flawless. Windows 10.I know this question is not really FME related but what would be logical things to check / try to get it running the inspector in 3D?What we did was install the latest videocard driver, but this did not change anything. Our IT is only staffed to solve Office365 problems, no help from there.

394
nielsgerrits
VIP
21 days ago
vivekdey451
Participant
vivekdey451Participant
asked in Architecture
Running Parallel FME Server version due to Smallworld Incompatibility

Hello FME Folks, I know that we can run multiple FME Desktop version on same Windows Machine with same licence.Can we do that with FME Server on different Windows Server machines?We have a SmallWorld DB incompatibility for our FME Server upgrade and EO SmallWorld upgrade will happen later.SO, we have to run two FME Server environment. Is that a red flag ? OK?Thanks,Vivek

455
vivekdey451
Participant
1 month ago
gjaguilar
Contributor
gjaguilarContributor
asked in Architecture
Change the disk where the results are stored

Hello everyoneIn a project I'm working on, we use the 2021 version and the results of the processes are stored on a disk so that the user can download those results to their personal computer using the URL; for example:https://<url>/download/results/110096.zipAs we understand it, download is like an alias of the path on the disk and Results is a directory on the disk, for example the results are in G:\FME\Results and 110096 is a compressed file with the resultsThese results must remain on that disk for 3 days so that the user has the opportunity to download them, but the problem is that due to the size of the results files, the disk fills up and the processes failWe have another disk with more space. How could we change it so that the results are saved on that other disk and users have access to download them?The person who did the configuration no longer works for our company but told me that to change disks it was only necessary to "expose" the directories of that disk in the T

776
gjaguilar
Contributor
1 month ago
ecx
Contributor
ecxContributor
asked in Architecture
FME Workbench Metadata - does FME have a built in solution?

Does FME Flow (server) have a way to store FME workbench metadata? I can’t seem to find anything.I mean metadata about the fme workbench, for example info such as describing what it does, who its made for (customer), having some tags and a owner doesn’t cut it. Also a way to export this information would be useful. How does everyone else manage their FME Flow servers with hundreds of workbenches and automations?Open to any third party application suggestions too.Thanks.

331
david_r
Evangelist
1 month ago
dsign-world
Contributor
dsign-worldContributor
asked in Architecture
FME Warning: Failed to free sufficient memory (while 30GB of memory are free)

FME shows the following warning during the translation:2023-09-06 10:24:29|5015.8|  0.3|WARN  |Failed to free sufficient memory to reach the process usage limit. To improve stability and performance please increase the memory available to FME. Available memory can be increased by adding physical RAM, increasing swap space, or closing other applicationsI'm using FME(R) 2022.2.1.0 (20221202 - Build 22776 - WIN64) on Windows 10 22H2 Build 19045.2006. I have 64 GB of memory. FME uses about 10 GB during that translation and 50% of RAM are free. Why does FME show this warning when there should be enough free space? FME says it's trying to free memory because it doesn't have enough memory, right? Why does FME fail to free memory? How can FME achieve that goal? What does it do to free memory? And what is the process usage limit? Also I get these log messages and I feel like optimizing memory usage takes up very much time. Does the "Optimizing Memory Usage" message have to do with the warning a

2956
australgis
Contributor
1 month ago
mtd
Observer
mtdObserver
asked in Architecture
looking for installation architecture suggestions

Installing FME flow for the first time.  Looking at it from IT perspective, not an FME user myself.  Current users are using FME Form on Windows, and I’m upgrading this FME Flow server.  We have very low load, but growing and so I’m moving our “operations” from under a user’s desk to our data center.   We mange a lot of Windows and Linux systems, but prefer Linux when there’s a choice, and Linux is genuinely fully supported by vendor.  Initially I thought it had to run on Windows do to ArcGIS jobs which apparently requires Windows ESRI DLLs.  But upon closer read of docs, it appears that a distributed install allows all components on Linux except engine(s) for ArcGIS jobs.  While I lean toward Linux, I also favor simplicity and eschew unnecessary complexity, and obviously a distributed install is more complex, but depending on the specific software, more complex doesn’t necessarily mean that much more work.  I don’t however need fault-tolerantAny recommendations?  Windows single-system

221
hkingsbury
Celebrity
2 months ago
mechilders11
Contributor
mechilders11Contributor
asked in Architecture
FME 2024.2 Anticipated Release Date

We are planning our 2024 upgrade and need to know when the anticipated release date is for FME 2024.2. We are looking to upgrade soon, but may delay some depending on the anticipated release date. Thank you in advance for your help!

1731
dylan.at.safe
Safer
2 months ago
H
hedieh
asked in Architecture
FME for Home Use

Where to get the FME for Home Use, like ArcGIS Home Use license?

114617
philippeb
Enthusiast
2 months ago
missp29
Contributor
missp29Contributor
asked in Architecture
Adding FME Engines on a Separate Machine

Hi All,We are working on adding new FME Engines on a Separate Linux Machine in a fault-tolerance environment where two FME Cores have been configured. Following the FME Flow Administrator’s Guidehttps://docs.safe.com/fme/html/FME-Flow/AdminGuide/Adding_FME_Engines_on_Separate_Machine.htmThe install instructions have this step on the Linux section,The installer prompts you for the name of the <coreHost>. In a fault-tolerant installation, the primary <coreHost> should always be specified. Do not specify the failover host.Here we are not very clear. We have two FME Flow Cores.first, how do we know which one is supposed to be the primary or the failover host between two Cores?Secondly, if say that the first Core to start can be considered the primary, what happens to the engines on a Separate Engine if the primary Core is down?Can anyone give us some helps on this?Thanks,-John

634
missp29
Contributor
2 months ago
dbannon22
Contributor
dbannon22Contributor
asked in Architecture
IMAP failure on FME Flow installed on Azure VM

I have an express install of FME Flow (2024.1) on a Azure VM and I am having troubles getting a stable connection to imap.gmail.com. The validation is sporadic. It will validate and be working and recieving notifications and then it will give me an error that the port or security are not correct. Thu-11-Jul-2024 06:04:41.318 AM : com.sun.mail.util.MailConnectException: Couldn't connect to host, port: imap.gmail.com, 993; timeout 15000;I have enabled inbound and outbound rules over port 993 for imap.gmail.com on Azure. I am not sure what else I could be missing. Any help is appreciated. 

382
dbannon22
Contributor
3 months ago
mattwilkie
Contributor
mattwilkieContributor
asked in Architecture
Error 2755 installing FME Flow

I get this error installing FME Flow 2024.1 on Windows 10. I don’t believe it’s related to the only other forum thread on this error as I have 30 GB of free space on C:.    

337
mattwilkie
Contributor
3 months ago
mkastelijns
Contributor
mkastelijnsContributor
asked in Architecture
Performance question fme 2024

Dear FME friends, We upgraded our fme 2023.1.1 to 2024.0.3. To test the new version, several test were done on the new environment, among which a performancetest for databases PostgreSQL and Oracle.The workspaces that are run in a automation do 3 things:Download open data en put this data in our own postgresql datase Read the data from the database Delete the data from the databaseWe saw strange things going on in the numbers for both our postgresql and Oracle test. We saw for the postgresql test that the CPU-time was longer than the elapsed time. Furthermore the running time in 2024 was generally longer than in 2021.  Please find attached the examples of the runs on fme 2021 and fme 2024. It is clearly seen something is wrong. Can you explain why in the 21 runs the elapsed time seems to be more than the cpu time and in the 24 run it is the other way around. The used dataset is exacly the same in both workspaces publised on fme server/flow.We did the same experiment 5 times for several

874
mkastelijns
Contributor
3 months ago
rob_m_esriuk
Contributor
rob_m_esriukContributor
asked in Architecture
FME server doesn't create log for failed workbench

We have a server running many jobs and one of them normally runs successfully and a log can be reviewed but at other times the job fails and when i access it i get the message Error: The log file for job ID "######" does not exist.I’ve seen the post in FME Server 2019 Error: The log file for job ID "2613" does not exist and we have plenty of disk space, the job frequently works successfully, other jobs are still creating log files. I’ve checked all the suggestions in that post.The failed job is recorded as running for a couple of seconds but without the log I have no insight into why it is failing

1217
rob_m_esriuk
Contributor
3 months ago
H
hughloughrey
asked in Architecture
Identify which Operating System is being used?

Is it possible to test (from within FME) which operating system an FME workspace is running on?

234
bobw
Contributor
3 months ago
vn1
Contributor
vn1Contributor
asked in Architecture
FME Flow 2024.1 express install

HelloWondering if anyone else has run into these issues when installing FME Flow 2024.1?  We’re testing an in-place upgrade process on a development system using the express installation.Engine name isn’t being updated correctly.  We changed the configuration per this post, and appears to resolve the issue . Also noticing a problem in the “Start FME Server” / "Restart FME Server” workflows.  Command line is reporting an error that seems related to the FME Database.  

722
vn1
Contributor
4 months ago
bhk
Contributor
bhkContributor
asked in Architecture
Compatibility Concerns with FME Desktop/Server 2021.1 and ArcGIS Enterprise 11.3 -ArcGIS Pro 3.1

Hello FME Community,We are currently using the following software versions:FME Desktop: 2021.1.0.0 (20210630 - Build 21607 - WIN64, Python 3.6-3.9) FME Server: 2021.1 (Build 21607 - win64, Python 3.6-3.9) ArcGIS Enterprise: 10.9.1 (Python 3.7.11/2.7.18) ArcGIS Pro: 2.7 (Python 3.7.9)And we did not encounter any compatibility issues with our current setup regarding Python versions (as expected).Now, we have a scheduled plan to upgrade our ArcGIS software to ArcGIS Enterprise 11.3 and ArcGIS Pro 3.1 this year, followed by an upgrade to our FME software next year.Since ArcGIS Enterprise 11.3 uses Python 3.11 and ArcGIS Pro 3.1 uses Python 3.9.16, could anyone please share if you have noticed any concerns or compatibility issues when using FME Desktop and Server 2021.1 with ArcGIS Enterprise 11.3 and ArcGIS Pro 3.1? Do we need to upgrade FME  before ArcGIS, from a technical performance and issues standpoint (please disregard tech support concerns for the purpose of this post)?

991
hkingsbury
Celebrity
4 months ago
blue_star
Participant
blue_starParticipant
asked in Architecture
Python Exception <OSError>: Could not find a suitable TLS CA certificate bundle, invalid path.

I got an error from FME 2019.2 and FME 2022.1. The error is " Python Exception <OSError>: Could not find a suitable TLS CA certificate bundle, invalid path: C:\\Program Files\\PostgreSQL\\15\\ssl\\certs\\ca-bundle.crt".Anyone has idea how to fix?

13894
natalieatsafe
Safer
5 months ago
mcnaughty79
Participant
mcnaughty79Participant
asked in Architecture
FME Service Account Privileges

We have a domain account setup to run the  3 services required for FME Server 2022 to function.  My question is simple, does this account need to be apart of the Administrators group? 

1052
hkingsbury
Celebrity
5 months ago
yaxi
Contributor
yaxiContributor
asked in Architecture
Questions about creating a LOD2 CityGML model for a neighborhood

HiI am currently looking to create a CityGML model of the buildings in a specific area using various spatial data. I have followed this tutorial Point Cloud to 3D Terrain Model with Buildings and obtained an Adobe 3D PDF model of the buildingsBut I now want to convert this model into a CityGML LOD2 model. Is this possible?Since I have just started using FME and am not very familiar with the software, what should my next steps be? Could you provide some useful references? Thanks for your advice😊

661
AliAtSafe
Safer
5 months ago
nicol.ricci
Contributor
nicol.ricciContributor
asked in Architecture
Schedules more query to fme_node_health and fme_lock table

Hi allI have FME Flow installed in production environment with 2 nodes (Fault-Tolerant installation).I have now 4 workspaces that i have scheduled every 4 minutes.My DB Administrator see many query like this UPDATE fme_node_health SET modifieddate = :1 , expirydate = :2 , timeout = :3 , expiry = :4  WHERE process = :5  AND name = :6UPDATE fme_lock SET val = :1 , uuid = :2 , expiry = :3  WHERE lock_key = :4  AND (uuid = :5  OR expiry < :6 )They occours more time and and fill the disk space dedicated to Oracle logs.It's the first time it's happened to me and I don't understand if it depends on the scheduling or the Fault-Tolerant type installation.Can someone help me?Thanks a lot

605
nicol.ricci
Contributor
6 months ago
zaneta.mark
Contributor
zaneta.markContributor
asked in Architecture
FME Server/Flow job logs saved as .json

Hi,Is there a way to configure FME Server/Flow, so that logs are  automatically saved not only to standard .log file, but also to .json file (containing JSON formatted data)? It would be very helpful when it comes to further log information processing.

643
damiobasa
Safer
6 months ago
virtualcitymatt
Evangelist
virtualcitymattEvangelist
asked in Architecture
404 not found from jobsubmitterservice

I’m trying to debug an issue with the Job Submitter Service (I haven't actually tried any of the other services) .I have a process which runs fine from the FME Server UI (FME Server 2021). I can fill in the parameters (also upload an input file) etc. The jobs runs.If instead I try and run this using the jobsubmitter service via REST call - e.g., http://Host/fmejobsubmitter/Repository/workspace.fmw?parametersThe response is a 404. What is interesting to me is that I’m able to use the URL without the parameters and get back a proper response - that is for example: http://Host/fmejobsubmitter/Repository/workspace.fmw. It seeeeems like the issue is somehow related to the input file, however, in that case I would expect the job to fail rather than return a 404. so to me it seems like there is a problem actually submitting the jobI’ve checked permissions and the user definitely has access to the repository where the workspace is, and in my testing removing the permissions returns a 401 ERROR

502
virtualcitymatt
Evangelist
7 months ago
missp29
Contributor
missp29Contributor
asked in Architecture
Can I still run a workspace in command line on a separate distributed machine when the FME Flow Core server down?

Hi All,I am new to FME Flow. We are installing FME Flow 2023.1. We are setting up a two-tier distributed FME Flow environment with a machine which hosts FME Flow Core and Web server, and two separate distributed machines where the workspaces will be executed within the same network.  Let’s say I have an automated scheduled job which supposed to run at one of distributed machine at a certain time. For some reasons, the FME Flow Core machine is down at the time when the scheduled job supposed to run. When the FME Flow Core machine down, is the scheduled job still able to start to run at the scheduled time automatically? If not, am I able to start the job manually on the command line on the distributed machine without the FME Flow Core machine available?Your help is great appreciated. Thanks, -John

903
keziaatsafe
Safer
7 months ago

Badge winners

Show all badges
30,141
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.