FME Flow

I am trying to create an automation using a trigger that watches a directory. If a file in the directory is added/created it launches an FME Workspace. However I keep getting the following error:2024-12-14T20:10:08Z | 410109 : (Automations) Creating link from trigger...3 2024-12-14T20:10:08Z | 410108 : (Automations) Creating dirwatch trigger...4 2024-12-14T20:10:08Z | 410112 : (Automations) Unable to assemble automation. There was an issue with component "Trigger". Publisher dirwatch does not exist.The same thing happens when I try add a trigger that watches an FTP? and I get the same error when trying to add a Publication under the Notification.What am I missing? Do I need to add something special for a trigger to work? is it possible that I am missing some part of FME?I am working with a FME FLOW 2024.1that is in a Azure Kubernetes cluster.Any help or hint that could explain the error is highly appreciated.

FME shows the following warning during the translation:2023-09-06 10:24:29|5015.8|  0.3|WARN  |Failed to free sufficient memory to reach the process usage limit. To improve stability and performance please increase the memory available to FME. Available memory can be increased by adding physical RAM, increasing swap space, or closing other applicationsI'm using FME(R) 2022.2.1.0 (20221202 - Build 22776 - WIN64) on Windows 10 22H2 Build 19045.2006. I have 64 GB of memory. FME uses about 10 GB during that translation and 50% of RAM are free. Why does FME show this warning when there should be enough free space? FME says it's trying to free memory because it doesn't have enough memory, right? Why does FME fail to free memory? How can FME achieve that goal? What does it do to free memory? And what is the process usage limit? Also I get these log messages and I feel like optimizing memory usage takes up very much time. Does the "Optimizing Memory Usage" message have to do with the warning a

Hi everyone,I’ve created a python script that has the docx library and arcpy library imported in it that takes field values from a GIS feature class and writes it to a docx document successfully. I would like to trigger the python script to run every time that feature class in an enterprise geodatabase is updated.I am working in the 11.3 Enterprise Environment and have come across this support page regarding implementing webhooks and FMEhttps://support.safe.com/hc/en-us/articles/25407414850061-Integrating-ArcGIS-Enterprise-Feature-Service-Webhooks-With-FMEI will attempt to do the above, but I have a simple question regarding the FME workspace itself.I have read up on the PythonCreator and PythonCaller transformers, with the PythonCreator not requiring an inpput. If all I want is an update to the GIS feature class to trigger the python script to run, would the FME workspace just have a PythonCreator with the python script in it and a logger? Or would it be more beneficial to have a Crea

We got this message: On December 17, 2024, we will release the following updates which will include the fix:• New release builds of 2023.2, 2024.0, 2024.1, 2024.2 and newer• Manual patches for versions 2021.1 through 2024.1.2.1 So I want to install the patch for our 2023.1.2 (build 23641)But where can I download the manual patch for this release?

Hello,  I am using the 2024 versions of FME (Form & Flow).  I would like to create an FME Form workspace that will be deployed on FME Flow and later called via the FME REST API.  In this API call (POST), I would like to include structured information in the request body that the FME Workbench can process.  For example, the request body could look like this:  ```json{    "entities": [        {            "schemaName": "xxxxx",            "entityName": "xxxx",            "fieldNames": [                 "ID",                "NR_ATT"            ]        }    ],    "whereClause": "ID = 'xxxxx'",        "constraint": "FIRST"}```  I would also like the response of the execution to contain structured information, which could include standard execution feedback along with additional custom data.  For example, the response could look like this:  ```json{    "rows": [        {            "fields": [                {"schemaName": "xxxx", "entityName": "yyyy", "fieldName": "zzzz", "fieldValue":

Hi everyone,after opdating FME Flow from 2024.0.3 to 2024.2.1 I’ve noticed that there is a (new?) “Data collection” optione within the Security Options. We are using FME Flow via docker compose. Is it possible to disable the “Data collection” via a (Docker) environment variable so I don’t have to disable it manually after every update?GreetingsPeter

I have a process that writes a number of graphs to a folder on the network.  It works great in FME Form.  If I attempt to publish this workspace to FME Flow as a Job Submitter it doesn’t write the files to the folder at all like the same file does at the desktop level.  The output path is set up in an RCaller so there isn’t a Writer in the .fmw script like normal.  There are zero errors on the desktop side, and I have made sure the FME Flow portion no R packages are causing errors.  When I run this process, I receive zero errors in Flow, but none of the files write to the directory.  The end process would be that a person could upload a number of spreadsheets run this process from a webpage (Flow) and the output would show up in their department’s folder.  I read in the community about it possibly writing to another directory and I attempted to check that out without success.  Any help or guidance would be appreciated.  

I tried to find an alternative transformer for the system caller to do the pg_dump, but even that did not work out.

HiI am the admin in my organisation for FME Flow and I woke this mornig with this messagehttps://support.safe.com/hc/en-us/articles/31265482270349-Security-Update-FME-Flow-Privilege-Escalation-VulnerabilityThe problem is that I can’t access it even after it asked me to log in.​@safe can you point me out to the right issue so I can understand the vulnerability that it might implicate in out environment?Best regards,Felipe Verdú

Today we saw this broadcast message from Safe Software on our FME Flow servers (2023.2.2):The link in the message is not working and I do not see any recent security issues. We have only external ports configured for dynamic engines and licenses. The FME Flow instance is not accesible from outside out network.I find a strange that they can create broadcast messages on our servers.That is all a bit suspicious, is anyone else experiencing the same? 

Hi,When I run a workspace via an App I get the following error:Microsoft Azure SQL Database Non-Spatial Writer: A suitable Microsoft SQL Server OLE Driver is not found. Install Microsoft OLE DB Driver for SQL Server from http://www.microsoft.com/en-ca/download/details.aspx?id=56730 I can see from earlier on in the logs that it failed to connect :Microsoft Azure SQL Database Non-Spatial Writer: Failed to connect using Microsoft OLE DB Driver 19 for SQL Server. Provider error ''. When I run the same workspace from “Run workspace” it connects and runs fine:Microsoft Azure SQL Database Non-Spatial Writer: Trying to connect using Microsoft OLE DB Driver 19 for SQL Server…Microsoft Azure SQL Database Non-Spatial Writer: Starting execution of BEGIN_SQL commands I tried deleting the app and creating it again but that didn’t seem to work. TIA

I am sure that there is a solution within fme flow automation, but meanwhile I am pulling my hair for not finding it…The scenario:Through a directory watcher triggered automation, I import the content of a variety of geopackage files into postgis tables with corresponding names. This part runs well.For some of these tables, I have ElasticSearch indices, which have to be rebuilt after table import. For the indexing, I have a repo on the flow server named Elastic-Indexer, and therein are workspaces with names corresponding to some of the tables. (n.b. not all tables have corresponding indexer workspaces)Now I try to build up a dynamic system that gets notified with the schema.tablename after import and runs - if it exists - a workspace with a matching name from the Elastic-Indexer repository. My first idea was to read the workspace names from that repository and call the workspace if the name matches, but a) I was not able to read the workspace names and b) this solution looks clunky whe

My FME Server dashboards are not working. When I try to run JobHistoryStatisticsGathering.fmw, it fails with:Terminator (TestFactory): Terminator: Termination Message: 'Translation Terminated: There was an error getting job history.Error Message: HTTP/1.1 404 - http://v01w-app-p0427/fmeserver/fmerest/v3/transformations/jobs/completed?limit=1000&offset=0'What file is it looking for? 

Has anyone come up with any easily quantifiable methods of testing the performance of the FME Flow user interface?I’ve sat with a stopwatch in the past but it’s a bit of a laborious process. 

Hi,We updated our FME Flow from 2023 to 2024.2.1 yesterday. After that workspaces that have connection to Arcis Online not inside our network are not working. Those that are in our internal network still work.Error message that we have is the same in all workspaces, we tried this also with a workspace that has only a reader and got the same issue. 53 2024-12-17 08:20:02 | Message Type: fme::internal::_v0::py::Exception 54 2024-12-17 08:20:02 | Python Exception <AttributeError>: 'NoneType' object has no attribute 'supportQueryStringAuthorization'

Hi.I’ve just upgraded my local FME Flow from 2024.0.1 to 2024.2.1 using an engine only upgrade.I.e. install FME parallel to the previous engine, and change the configured template path.The interface is thus still 2024.0.1.The FME Flow interface starts, but the engine never shows up in its list.I’ve tried to run the new fme.exe directly, and it seems to be running.What unforeseen pitfall have I stumbled into ?Cheers.

Hello,  I am using a no-fault FME Flow architecture: 2 engines. Should the engines be restarted regularly, for example, each month? What does Safe Software recommend?How often do you restart the engines? When do you restart the engines?

Hi Folks,I have previously installed and worked on FME Server, with my last usage being approximately 2–3 months ago.However, I am currently unable to log in, and the system displays the following error message:Could someone please assist in identifying the cause of this issue and guide me on resolving it?Thank you in advance for your support.

Hello :) I have some workbenches on the FME Server 2022 and I get for all of them the error:2024-12-11 13:37:46 | java.sql.SQLException: Query failed (#20241211_123746_28965_mxxee): Unknown transaction ID: f6d2afb3-c2fa-4417-970c-375bf47d1c9f. Possibly expired? Commands ignored until end of transaction blockIs that something I can fix or is it a Server error that only admins can fix? It is some time ago I was running the workbench. I tested one on my Laptop for a small country and it went good. all other countries are too big that is why I choose the FME Server. Any suggestions of what I can do?Vanessa

Hello, we noticed that with multiple scripts that have the feature portal service writer problems occurred:  This is part of the log file when trying to run the workbench script:Loaded Python module `arcgisonlinefeatures' from file `C:\Program Files\ArcGIS\Data Interoperability for ArcGIS Pro\python\fme-plugins-py311.zip\arcgisonlinefeatures\__init__.pyc' Writer `ARCGISPORTALFEATURES_2' of type `ARCGISPORTALFEATURES' using group definition keyword `ARCGISPORTALFEATURES_2_DEF' Loaded Python module `arcgisonlinefeatures' from file `C:\Program Files\ArcGIS\Data Interoperability for ArcGIS Pro\python\fme-plugins-py311.zip\arcgisonlinefeatures\__init__.pyc' Message Type: fme::internal::_v0::py::Exception Python Exception <ValueError>: invalid literal for int() with base 10: '<Unused>' ARCGISPORTALFEATURES writer: An error has occurred. Check the logfile above for details When running the script using a local .gdb as a writer there are no problems and the script runs fine. What c

We are running into issues with the user parameter file inputs for Automation Apps.  In this case our end user wants to upload a new csv file every time they run the automation app, and they want to upload it from their local computer/machine.  Right now the only way to accept this user input is to have the csv file uploaded to a data store in FME Server, prior to selecting it as a user parameter, and then running the automation app.  We noticed that this problem doesn't happen for workspace applications and they can upload local files directly as the end user, with no need to upload it to the data store in fme server prior.  Is it possible to have our end user run an automation app and upload the user parameter directly from their local machine?

I have a flow automation runs every 5 minutes, and will send out a notification email if a job failed. That becomes an issue if a problem that caused the job to fail hasn’t been resolved soon since the automation will continue to send out error email every 5 minutes.Is there any way to stop sending email after e.g. 10 emails or to reduce the frequency for sending error emails? I still want the automation to run every 5 minutes, even some job failed, but want to get just reasonable amount of error emails. 

Hello everyone-Hoping that someone may be able to help with this question!Is there a way to provide a specific required JSON Response body (for example:  {“status”:”OPERATION_OK}  ) to a 3rd party application in response to a successful post to an FME Flow Automation with a Webhook trigger? I feel like I’m missing something obvious here….Any help would be greatly appreciated!Mike

Upgrading from FME Server 2022 to Flow 2024.2, Very frustrating to see no Schedule Categories in FME Flow 2024.2! WHY ? Instead of finally making the tabular Schedules page sortable (how old is that idea?) or adding some useful filtering, it’s now time for tagging? Man!All my workspaces are organized by repository. Have been for years. My Schedules were organized by Categories, which matched Repository names. What was wrong with that? Go ahead and add tagging but why remove the categories? If I’m missing something, please let me know and I will gladly stand corrected. My real concern here is not with having to invent tags and changing my ways. Rather it’s the fear that Safe is becoming more like ESRI where changes seem to get rolled out not in an effort to improve the product but to make it look like the dev teams are constantly working. Please don’t follow their lead. FME has been my haven of sanity and productivity over the years when ESRI bugs shut me down. I can ignore the silly re

I'm running FME Server 2019.2 in Docker Swarm using a fairly standard compose file. In the past, we have had some minor issues with time synching, and the containers believing they were in UTC. Most of that has been resolved, however, we noticed today that we are unable to get a local timestamp generated from within a workspace, even though FME server logs in local time, and all of the containers are pulling time from their host.Using date, echo /etc/timezone or $TZ all return PST, however the workspace always returns UTC. I've got a volume on all our containers to use local host's timezone (/etc/localtime:/etclocaltime:ro) with no effect. Does anyone know what else I can look at to fix this? To be clear - all of our job schedules run localtime, but when trying to use date/time functions inside a workspace, UTC and localtime are the same according to FME.