Skip to main content
  • EN

FME Flow

A space to discuss FME Flow

2364 Posts
matthewb
Contributor
matthewbContributor
asked in Architecture
Installing Custom Python SDK to FME Flow.

In order to pull data from one of our clients’ data repositories, we are using a custom Python SDK that they have provided.  Installation and testing went smoothly for use with FME Form, but no so well with FME Flow.   For FME Form, I used fme.exe python -m pip install.  For FME Flow, I’ve tried navigating to Resouces>Engine>Plugins>Python>python311 and uploading the directories there, I’ve tried running fme.exe python -m pip install with the target directory set the FME Flow Resouces\Engine\Plugins\Python\python311.   No matter what I do, my transformer fails with the following errors:Python Exception <ModuleNotFoundError>: No module named xxxx Any suggestions?

40
matthewb
Contributor
15 hours ago
koen
Contributor
koenContributor
asked in Deployment
Module 'realdwg/REALDWG' is unavailable for use with this FME edition (FME Flow 2024.2)

After upgrading FME Flow to 2024.2 some of our workspaces fail with the following error:WARN  |Library 'F:\FMEFlow\Server\fme\plugins/realdwg/REALDWG.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this library WARN  |Could not load module 'F:\FMEFlow\Server\fme\plugins/realdwg/REALDWG.dll' : 'The specified module could not be found' WARN  |Could not load module 'F:\FMEFlow\Server\fme\realdwg/REALDWG.dll' : 'The specified module could not be found' ERROR |Module 'realdwg/REALDWG' is unavailable for use with this FME editionSeems like RealDWG and AUTOCAD_OD readers/writers do not work anymore. -Is this a known issue/bug?-Is RealDwg not supported anymore? It does work in FME Form 2024.2

2057
tjc_cows
Contributor
19 hours ago
sneha
Contributor
snehaContributor
asked in Automation
I am trying to do a pg_dump using command line in the system caller. It is failing, when i implemented the same command in the linux terminal, it is prompting for the password. I tried all the ways to pass the password value, nothing has worked out.

I tried to find an alternative transformer for the system caller to do the pg_dump, but even that did not work out.

7298
giosp
Contributor
20 hours ago
felipeverdu
Enthusiast
felipeverduEnthusiast
asked in Security
Security update affecting FME Flow 2023.2.2

HiI am the admin in my organisation for FME Flow and I woke this mornig with this messagehttps://support.safe.com/hc/en-us/articles/31265482270349-Security-Update-FME-Flow-Privilege-Escalation-VulnerabilityThe problem is that I can’t access it even after it asked me to log in.​@safe can you point me out to the right issue so I can understand the vulnerability that it might implicate in out environment?Best regards,Felipe Verdú

2275
luke.hicks
Safer
21 hours ago
francis
Contributor
francisContributor
asked in Security
Broadcast message from Safe Software on FME Flow

Today we saw this broadcast message from Safe Software on our FME Flow servers (2023.2.2):The link in the message is not working and I do not see any recent security issues. We have only external ports configured for dynamic engines and licenses. The FME Flow instance is not accesible from outside out network.I find a strange that they can create broadcast messages on our servers.That is all a bit suspicious, is anyone else experiencing the same? 

2298
francis
Contributor
21 hours ago
sunnywaygis
Participant
sunnywaygisParticipant
asked in Automation
Extract Detailed Job messages from FME Flow Successful/Failed Jobs

Hi All, I want to extract detailed log messages from FME job running on FME Flow (Ver 2021.2.3). What options are available to extract this information along with basic job information like Workspace, Repository, user, source, start and end time. etc. Appreciate any feedback. Jay    

81
hkingsbury
Celebrity
1 day ago
sam_appleton
Contributor
sam_appletonContributor
asked in Automation
Workbench fails when run from Flow Apps - Runs fine with "Run Workspace"

Hi,When I run a workspace via an App I get the following error:Microsoft Azure SQL Database Non-Spatial Writer: A suitable Microsoft SQL Server OLE Driver is not found. Install Microsoft OLE DB Driver for SQL Server from http://www.microsoft.com/en-ca/download/details.aspx?id=56730 I can see from earlier on in the logs that it failed to connect :Microsoft Azure SQL Database Non-Spatial Writer: Failed to connect using Microsoft OLE DB Driver 19 for SQL Server. Provider error ''. When I run the same workspace from “Run workspace” it connects and runs fine:Microsoft Azure SQL Database Non-Spatial Writer: Trying to connect using Microsoft OLE DB Driver 19 for SQL Server…Microsoft Azure SQL Database Non-Spatial Writer: Starting execution of BEGIN_SQL commands I tried deleting the app and creating it again but that didn’t seem to work. TIA

323
sam_appleton
Contributor
1 day ago
lifalin2016
Contributor
lifalin2016Contributor
asked in Architecture
FME Flow 2024 gets versioning wrong

Hi.I just did an engine upgrade of my 2024.0.1 Flow instance to the very latest version 2024.2.1I then created a workspace in Form version 2024.2.0, and tried to upload it to Flow to test deployment parameters.But I get a warning stating, that Flow is older than Form, and the workspace is unrunnable on Flow.This is not good, as an engine upgrade is a nice way to keep Flow running with the latest version without the hazzle of major downtime and reinstallation.Why can’t the Flow 2024 UI handle engine upgrades, and why is my workspace blocked on Flow ? 

294
lifalin2016
Contributor
2 days ago
bdotfdotfme
Contributor
bdotfdotfmeContributor
asked in Automation
fme flow automation: how to run a workspace (name decided at runtime) if it exists?

I am sure that there is a solution within fme flow automation, but meanwhile I am pulling my hair for not finding it…The scenario:Through a directory watcher triggered automation, I import the content of a variety of geopackage files into postgis tables with corresponding names. This part runs well.For some of these tables, I have ElasticSearch indices, which have to be rebuilt after table import. For the indexing, I have a repo on the flow server named Elastic-Indexer, and therein are workspaces with names corresponding to some of the tables. (n.b. not all tables have corresponding indexer workspaces)Now I try to build up a dynamic system that gets notified with the schema.tablename after import and runs - if it exists - a workspace with a matching name from the Elastic-Indexer repository. My first idea was to read the workspace names from that repository and call the workspace if the name matches, but a) I was not able to read the workspace names and b) this solution looks clunky whe

324
bdotfdotfme
Contributor
2 days ago
mbaumgartner
Participant
mbaumgartnerParticipant
asked in Automation
issue with component "Trigger". Publisher dirwatch does not exist

I am trying to create an automation using a trigger that watches a directory. If a file in the directory is added/created it launches an FME Workspace. However I keep getting the following error:2024-12-14T20:10:08Z | 410109 : (Automations) Creating link from trigger...3 2024-12-14T20:10:08Z | 410108 : (Automations) Creating dirwatch trigger...4 2024-12-14T20:10:08Z | 410112 : (Automations) Unable to assemble automation. There was an issue with component "Trigger". Publisher dirwatch does not exist.The same thing happens when I try add a trigger that watches an FTP? and I get the same error when trying to add a Publication under the Notification.What am I missing? Do I need to add something special for a trigger to work? is it possible that I am missing some part of FME?I am working with a FME FLOW 2024.1that is in a Azure Kubernetes cluster.Any help or hint that could explain the error is highly appreciated.

262
evoteck
Supporter
2 days ago
swach
Contributor
swachContributor
asked in General
Error retrieving Job History

My FME Server dashboards are not working. When I try to run JobHistoryStatisticsGathering.fmw, it fails with:Terminator (TestFactory): Terminator: Termination Message: 'Translation Terminated: There was an error getting job history.Error Message: HTTP/1.1 404 - http://v01w-app-p0427/fmeserver/fmerest/v3/transformations/jobs/completed?limit=1000&offset=0'What file is it looking for? 

1435
gistech_
Contributor
3 days ago
nedwaterman
Contributor
nedwatermanContributor
asked in Deployment
Set FilePath for FME_SHAREDRESOURCES_TEMP

Morning all,I’m trying to create a workspace that works both on FME Flow & Form. I’m using the FME_JOB_ID to determine what the workflow is running on.If its FME Form I’m setting the filepath to a shared drive. For Flow I’m trying to set it to the FME_SHAREDRESOURCE_TEMP folder to produce a data download.If I hard code the parameter in the writer to $(FME_SHAREDRESOURCE_TEMP)@Value(_FILEPATH) its fine, but I can’t do this as the file will not then post to a shared drive.If I try and set the FME_SHAREDRESOURCE_TEMP in the workspace to push that to my parameter and add it to the created filepath FME no longer produces the downloaded zip file.I’m setting the FME_SHAREDRESOURCE_TEMP to the url defined on Flow - which in this case is something likehttps://-myserverlocation-/fmeserver/resources/browse?path=FME_SHAREDRESOURCE_TEMP&name=TempIs this correct, or should I be using a shorter, relative path? EDIT: Sorry just figured out I don’t need to set this at all! FME Flow just does it

221
hkingsbury
Celebrity
3 days ago
ebygomm
Supporter
ebygommSupporter
asked in Deployment
FME Flow - User Interface Performance

Has anyone come up with any easily quantifiable methods of testing the performance of the FME Flow user interface?I’ve sat with a stopwatch in the past but it’s a bit of a laborious process. 

325
virtualcitymatt
Celebrity
3 days ago
mestarijaakko
Participant
mestarijaakkoParticipant
asked in Deployment
Arcis Online Connection

Hi,We updated our FME Flow from 2023 to 2024.2.1 yesterday. After that workspaces that have connection to Arcis Online not inside our network are not working. Those that are in our internal network still work.Error message that we have is the same in all workspaces, we tried this also with a workspace that has only a reader and got the same issue. 53 2024-12-17 08:20:02 | Message Type: fme::internal::_v0::py::Exception 54 2024-12-17 08:20:02 | Python Exception <AttributeError>: 'NoneType' object has no attribute 'supportQueryStringAuthorization'

201
mestarijaakko
Participant
4 days ago
lifalin2016
Contributor
lifalin2016Contributor
asked in Deployment
Upgrading FME Flow 2024 version looses engine ?

Hi.I’ve just upgraded my local FME Flow from 2024.0.1 to 2024.2.1 using an engine only upgrade.I.e. install FME parallel to the previous engine, and change the configured template path.The interface is thus still 2024.0.1.The FME Flow interface starts, but the engine never shows up in its list.I’ve tried to run the new fme.exe directly, and it seems to be running.What unforeseen pitfall have I stumbled into ?Cheers.

171
lifalin2016
Contributor
4 days ago
vxn43
Supporter
vxn43Supporter
asked in Deployment
FME Flow Engine Restart - how often and when?

Hello,  I am using a no-fault FME Flow architecture: 2 engines. Should the engines be restarted regularly, for example, each month? What does Safe Software recommend?How often do you restart the engines? When do you restart the engines?

211
david_r
Evangelist
4 days ago
vanessarapior
Contributor
vanessarapiorContributor
asked in Automation
Error on FME Server 2022

Hello :) I have some workbenches on the FME Server 2022 and I get for all of them the error:2024-12-11 13:37:46 | java.sql.SQLException: Query failed (#20241211_123746_28965_mxxee): Unknown transaction ID: f6d2afb3-c2fa-4417-970c-375bf47d1c9f. Possibly expired? Commands ignored until end of transaction blockIs that something I can fix or is it a Server error that only admins can fix? It is some time ago I was running the workbench. I tested one on my Laptop for a small country and it went good. all other countries are too big that is why I choose the FME Server. Any suggestions of what I can do?Vanessa

232
vanessarapior
Contributor
9 days ago
sc1
Contributor
sc1Contributor
asked in Flow Hosted
Esri ArcGIS Feature Portal Service writer results in errors, while running to a local .gdb the script runs fine

Hello, we noticed that with multiple scripts that have the feature portal service writer problems occurred:  This is part of the log file when trying to run the workbench script:Loaded Python module `arcgisonlinefeatures' from file `C:\Program Files\ArcGIS\Data Interoperability for ArcGIS Pro\python\fme-plugins-py311.zip\arcgisonlinefeatures\__init__.pyc' Writer `ARCGISPORTALFEATURES_2' of type `ARCGISPORTALFEATURES' using group definition keyword `ARCGISPORTALFEATURES_2_DEF' Loaded Python module `arcgisonlinefeatures' from file `C:\Program Files\ArcGIS\Data Interoperability for ArcGIS Pro\python\fme-plugins-py311.zip\arcgisonlinefeatures\__init__.pyc' Message Type: fme::internal::_v0::py::Exception Python Exception <ValueError>: invalid literal for int() with base 10: '<Unused>' ARCGISPORTALFEATURES writer: An error has occurred. Check the logfile above for details When running the script using a local .gdb as a writer there are no problems and the script runs fine. What c

202
sc1
Contributor
9 days ago
kyle_fiacco
Observer
kyle_fiaccoObserver
asked in Automation
Automation vs Workspace App User Parameter Upload File

We are running into issues with the user parameter file inputs for Automation Apps.  In this case our end user wants to upload a new csv file every time they run the automation app, and they want to upload it from their local computer/machine.  Right now the only way to accept this user input is to have the csv file uploaded to a data store in FME Server, prior to selecting it as a user parameter, and then running the automation app.  We noticed that this problem doesn't happen for workspace applications and they can upload local files directly as the end user, with no need to upload it to the data store in fme server prior.  Is it possible to have our end user run an automation app and upload the user parameter directly from their local machine?

221
nia.colebrooke
Safer
9 days ago
chelseawu
Contributor
chelseawuContributor
asked in Automation
How to stop automation to send out error emails after it exceed a certain number?

I have a flow automation runs every 5 minutes, and will send out a notification email if a job failed. That becomes an issue if a problem that caused the job to fail hasn’t been resolved soon since the automation will continue to send out error email every 5 minutes.Is there any way to stop sending email after e.g. 10 emails or to reduce the frequency for sending error emails? I still want the automation to run every 5 minutes, even some job failed, but want to get just reasonable amount of error emails. 

243
chelseawu
Contributor
10 days ago
mpittinger
Contributor
mpittingerContributor
asked in Automation
Provide specific response body to Webhook POST from 3rd party app

Hello everyone-Hoping that someone may be able to help with this question!Is there a way to provide a specific required JSON Response body (for example:  {“status”:”OPERATION_OK}  ) to a 3rd party application in response to a successful post to an FME Flow Automation with a Webhook trigger? I feel like I’m missing something obvious here….Any help would be greatly appreciated!Mike

774
mpittinger
Contributor
10 days ago
M
mconway
asked in Architecture
Unable to get local timestamps in a worksapce on FME Server (Docker)

I'm running FME Server 2019.2 in Docker Swarm using a fairly standard compose file. In the past, we have had some minor issues with time synching, and the containers believing they were in UTC. Most of that has been resolved, however, we noticed today that we are unable to get a local timestamp generated from within a workspace, even though FME server logs in local time, and all of the containers are pulling time from their host.Using date, echo /etc/timezone or $TZ all return PST, however the workspace always returns UTC. I've got a volume on all our containers to use local host's timezone (/etc/localtime:/etclocaltime:ro) with no effect. Does anyone know what else I can look at to fix this? To be clear - all of our job schedules run localtime, but when trying to use date/time functions inside a workspace, UTC and localtime are the same according to FME. 

272
kieran.odonnell
Participant
10 days ago
ebygomm
Supporter
ebygommSupporter
asked in Deployment
JMS Connection to WebMethods using Software AG (Nirvana) - FMEFlow2024.1

Recently upgraded our Dev environment to FME Flow 2024.1 (in situ)Previously we were connecting to WebMethods using Software AG(Nirvana)After installation, relevant .jar files have been added to the jms directory on the serverHowever, there is no connectivity.The error received isOM.safe.fmeserver.plugin.jms.JMSClientException: javax.naming.CommunicationException: JNDI setup failed on RNAME=nsps:REDACTED [Root exception is com.pcbsys.nirvana.client.nRealmUnreachableException: Realm is currently not reachable:Realm was still unreachable after max retry count - 0]This doesn’t appear to be hugely helpful as you get the exact same error if you use an incorrect provider URL. I can’t see anything in the logs that provides any additional informationAll evidence points to the location being reachable (testnet connection in powershell from the server) @steveatsafe - any ideas?

652
ebygomm
Supporter
11 days ago
sigtill
Contributor
sigtillContributor
asked in Automation
Datadownload - change filename on ZIP

I have looked at this: https://knowledge.safe.com/articles/678/create-a-custom-download-link-for-results-from-dat.htmlI want to be able to set the exact-filename of the zip-file within FME Workbench for the download service. Si instead of the URL like this: http://fmeserver/fmedatadownload/FME_2D764B0C_1515155526785_73956.zipI want to be able to define a parameter in a workspace called:ZIPFILENAME = myfilename.zipSo the Datadownloadservice serves the file:http://fmeserver/fmedatadownload/myfilename.zipIn other workspaces I will have completely different zip-filenames.Any way to do this? I manage to create all the data within the correct file and use the filecopy to copy the file to the correct place (within fmedatadownload/) but I can not persuade the fME Datadownloadservice to use that zipfile and not create a random-zipfile.

1436
miquelrs
Contributor
11 days ago
jaygrg111_
Contributor
jaygrg111_Contributor
asked in Architecture
How to fix when BackupConfiguration.fmw fails to retrieve the Backup?

Hi everybody, Our BackupConfiguration.fmw has been failing lately. Based on the following post, I created new schedule on Flow but still having issues.  With the new schedule, I am having the attached error. However, gisadmin does have a fmesuperuser role. Any insights is highly appreciated.  Thanks in advance!

264
jaygrg111_
Contributor
11 days ago

Badge winners

Show all badges
30,351
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.