A space to discuss FME Flow
Recently active
Hello community,I am currently facing problems uploading files to FME Flow. Previously I was handling this with a “FMEFlowResourceConnector”. One of our instances was now updated to version FME Flow 2024.2 (Build 24783 - win64).As the transformer “FMEFlowResourceConnector” was deprecated in FME 2024.1.0 (and it anyway refused to work with the transformer) I tried to go directly through the Flow REST API with a POST request. My request:/fmerest/v3/resources/connections/{connection}/filesys/{path}In my concrete example:/fmerest/v3/resources/connections/FME_SHAREDRESOURCE_DATA/filesys/Test I get this as a response:"message": "Error communicating with FME Flow host XXXXXX.\nContact your FME Flow administrator who can investigate the log files for further details.\nAlso see: http://fme.ly/e100007#error-communicating-with-fme-server-hostConnection refused: connect" However, when I try the same approach on my local installed Flow (same version), it works using this POST request. Does anyone h
Hi all,I removed/deleted several automations in FME Flow (Server), I stopped most of them, but probably not all. All these automations were monitoring the same folder, and for some reason they are still running and processing jobs.How can I completely delete them?I have already tried restarting FME services and restarting the server, but that didn't solve the issue.
Hello FME Community users, I am trying to upgrade FME FLow from 2024.0.3 to 2024.2.1. I looked into this article https://docs.safe.com/fme/html/FME-Flow/AdminGuide/Upgrade-in-Place-Same-Machine.htmJust wondering if there is a better compared to install/uninstall as mentioned above. Such as done on ESRI side.
I created an FME Flow cleanup task for a folder under Resources/Temp. However, cleanup isn’t happening on my test folder because FME Flow isn't resolving to the correct path for the FME_SHAREDRESOURCE_TEMP parameter. The path on the server is D:\ProgramData\Safe Software\FMEFlow\resources\temp\, which matches the path for the FME_SHAREDRESOURCE_TEMP parameter listed in the fmeServerConfig.txt file. The error in the system cleanup log states “Path not found for system cleanup:D:\ProgramData\Safe Software\FMEFlow\resources\system\temp\AA_Test.” - same but with “system” folder added in the path. Should I be using a different parameter? I'm unclear why the path for FME_SHAREDRESOURCE_TEMP is different in the system cleanup task from what is listed in fmeServerConfig.txt file.
We are trying to update our on-prem FLOW (from version 2023.2) and I have successfully created the backup but am unable to determine the location of where the file was saved to. The FLOW interface does not provide any clues as it does not indicate the target directoy (please see attached screen grab). And doing a seach on my C and D drives with keyword ‘.fsconfig’ yelds no results. Where does the backup file get saved to? Thanks!
An automation reads a message from a JMS queue and should trigger a workspace, the message content is passed as an automation parameter. This message is valid json, however we’ve had some cases where the message is something along the lines of{ "ID": "1234", "Notes": "Careless typing} includes a right hand curly brace"}This is valid json but the job fails with a status of FME_FAILURE and a statusMessage of "extra characters after close-brace". How should the message be passed to the workspace if json like the above example leads to failure to submit?
HelloWhat are the prerequisites to be able to run Automation on a FME Flow instance?When I try to build and test/run an automation I keep getting an error:Unable to assemble automation. There was an issue with component "Workspace". Subscriber configuration does not exist.It does not really matter what I add as action in the Automation. I keep getting this similar error.The FME Flow I am using is running in a Kubernetes environment on an Azure cloud with one Engine using version 2024.1.In the end my question is is it the set up that does not allow Automatons or is there possibly something missing in my installation? Or any other reason that I can not see? Unfortunately I was unable to find any thing in the documentation or any where that could explain this
This question came up at my office today. Can I have two FME Flow engines at different versions installed on the same Windows Server? I’m guessing that the answer is no but I wanted to get official verification on that.
Hei,on the webside about Troubleshooting SharePoint Web Connections and Services – FME Support CenterIt says “If the application is single tenant then you should have the directory (tenant) id in the URL instead.”Unfortunately, I can’t see where to find/change this URL. Where should I register the tenant ID?Can somebody point me in the right direction?Thank you.
Hello,I am working on converting point cloud data from the E57 format to the LAS format. However, I’ve encountered an issue with the intensity component.In the original E57 file, the intensity values range between 0 and 1. After the conversion, the intensity values in the LAS file become a constant integer with five digits.I would appreciate any guidance or suggestions on how to retain the original intensity format during the conversion process.
HTML Pages created with FME use an external stylesheet:<html> <head> <title>Report</title> <meta charset="UTF-8"> <link href="https://cdn.jsdelivr.net/npm/bootstrap@4.5.3/dist/css/bootstrap.min.css" rel="stylesheet"> </head> <body> ...... </body></html>This is somewhat of a problem when FME Flow has no access to this location, as HTML pages displayed from FME Flow Apps in that case will show without this stylesheet, thus maiming the layout.Are there alternatives for using this external stylesheet, like placing a copy of it somewhere on the FME Flow machine? Then the <head> of the HTML page could point to this local stylesheet.The stylesheet contains a lot of information, so adding the contents of the stylesheet to the header of the HTML file does not look like a viable option.
We have a server running many jobs and one of them normally runs successfully and a log can be reviewed but at other times the job fails and when i access it i get the message Error: The log file for job ID "######" does not exist.I’ve seen the post in FME Server 2019 Error: The log file for job ID "2613" does not exist and we have plenty of disk space, the job frequently works successfully, other jobs are still creating log files. I’ve checked all the suggestions in that post.The failed job is recorded as running for a couple of seconds but without the log I have no insight into why it is failing
The trigger is an incoming IMAP email with potentially more than one attachment. I wasn’t able to use the “Send Event As JSON” option because the email body is being delivered as HTML which fouls up the JSON parser in FME Flow. So I’m sending individual components of the email to a workbench+From:{email.from}+Subject:{email.subject}+Sent:{email.sent}+BodyType:{email.contentType}+Attachments:{email.attachments}+Body:{email.body} I’m splitting up the individual sections of the delivered data in the workbench using StringSearchers with Regex. I wind up with a string with the location that email attachments have been saved to in Flow, which is something like this:$(FME_SHAREDRESOURCE_TEMP)20250121124721-IMAP_Email_Testing-FW_Attachment_test-98e024d4-2316-4cd5-9905-1eb756d02a09I’ve been struggling with what to do with this string in order to access the attachments to save them somewhere on the network. The ultimate goal is to have the inbound email trigger a workbench that automatically cre
FME Flow 2024.1 Build 24612 - distributed setupI’m raising with Safe but if anyone has any bright ideas before Vancouver wakes up :-)Recently upgraded our pre-production environment to the above version. Noticed an issue however with some jobs getting stuck in a queued state and never moving on. The jobs are triggered by automation that runs every 10 minutes and assigns the jobs to a specific queue which in turn has two engines available. Sometimes the job gets submitted and runs successfully, sometimes the job gets put in a queue where it remains forever. e.g. the job triggered at 11:20 was processed successfully, the job triggered at 11:30 ended up in the queue, the job triggered at 11:40 was processed as expected The automation log (running in debug mode) doesn’t show any errors or warnings, the queued jobs show as submitted but with no other information Other perhaps relevant information, the jobs should also expire once in the queue beyond a certain length of time and that is not
We currently run all our FME jobs as an AD service account. Unless a workspace uses SQL Authentication for DB access, all DB access occurs as this service account. This has turned into a security concern and I’m sure others have dealt with this. Which of the following is the best solution or what have I missed?It sounds like the new FME licensing allows unlimited engines. Could we create a new engine for each workspace and run it as the service account with DB access, and access to network shares? Kindly point me to steps to do this.Group Managed Service Accounts - can a FME workspace run as a gMSA? Use SQL Authentication instead of Windows Authentication for DB access. I understand FME encrypts passwords but we’d still use the FME service account to access a ton of resources.How do others handle FME jobs and access to resources?
I have an workbench published in FME Flow which gathers parameters then passes them in an automation to workbenches which use them. I am using an Automations writer in it. When I try to run it in FLOW it gives the error:AUTOMATIONS writer: FME Flow error: `FME Flow error: `UNPROCESSABLE_REQUEST(Automations) Route "NewFeatureType" does not exist''I have never used this writer type before. Does it need to be registered on the server or something?
I’m using an IMAP email trigger for an automation where I’m using the content of the email in a workbench with the goal of delivering a JSON payload to Cityworks to automatically create a new Work Order.I’ve set up a User Parameter in the workbench to receive data from the the email. When I use the “Event as JSON” option for the parameter in FME Flow, the message body is being delivered to the workbench as HTML. This crashes the JSON being delivered. Everything up to the body is fine, but the message body doesn’t make it over, and everything that follows the body is also lost.I’ve been able to get the message content into a workbench by using the individual headings such as “Email Body”, “Email Subject”, “Sent from Address” headings in Flow as the parameters to pass, but doing it this way does not allow you to use the JSON transformers in the workbench.Essentially what I am needing to do is receive JSON formatted data in a workbench from the IMAP email trigger, create attributes from
Hi, is it possible to upload a file to the FME Flow shared resource folder through the Flow REST API? I tried to setup a POST request for fmerest/v3/resources/connections/<resource>/filesys/<path> but get a 415 Unsupported Media Type Response. I used the following parameters in Postman:In this example I want to upload the text file “test.txt” to the shared resource folder “Test”. Is there a problem with the request, or is this the wrong approach for uploading a file via the REST API? The goal would be to provide a means for external applications to upload files that are then processed by FME Flow. Thank you for your help!
We have enabled Version Control to an external repository on FME Flow. Are there any best practices for managing Workbenches in development in FME Form? My current thought, which I haven't spent much time developing, is to recommend that once a Workbench is uploaded to Flow, the desktop version is archived and any future work on the Workbench must be done by Downloading from Flow and Republishing. Basically, to insist that all work must be done from Workbenches from Flow. The downside I can see from this is that there is no way to force developers to follow that. Any suggestions?
In order to pull data from one of our clients’ data repositories, we are using a custom Python SDK that they have provided. Installation and testing went smoothly for use with FME Form, but no so well with FME Flow. For FME Form, I used fme.exe python -m pip install. For FME Flow, I’ve tried navigating to Resouces>Engine>Plugins>Python>python311 and uploading the directories there, I’ve tried running fme.exe python -m pip install with the target directory set the FME Flow Resouces\Engine\Plugins\Python\python311. No matter what I do, my transformer fails with the following errors:Python Exception <ModuleNotFoundError>: No module named xxxx Any suggestions?
Hello, I am new to administering FLOW. We actually have just purchased the product and are in the process of setting everything up, and learning.I would like to integrate SAML with FLOW. It is straightforward enough with the ability to use the metadata URL or import from a xml file. All of that and actually enabling SAML under User Management was quite straightforward. We are a huge IT shop and I have to submit tickets to another department to have the applications integrated with ADFS.The software was installed as port 8080, and is accessed through an F5 (load balancer). After install, I had the F5 team set up listening on port 8080 and the software is accessible via the F5 VIP and internally. All that said, there have been a few issues. Initially the software was passing communication for ADFS over http, because that is how it was setup. So this was expected. The problem there, is the ADFS console would not allow http to be used, it only allows https. I have since used a FME article
Hello Forum,I am currently working on a task that involves copying files from a source server (Server 1) to a destination server (Server 2). I am new to FME and am unsure how to approach this.Could this process be achieved using an FME transformer, or would it require writing a Python script? I would greatly appreciate any guidance or suggestions on where to begin.Thank you in advance for your support!
Where can one find the system cleanup log files on FME Flow (2023.2; build 23764)? I’m testing cleaning up a folder under Resources/Temp. I don't see any corresponding logs under Jobs or System Configuration → System Cleanup. Or, is it possible to test a specific cleanup task on FME Flow? I’m currently at the mercy of whenever system cleanup runs, which is vaguely set to once a day at no set time so not ideal for testing.
hello all, I have 2 sets of data with no fields which I can join on (for Feature Merger transformer)I would like to keep the 1 set of data (ieqm2023) with its geometry and attributes and add to it the attributes ONLY from the 2nd dataset (ieqm2025) where geometry overlaps with the (ieqm2023) geometry. so for instance I want the same numbers of records (ieqm2023 - 1,880,638 ) afterwards only with more fields (from 2nd dataset) (see attached) I was thinking an Aggregator or an area on areaOverlayer transformer might work? but I have had no luck getting the correct result so far. thanks and much appreciated for any help!!
Hello and happy 2025!Was speculating on feature types selection possibilities when reading as a single merged feature type with a wildcard on flow.My scenario being that a user will drag and drop a DWG to a Flow tool and then that said tool would read it in and then display all the feature types (layers) that said DWG consists of in a list. Where the user could then check a box in front of each and every layer they need and afterwards select “Run” to start the main tool (which is a conversion into another file format).Thus the tool not converting all features/layers within a file but only a selected few which are selected like one does for example with the “Feature types to read” option in the FeatureReader.Anyone here done this before that wishes to share?