A space to discuss FME Flow
Recently active
I am on FME Server 2022.2.8, and I have a quite big automation where the workspaces communicate through json messages. Now I have been able to replicate a crash in too machines, but I haven’t been able to isolate the exact problems. I think it might be related to https://support.safe.com/hc/en-us/articles/25407442818189-Known-Issue-FME-Server-Core-java-lang-OutOfMemoryError-Java-heap-spaceIf I start processing that involves some 100 workspaces queued and running with quite long json messages the rest api stops responding eventually (about 30 minutes in, returning 500 errors). Processing seems to continue and automation is running fine, the Server ui seems ok (I think it is relying on REST API v4).Restarting the FME (or the server) does not help the problem, but cleaning up rows in the fme_job_history table seems to help.I have worked around the problem by re-architecting the Automation to make the messages smaller, so we are in the clear now.Just if anyone else have similar problems!
I am trying to convert an old script that loads 100+ tables in Postgres to a FME Server automation. One of the things I am doing is a INSERT INTO schema1.table SELECT * FROM schema2.table with a SQLExecutor where schema2 is a Oracle foreign table. This works fine for some smaller tables, but for a large table around 33gb I eventually receive a 'could not receive data from server: Connection timed out' error whether I run it on desktop or server. This worked fine when run from the script. I'm at a loss here, what could be causing the problem?
Hello,I just performed an upgrade from FME FLOW 2023.1 to version 2024.2 and now I have a big problem because I can’t restore the backup I made before upgrading.The restore process fails with The system restore failed for the following reason:The export location provided is invalid.The error message in the History list saysCOM.safe.fmeserver.configuration.migration.FMEConfigurationException: java.lang.NullPointerException: inputStreamin a red box just above the heading “Failure”.The log just states Unable to extract import package. The backup.fsconfig is a quite large file (15 GB) because I forgot to remove some raster files from the resources before creating the backup. I copied it manually to the resources/Backup folder so I can select it from there for restoring instead of uploading. Nonetheless it won’t restore.I can unzip the file and see its content, so the archive itself is seemingly OK. What I did try:Unzipped the file to a directory, removed the raster files from the created s
After a fresh installation of FME Flow 2024.1.2.1 are we (at least) missing the following two libraries:DateTimeFormat_func.dll DateTimeNow_func.dllAny idea where I can get these dll’s from so I can add them to the plugin directory of the server?
Hello, I am using FME Flow 2021 with 2 VMs and a Load Balancer all on Windows 2016. In Windows File Explorer (not in FME Flow), what folder/subfolder(s) are the uploaded workspaces and automations stored in? Is there a link to a document that explains what files are stored in what File Explorer folders or something similar for FME Flow? Thank you in advance for your assistance.
In a experimental environment I have set FME server in a machine with ArcGIS Pro. (I want to verify some expected behaviors in FME Server, with out the trouble to install ArcGIS Server)It has ArcGIS Pro 3.1.3, As the document https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility states: When I try to run the workspace, it fails, and do not even creates a log file. In the fmeprocessmonitorinengine.log I find this: Wed-13-Nov-2024 03:44:01.898 PM INFORM Thread-19972 ALGTRCPIMSDM01_Engine1 Translation Finished (service '7070'). Return message is '370430:The workspace has Python Compatibility set to 'Esri ArcGIS Python 3.7+', which requires an appropriate version of ArcGIS Pro or ArcGIS Server. If ArcGIS is not required by this workspace, then update Python Compatibility to a non-Esri-ArcGIS Python. Otherwise, please install the required ArcGIS product. Please visit https://community.safe.com/s/article/notes-on-fme-and-esri-vers
Hi all, I am wondering if anyone has faced a similar challenge. I created an FME workbench and published it to FME Flow successfully with some user parameters. The challenge is that I would like to send a message to the user after the job has completed running (or if failed). So instead of saying the job is completed or failed, I would like to modify it to give a more meaningful message.I do not want to send emails to users, otherwise I would have tried topics or automations. I just want to send a message (from an attribute) that appears at the end of the job.Thanks for the support in advance! Regards,Maadh
We just installed FME Flow 2024.1.2.1 on a Windows machine and I published a workspace. Running the workspace immediately ends in:Undefined macro `WORKSPACE_NAME' dereferenced in file `flow_testing\sqlserver_test_delete\sqlserver_test_delete.fmw' The workspace was published from an ArcGIS Interoperability Workbench [FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)], but I tried the same from FME Form 2024.2. The result is the same. The workspace is as simple as it gets. Just a reader and a writer, and the error appears independent if there is a name for the workspace set or not. Can somebody please point me the right direction to solve the issue?
Hi All.Our FME servers are still running 2022.2, but I need to run a specific job in FME Form 2024.1, and have it execute a workspace on the server.But the workspace refuses to connect to the server. This happens regardless of using FMEServerJobSubmitter (as copied from an old workspace), or a brand new FMEFlowJobSubmitter.The web connection used is saved in an older version (2020-2022), and works there. I tried to create and use a new connection in 2024, but that also fails.What caveats are present when trying to connect 2024 to a 2022 server ?Any insights and experiences are welcome.Cheers, Lars I.
How to setup FME Server as POST Endpoint capable of receiving HTTPS requests from AWS’s source IP range.?
I’m considering updating FME Flow to version 2024.1 on a server where we currently have ArcGIS Enterprise 10.9.1 installed. Some of my workspaces utilize Arcpy and the ArcGIS API for Python.Based on the compatibility table, ArcGIS Enterprise 10.9.1 is compatible with FME 2021.2, but not with FME 2024.1.Can anyone clarify whether Arcpy and the ArcGIS API for Python will function properly with FME Flow 2024.1 in this setup? Are there any known issues I should be aware of?https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility
We have an FME Flow automation that monitors a network directory for new files. Once new files arrive, they are emailed as attachments using an FME Flow Email (send) Action.Is there a way to make the “Email To” distribution list somewhat dynamic?We have an FME Workspace that generates a text file of the desired distribution list. Currently when it is determined a change might have occurred in the list, we open the text file and manually copy & paste the contents into the “Email To” of the FME Automation monitoring the network directory. Is there a means to have the Automation’s “Email To” parameter just use the text file directly?Or perhaps to have the workspace that generates the text file be included in the automation and provide the current distribution list once the automation is triggered?
Hi,I am trying to trigger an action on FME Flow when a new file geodatabase is added to my network. So I set up a Network or Resource directory trigger to monitor for CREATE events, but when I test it it fires once for each of the files contained in my geodatabase, or about 70 times.Ultimately I want to receive the path to the geodatabase in the File Path automation attribute, in just one trigger. Any suggestions are appreciated, thanks.
In the ‘Run Workspace Dialog, there is a ‘Log Debug’ option under ‘Advanced’ settings here: Why isn’t there an option to enable this ‘Log Debug’ in Automations when configuring the ‘Action>Run Workspace’ interface? I need debug logging details to run my automation in ‘production’ mode. It’s not honoring the logging setting when I published from FME Form. Shouldn’t the option be here: My ultimate goal is to have log files from workspaces ran within Automation have full debug logging enabled.Is there some setting in a config file I can change?Version: FME Form/Flow 2024.1.1.0 (Build 24619)
I have a workflow that allows the user to select their desired market as an AOI for a server app. See this example for what I'm referring to and how this is deployed. https://engage.safe.com/demos/map-based-data-distribution-fme-server-apps/ The workflow works just fine, but does FME server have the functionality to display features on the map when the user selects the AOI? This would help when defining the area somewhat and give the user more context to what they are selecting.
Disregard...found issue
We currently have a process where an automation is stopped by any upstream failure triggering a workspace which contains a httpcaller with a call to the fme rest api to stop the automation. The request is configured to use $(FME_SERVER_WEB_URL) and an the Automation General Attribute/Key AutomationID to construct the request for the api so in this way it is generic. I’m wondering if there’s any way to use the user running the automation as authentication for the http request?
Hi We have recenly started using FME Flow more. When someone runs a flow app no log file is created. However, if the admin user logs onto the web interface and they run the app again (on the same or different pc), a log file is created. Is this expected behaviour? If not, does anyone know how to get round this? Thanks
HelloI have a Workspace App in dev phase. Since I cannot embed a HTML page by design or make use of dynamic user parameters to retrieve an event ID for now, I went with the idea of using a URL / Link within the description box, (Markdown style).URL points to SP OnlineI’d like to implement target=”blank”.[link](url){:target="_blank"} (Kramdown)Is this possible? ThanksSameer
Hello, I am needing some help quickly. I am trying to create a FME Flow Automation that passes 3 attributes to the email action. The attributes are all created inside the workbench using the FME Flow Automation Writer. Each one of the attributes passes the From, To and CC data for the email action. When I run the automation, nothing comes out and the log file says the below message. I honestly have no idea why this is not working. I have looked up many resources on this site to get this to work, but i keep getting the same message. I know there is a value, why is it not working. 65 2024-10-29 07:58:41 | PermitData: Attribute name is empty for value expression ''. Ignoring expression since unable to create a blank attribute name
I’ve been running a script on FLOW for months that unzips and deploys apps to an IIS web server by copying them to the wwwroot folder. If the app already exists and needs updating, the script backs up the existing folder, deletes it, and then deploys the new version. However, about two weeks ago, it stopped working because the Python function in the Python caller can’t delete and replace the existing directories.I have admin permissions to the wwwroot folder, and the workbench runs correctly from my computer. But when it runs from FLOW as the application account, it fails. The app account has the same permissions on the wwwroot folder as I do, and both accounts are in the admin group.I suspect a Windows update or a policy change might be causing this issue.Any ideas?
This is my first time using the SFTP External Action in an Automation. I have previously used the FTPCaller Transformer in FME Form, but sometimes it gives an SSH error. The SSH error has occurred 2x over the past 6 months. Safe Tech Support tells me it is a generic error for which they cannot find a fix. Consequently, I am looking to use SFTP External Action in my Automation that previously used a FME Form workspace to upload to the SFTP. Questions about the SFTP External Action Details in Automation:Source Path includes the path and the file name (myspreadsheet.xlsx); Is it ok to add the name of the source file in the Source Path? Destination Path includes the path and the file name (myspreadsheet.xlsx); Is it ok to add the name of the destination file in the Destination Path? Is it correct to assume that Destination Path is the same as the Transfer URL in the FTPCaller Parameters in FME Form? The SFTP site has a password, when I enter the password in Password (optional) and choose
How to set FME Flow Schedule (under Automations) to run quarterly? I’ve tried the following CRON expressions:0 0 1 */3 *and 0 0 1 3,6,9,12 *FME throws an error for both of these expressions. Is there a known work around?Note: I do not want to use Schedules.
Not sure if it might benefit others but I’ve recently had to enable HSTS to harden the HTTP redirect from Port 80 to 443.Edited the web.xml file and located the HSTS Comments. (~Line 468)Added the below filters <!-- Enable HSTS --><filter> <filter-name>httpHeaderSecurity</filter-name> <filter-class>org.apache.catalina.filters.HttpHeaderSecurityFilter</filter-class> <init-param> <param-name>hstsEnabled</param-name> <param-value>true</param-value> </init-param> <init-param> <param-name>hstsMaxAgeSeconds</param-name> <param-value>31536000</param-value> </init-param> <init-param> <param-name>hstsIncludeSubDomains</param-name> <param-value>true</param-value> </init-param> <init-param> <param-name>hstsPreload</param-name> <param-value>true<
We are in the process of setting up our production environment. I have enabled version control in Dev and have been committing/pushing my workbench edits to our external GIS repository. I have connected our production environment to the same repository, but Fetch doesn’t pull down the workbenches. Is that normal behavior, as is that user-error? I know I can make a Project file and move them, but was wondering if I’m doing something wrong.