FME Flow

I’m new to FME tool and I wanted to pull data from Google BigQuery tables and convert into GeoDatabase and shapefile. I'm using FME Workbench version 2024.1.1 and I'm experiencing an issue with using Google BigQuery as a reader. But I’ve installed Google BigQuery as a transformer and attempted to pull data, but no data is being retrieved. I’ve also authenticated using a service account key file, but the data still isn’t showing up.

I have an Automation on FME Server, which runs a workbench and that workbench runs a SystemCaller which runs a python script.Occasionally, the python script fails to run, and I want this failure to be recognised by the Automation, so that it sends me an email stating that it has failed.How do I do this?I can see how to set up the SystemCaller so that the Output Exit Code Attribute has a value of nonzero (representing failure)But how does this trigger the workbench to fail inside the Automation?I need the Automation to recognise the failure event so that it can generate an email stating that.

Hi, This is just for esthetics: I geht houndreds of warnings from FME_Server runnung an Job with some SystemCallers that copy files with robocopy. Although everything works fine and the the files are copied, "Failed to Execute" does not look nice. SystemCaller_12: Failed to Execute `robocopy \\\\RZ2-ZDA-01\\Data$\\Aktuell\\INSPIRE \\\\RZ2-ZDA-01\\Data$\\Historisch\\INSPIRE CP_CadastralParcel.gpkg' If I use the commandline "cmd" from Win2019 on the FME-Server then I dont get any warning.   

Hello,I have a question on the automatic rotation of 3D objects with FME. First I placed my 3D object on different points with the workflow explained in the following tutorial: https://support.safe.com/hc/en-us/articles/25407425765133-Creating-and-Using-Geometry-Instances. Now I want to rotate the 3D objetcs (electric poles railway) in the direction of a 2D Polyline (rail axis). Is there a possibility to rotate the 3D poles rectangular to the rail axis? Best regardsEric

I’m trying to update FME Flow from version 2023.1 to 2024.2. Upgrading In Place, On the Same Machine.I want to use the encryption key from the previous FME Flow installation so I could restore the previous configuration in the new installation. This means I also want to update my FME Flow Database password in fmeDatabaseConfig.txt.Before starting the newly installed FME Flow, the encryptConfigSetting.sh script works and outputs the password in the format of DB_PASSWORD=fme_enc:xxx.After I’ve started the FME Flow, the script does not work anymore:Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/codec/digest/DigestUtils        at COM.safe.fmeserver.encryption.FMEEncryptionKeyFileUtils.computeChecksum(FMEEncryptionKeyFileUtils.java:22)        at COM.safe.fmeserver.encryption.FMEEncryptionKeyAccessorFile.calculateChecksum(FMEEncryptionKeyAccessorFile.java:86)        at COM.safe.fmeserver.encryption.FM

Hello everyoneWe have a problem, we upgraded from FME Server 2022 to FME Flow 2024.1.1FME Flow was installed on a virtual machine in Azure, after doing the express installation it was configured to use a .pfx certificate and HTTPS according to the documentation (https://support.safe.com/hc/en-us/articles/25407434854157-Configuring-FME-Flow-for-HTTPS-Using-a-PFX-or-P12-Certificate)In the fmeServerConfig.txt file it was assigned to FME_SERVER_WEB_URL=https://<hostname>:443From that machine we tried accessing using https://<hostname>/fmeserver/ and it works fineFrom any other computer we used https://<hostname>.mydomain.eu/fmeserver/ and it worked but now this gives an error 502 Bad GatewayIs it a DNS error or are we missing something to configure in FME Flow? Thanks in advance

I just had a little adventure in restoring the FME Server (we are on 2022) configuration database - that is the internal postgres database for configuration and job history. We will move it to mssql eventually...I managed to hose our test server the other day - it is this problem I wrote a post about here:Now we have had a scheduled job that creates a full pg_dump backup of the data, and the latest run was just 2 days old! We have had the backup system in place, but we have never had to do a restore - the backup is also for archiving the history.It took a lot of trial and error and experimentation to figure out how do it, but eventually I got there.* Drop the fmeserver database* Recreate the database* Restore from backup (schema + data)* Grant permissionsHere are my more detailed notes...

I am on FME Server 2022.2.8, and I have a quite big automation where the workspaces communicate through json messages. Now I have been able to replicate a crash in too machines, but I haven’t been able to isolate the exact problems. I think it might be related to https://support.safe.com/hc/en-us/articles/25407442818189-Known-Issue-FME-Server-Core-java-lang-OutOfMemoryError-Java-heap-spaceIf I start processing that involves some 100 workspaces queued and running with quite long json messages the rest api stops responding eventually (about 30 minutes in, returning 500 errors). Processing seems to continue and automation is running fine, the Server ui seems ok (I think it is relying on REST API v4).Restarting the FME (or the server) does not help the problem, but cleaning up r

I am trying to convert an old script that loads 100+ tables in Postgres to a FME Server automation. One of the things I am doing is a INSERT INTO schema1.table SELECT * FROM schema2.table with a SQLExecutor where schema2 is a Oracle foreign table. This works fine for some smaller tables, but for a large table around 33gb I eventually receive a 'could not receive data from server: Connection timed out' error whether I run it on desktop or server. This worked fine when run from the script. I'm at a loss here, what could be causing the problem?

Hello,I just performed an upgrade from FME FLOW 2023.1 to version 2024.2 and now I have a big problem because I can’t restore the backup I made before upgrading.The restore process fails with The system restore failed for the following reason:The export location provided is invalid.The error message in the History list saysCOM.safe.fmeserver.configuration.migration.FMEConfigurationException: java.lang.NullPointerException: inputStreamin a red box just above the heading “Failure”.The log just states Unable to extract import package. The backup.fsconfig is a quite large file (15 GB) because I forgot to remove some raster files from the resources before creating the backup. I copied it manually to the resources/Backup folder so I can select it from there for restoring instead of uploading. Nonetheless it won’t restore.I can unzip

After a fresh installation of FME Flow 2024.1.2.1 are we (at least) missing the following two libraries:DateTimeFormat_func.dll DateTimeNow_func.dllAny idea where I can get these dll’s from so I can add them to the plugin directory of the server? 

Hello, I am using FME Flow 2021 with 2 VMs and a Load Balancer all on Windows 2016. In Windows File Explorer (not in FME Flow), what folder/subfolder(s) are the uploaded workspaces and automations stored in? Is there a link to a document that explains what files are stored in what File Explorer folders or something similar for FME Flow? Thank you in advance for your assistance. 

 In a experimental environment I have set FME server in a machine with ArcGIS Pro. (I want to verify some expected behaviors in FME Server, with out the trouble to install ArcGIS Server)It has ArcGIS Pro 3.1.3, As the document https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility states: When I try to run the workspace, it fails, and do not even creates a log file. In the fmeprocessmonitorinengine.log I find this: Wed-13-Nov-2024 03:44:01.898 PM INFORM Thread-19972 ALGTRCPIMSDM01_Engine1 Translation Finished (service '7070'). Return message is '

Hi all, I am wondering if anyone has faced a similar challenge. I created an FME workbench and published it to FME Flow successfully with some user parameters. The challenge is that I would like to send a message to the user after the job has completed running (or if failed). So instead of saying the job is completed or failed, I would like to modify it to give a more meaningful message.I do not want to send emails to users, otherwise I would have tried topics or automations. I just want to send a message (from an attribute) that appears at the end of the job.Thanks for the support in advance! Regards,Maadh

We just installed FME Flow 2024.1.2.1 on a Windows machine and I published a workspace. Running the workspace immediately ends in:Undefined macro `WORKSPACE_NAME' dereferenced in file `flow_testing\sqlserver_test_delete\sqlserver_test_delete.fmw' The workspace was published from an ArcGIS Interoperability Workbench [FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)], but I tried the same from FME Form 2024.2. The result is the same. The workspace is as simple as it gets. Just a reader and a writer, and the error appears independent if there is a name for the workspace set or not. Can somebody please point me the right direction to solve the issue? 

Hi All.Our FME servers are still running 2022.2, but I need to run a specific job in FME Form 2024.1, and have it execute a workspace on the server.But the workspace refuses to connect to the server. This happens regardless of using FMEServerJobSubmitter (as copied from an old workspace), or a brand new FMEFlowJobSubmitter.The web connection used is saved in an older version (2020-2022), and works there. I tried to create and use a new connection in 2024, but that also fails.What caveats are present when trying to connect 2024 to a 2022 server ?Any insights and experiences are welcome.Cheers, Lars I.

 How to setup FME Server as POST Endpoint capable of receiving HTTPS requests from AWS’s source IP range.?  

I’m considering updating FME Flow to version 2024.1 on a server where we currently have ArcGIS Enterprise 10.9.1 installed. Some of my workspaces utilize Arcpy and the ArcGIS API for Python.Based on the compatibility table, ArcGIS Enterprise 10.9.1 is compatible with FME 2021.2, but not with FME 2024.1.Can anyone clarify whether Arcpy and the ArcGIS API for Python will function properly with FME Flow 2024.1 in this setup? Are there any known issues I should be aware of?https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility

We have an FME Flow automation that monitors a network directory for new files.  Once new files arrive, they are emailed as attachments using an FME Flow Email (send) Action.Is there a way to make the “Email To” distribution list somewhat dynamic?We have an FME Workspace that generates a text file of the desired distribution list.  Currently when it is determined a change might have occurred in the list, we open the text file and manually copy & paste the contents into the “Email To” of the FME Automation monitoring the network directory. Is there a means to have the Automation’s “Email To” parameter just use the text file directly?Or perhaps to have the workspace that generates the text file be included in the automation and provide the current distribution list once the automation is triggered?  

Hi,I am trying to trigger an action on FME Flow when a new file geodatabase is added to my network. So I set up a Network or Resource directory trigger to monitor for CREATE events, but when I test it it fires once for each of the files contained in my geodatabase, or about 70 times.Ultimately I want to receive the path to the geodatabase in the File Path automation attribute, in just one trigger. Any suggestions are appreciated, thanks. 

In the ‘Run Workspace Dialog, there is a ‘Log Debug’ option under ‘Advanced’ settings here:  Why isn’t there an option to enable this ‘Log Debug’ in Automations when configuring the ‘Action>Run Workspace’ interface? I need debug logging details to run my automation in ‘production’ mode. It’s not honoring the logging setting when I published from FME Form. Shouldn’t the option be here:  My ultimate goal is to have log files from workspaces ran within Automation have full debug logging enabled.Is there some setting in a config file I can change?Version: FME Form/Flow 2024.1.1.0 (Build 24619)

I have a workflow that allows the user to select their desired market as an AOI for a server app. See this example for what I'm referring to and how this is deployed. https://engage.safe.com/demos/map-based-data-distribution-fme-server-apps/ The workflow works just fine, but does FME server have the functionality to display features on the map when the user selects the AOI? This would help when defining the area somewhat and give the user more context to what they are selecting.

Disregard...found issue

We currently have a process where an automation is stopped by any upstream failure triggering a workspace which contains a httpcaller with a call to the fme rest api to stop the automation. The request is configured to use $(FME_SERVER_WEB_URL) and an the Automation General Attribute/Key AutomationID to construct the request for the api so in this way it is generic. I’m wondering if there’s any way to use the user running the automation as authentication for the http request?

Hi We have recenly started using FME Flow more. When someone runs a flow app no log file is created. However, if the admin user logs onto the web interface and they run the app again (on the same or different pc), a log file is created. Is this expected behaviour? If not, does anyone know how to get round this? Thanks