FME Flow

FME server job for 23M records fails on one environment, but succeeds on another. Comparison of initial memory resources shows that the starting point for both jobs is the same: However, a comparison of memory fragmentation in those environments shows some differences as follow: Is it possible that memory fragmentation causes that on one FME Server Engine job succeeded, but on the other failed?

Hi, I see these warnings in some of our logs (FME Server 2021): FME Configuration: Extremely low initial memory conditions detected. To improve stability and performance please increase the memory available to FME. It seems to be random, not correlated to any particular jobs. However, when it happens, it seems to affect two to four jobs in a row - I don't have many jobs yet (recent installation), so this might be a coincidence. On the bright side, it doesn't seem to prevent the jobs from finishing. After reading a few articles, I see a few points I suspect I could look into: FME Server configuration - specifically, MAX_TRANSACTION_RESULT_SUCCESSES and MAX_TRANSACTION_RESULT_FAILURES. We have the default values at this moment (100 and 10).Memory parameters - in the examples I see "Start freeing memory when the process exceeds 71.99 GB". In our system we see much lower values, e.g., "Start freeing memory when the process exceeds 2.83 GB or address space exceeds 3.4

When I create a manual trigger automation and pass in a single key value pair as a manual Key, the complete json for the key seems to be pass to the next action in the automation. The next action is a submit job action that takes a single published parameter (VERSION).    Is there a way to bind just the value from the manual key to a published parameter in the next action (Run a workspace action)?  I created a manual trigger with a manual key called MANUAL_KEY.  In subsequent actions, I apply the MANUAL_KEY from the trigger to a parameter in the action using the pattern “Manual.MANUAL_KEY” the resulting value is complete JSON and includes KEY name and value.   This results in the full json passed in as the published parameter in the workbench action : { "MANUAL_KEY": "Example value"} Is it possible to bind only the value?  Something like “Manual.MANUAL_VALUE.Value” ?? Which would pass only “Example value” into the published parameter of the next action? I have tried

I have a user that gets an email with an xlsx report in it. the report is not sent directly but is in a url that (i cannot post it here) has ?u=213123&id=3126582175e=12323 I have not determined how or if this url will change with each delivery. The url only changes with the report type. apparently they upload a new file to the same url each week.But this cannot be used with any of the fme server email functions (we had to disable all email to or from fme). The file that is in the link is a simple xlsx so that part i already have working. i am just trying to figure out how to make something work within the parameters of our requirements. So since the url doesn't change I just need a way to read this email and feed this url into the xlsx reader.I have the feed part i think. but when i try to set up something with email it always seems to be dependent upon the internal fme server email system. which we cannot use. the only other method i have found will only read an email attachm

Hi, I am new to using data download or streaming in FME Server, I have only used job submitter up until now. I am wanting a very basic workspace to generate a CSV which is then returned to the user via the web browser, once they run a fme workbench via FME Server directly (Server App).  Does anyone know which method would be best to return just the CSV file, on demand, direct to the users web browser for download? I am looking through the help files for examples on best practice, but its all a bit confusing. I have currently got a workbench published to server, and its using data download as its registered service, but it keeps downloading a zip file with a half dozen sub folders within, then my CSV file with its associated data. I am presuming I have over complicated things. In essence, I am hoping to get the results of this workbench to the user via a CSV which they can download to their PC:  Can anyone point me to any guides or tutorials on how to do this in the most simple and stra

Hi all,I have an FME Server automation that runs a number of workspaces one at a time. In the first workspace I want to apply some kind of action depending on whether there are any features on a certain transformer output port. For example, I can place a NoFeaturesTester on this port, and:If it reports no features, I would like to inform the user in some way and continue with the remaining automationIf it reports that there are features, then I would like to send the user a list of these features (via email perhaps), and also look to pause or terminate the Automation.Can anyone advise a sensible way of doing this?Thanks,RB     

I've been able to create a Workspace that gathers PDF's -> ZIP them -> Attaches files -> to Emailer Transformer. The file only needs to be temporary until the Workspace is complete.I'm trying to understand FME Server Resources and using [FME_SHAREDRESOURCE_TEMP] or [FME_SHAREDRESOURCE_DATA] within a Workspace but no success. Are these the wrong location or not accessibleORDo I need to follow and create a new location "Example 4: Using a Resource Folder Within a Workspace" in https://community.safe.com/s/article/fme-server-resources-uploading-referencing-and-con-1

Hi all!I have some odd issue,I set up my Gmail web connection like describe in here, test it, and everything's is good.But when I want to use this connection in Emailer, it doesn't give the option to choose this Gmail web connection, and it ask me to set up new and regular one, which fails with Google error 401: disabled_client.Can anyone help me?how can I force 'emailer' to take the right Gmail connection?Thanks!

Hi there, UPDATE 14th Feb 2022: I have now added my workbenches, though not sure how much more insight they will provide - I am wondering if it is the fact that an 'umbrella' process is running and taking a long time and therefore using up a lot of processing? Or if it is simply downloading a lot of zip files and then loading them into the database in a linear fashion that makes it take such a long time.I have also now upgraded my FME Cloud instance to 'Professional' - m5.xlarge, 4 CPUs, 16 GB RAM and 100GB temporary disk space - this did show an initial improvement (see additional graph data 14th Feb), but it is still averaging 00:02:15 per file, so will take 11 days just to download and upload 7,00+ files - this doesn't seem right to me?!Any pointers very gratefully received. And thanks again.  I have an FME Server running on a standard FME Cloud (8 GB RAM, 2 CPUs, 25 GB Temp disk space) I am trying to understand the best set up of my workbenches / FME Cloud to en

Having setup an automation on FME server downloading data from an AGOL service, I have to repeat Reauthentication on my login every time data with in the AGOL service has been updated. This does make the automation kind of redundant.. anyone else have had this problem ? and how do I make it go away 😊

The application-specific permission settings do not grant Local Activation permission for the COM Server application with CLSID {228826AF-02E1-4226-A9E0-99A855E455A6} and APPID {2FD08A73-D1F1-43EB-B888-24C2496F95FD} to the user <user> SID (S-1-5-21-73586283-1409082233-725345543-564895) from address LocalHost (Using LRPC) running in the application container Unavailable SID (Unavailable). This security permission can be modified using the Component Services administrative tool.

Hey everyone, new to FME. Not a professional in GIS, so please excuse my lack of knowledge on terminology. I'm using this guide and I've followed the instructions, as well as downloaded the provided workbench file, but for some reason, I can't get my .LAS/.LAZ files to convert properly. Using the first method from the guide yields the weird image above. Does anyone know what's wrong? I've tried this with a few files and it doesn't seem that my files are the issue. I've uploaded the project file to this post.

Hello everybody... I'm trying to find a way to delimit a preservation area within the parcels of my allotment. The area to be preserved has always to be 30% of the parcels area, also it has to be on the bottom side of the parcel. I tryied to had draw it on the pic above. Is there any transformer that could fill a the polygon within a given percentage, or create another polygon wich the área corresponds to the a percentage of the lot?

I have survey records being written to a database using a work bench. Along the way there is a transformer that checks for null values, if they exist currently the records are wrote to a .csv file to be checked. I would like to send an email to the surveyor so they can edit and resend their records for writing to the database. Currently I have a HTML Report Generator set up for a table of records that have null values. I had tried to use the Attribute File Writer to isolate the surveyor name and then use the html content in the email body. This doesn't seem to work and was hoping someone has a workflow. Basically the Emailer 'To' is conditional based on the survey record submitted and then I would like the email to contain the survey record with null value. Thanks in advance!,Kathy

I have a workbench that reads/writes CSV files to a network location. It works fine from my desktop but when published to FME Flow i get permission errors reading and writing. What user is FME Flow using to read/write to the network? any other workaround

I need to merge individual 1km2 LIDAR tiles in .asc format to form a single layer. I have a table (.xlsx) which lists the .asc files, their folder location and the site reference they are associated to. I have read the table into FME and using a FeatureReader and can open all the .asc files and by using the RasterMosaicker, and Reprojector I can combine the the .asc files and output the merged LiDAR.  This works fine for a single site. Of course when I add further sites to the table I end up with all the LiDAR merged into a single feature. How can I set up FME to iterate through the table merging the necessary tiles and produce a single LiDAR output before repeating the process for the remaining sites?  

Can you use LDAP/Active Directory Reader (Technology Preview) to update active directory? If not, what does FME offer to provide this functionality? Thanks

Issue: During the Christmas break, one of our automations failed regularly due to an account issue. I did not get any notifications and only upon my return and a manual review did I see this issue. Question#1 : What is the correct method for tracking automation failures. Can the system send email notifications with the associated error message. If so, how do I do this ( note: my knowledge in the product are still basic ) Question#2 : We are scanning workspace logs from the logs folder , but where are the automation logs ? Many thanks in advance for any assistanceOliver @ EGW 

Hi, I have an issue with import numpy in Python Startup Script in FME Workspace in FME Flow: FME Flow 2023.0.1 uild 23332 - win64 I guess that numpy package is already installed in FME Flow (and Form).In FME Form there is no issue but when I publish workspace on FME Flow I get: Python Exception <ImportError>: IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!Importing the numpy C-extensions failed. This error can happen formany reasons, often due to issues with your setup or how NumPy wasinstalled.We have compiled some common reasons and troubleshooting tips at: https://numpy.org/devdocs/user/troubleshooting-importerror.html Please note and check the following: * The Python version is: Python3.11 from "C:\\Program Files\\FMEFlow\\Server\\fme\\FMEEngine.exe"* The NumPy version is: "1.24.2"and make sure that they are the versions you expect.Please carefully study the documentation linked above for further help.Original error was: DLL load failed

Hi, I have successfully followed the below resources to get the SharePointOnlineConnector up and running on FME Server:https://community.safe.com/s/article/How-to-create-a-Sharepoint-Web-ConnectionI created my own Azure application to do this, and successfully test the authentication. The workspace works fine for a few days, untill the request token expires, it then fails to generate a new token until I manually reauthenticate. Is there a way around this @jlutherthomas​ ? I'm using FME Server 2021.1.1 Build 21619 - win64 Thanks

Hi, I've build an automation in the FME Server with Trigger type: Schedule initiated and Schedule type: Repeat on interval for 1 minutes (for testing purpose) and it works perfectly . However when I stop the automation and set the interval for 1 day at 7.00am, the automation is not working after I checked again the service the other day.   Any idea on how can I resolve the issue?

Hi Is there any time frame on when a version of FME will be available for Debian 12?

How we can read any specific Microsoft Outlook email and excelsheet attachment with data from email to add this excel data in FME Workbench to process ahead and generate the required output as reports.

I am trying to use webhook with the FME server, and the service requires the web server must support GET/ to confirm the reachability of the server. How do I enable GET within the FME server's automation to return a success message?  

Hi, We are implementing FME Server, we have set up server core components on one machine using docker-compose and engines on different machines using docker. All these are done on Linux, the host is a Linux machine and all component is running on Linux containers. I do have a few users who have jobs that have a dependency on arcpy. I came across this article ArcPy on FME server (safe.com). This is more about windows, is there any way to support arcPy with FME on Linux environment?  Thanks,Naman