A space to discuss FME Flow
Recently active
I have a workspace on FME Server which is initiated by a webhook. There is always an XML that comes with the webhook. The XML is passed into a parameter for the workspace. The workspace parses the XML and processes it into a database. Occasionally, the workspace fails or is aborted. I would like to try to run that workspace again or at the very least extract the XML payload. When the workspace fails (could be because the XML had an incorrect value or there were network issues), is there any way that I can retrieve the XML? Further, and this is probably more critical, if the workspace has been aborted (perhaps it was accidentally cleared from the queue), can I retrieve the XML? Or reprocess the message somehow? If I try to resubmit the failed job again , it doesn't seem to have the XML anymore. Or do I have to send the message again from it's source (Maximo)?
We do have FME Server setup on Ubuntu OS, and some of our big data stores are in windows file shares AWS FsX. Our users would like to access windows fileshare from FME workspaces in the FME server. Any ideas on how we can achieve this?
Is FME Server affected by the recent vulnerability discovered in Spring Core? https://www.contrastsecurity.com/security-influencers/new-spring4shell-vulnerability-confirmed-what-it-is-and-how-to-be-prepared
Hi, Our FME Server infrastructure is deployed in AWS on Docker, Core is running on dedicated EC2 with docker and engines are running on docker + EC2 which starts as users start the job. I have a user who has a workflow that uses python script. We followed the documentation and asked the user to upload the module to Resource>Engine>Plugins>Python FOlder. After uploading the module user is still facing the error. I am suspecting this is related to the path where the module is and where the script is looking for the module. Most likely, I am not the first one to encounter this but I could not find any documentation or community post with examples that can help us solve this situation. Any pointers? Thank you in advance. -Naman.
In my automation I want to include the server name in my success / fail emails. That way from the email you can determine if the emails is coming from the dev / test / production server. Can not find the server name as one of the keys available.
Hi All,Running an automation to pull data from an external SFTP site to be post processed with multiple other workspaces.I've set the time per my server at 4:15 am (and tried 4:30am, now trying 5am), have checked my server, it is set to EST (UTC - 4 since we are in DST now). Schedule trigger states that it uses the local time on the FME server). Looking at the SFTP thin client website, the data says that it was uploaded at 4am today. When looking at the same SFTP site via WinSCP, it says that it was uploaded at 12am today.My automation appears to be working as it should by processing all of the data. However, it is consistently having the previous week's data (it is only uploaded to the SFTP site once a week and I process only once a week). What time should I really be using for getting this data? When I trigger the automation after 8am EST it picks up the currently shown data (although it is dropping it on the server with the 12am timestamp). I would have thought that i
@stewartatsafe , you mentioned the modification of templates in :https://community.safe.com/s/article/Deployment-options-for-FME-Server-in-the-CloudI could not find any example (or even better step by step tutorial) to adapt the Azure distributed deployment template to be "ESRI server compatible". The engine instances should have the ESRI libraries included if I understood well. Do you have any kind of resource or advice in this regard? Thanks in advance!Antoine.
I have a working Postman script for an OAuth2 connection.When I look at the raw headers it shows that it sends the following headers:Content-Type: application/x-www-form-urlencodedAuthorization: Basic QjIzRkI3RUU5RTZDRZZZQTRCRDJGNjVEOUM5ZZZxNjE6QzAzM0ZDOTU0RjM5NDQ1Qjg2RjdCOUQ1QzlGQzQ2MDYwM0Q1QkUwNEIzMEE3ZZZDMzFCMTI5NzM5M0MxQUMwRQ==User-Agent: PostmanRuntime/7.29.0Accept: */*Cache-Control: no-cachePostman-Token: a8126467-b10d-4a59-b116-f8a6d1160aa8Host: projectlocation.relaticsonline.comAccept-Encoding: gzip, deflate, brConnection: keep-aliveContent-Length: 182Cookie: SESSION_START_COOKIENAME_29C5C999-84D0-4D23-A8F0-F888A8C64C78=trueBut if I add a new Webservice with the OAuth2 template in FME it looks like it is sending:https://projectlocation.relaticsonline.com/oauth2/token redirect_uri=https://localhost/client_id=12345567890client_secret=ASDFJKLgrant_type=authorisation_codecode=[responseCode] Accept=application/jsonContent-Language=en-USContent-Type=application/x-www-form-urlencodedI
Hello, I encountered an issue using FileDeleter as it fails to delete the files. I have some scripts deployed on FME Server that download some xls files daily, perform some reports and next day, new files are downloaded,and the old ones must be moved to an archive and delete the target file or folder. I get the next error when the transformer FileDeleter is trying to dedlete the files from previous day in order to download new ones. This error is not present in a Windows env (now I am trying to replicate that FME Server installation along with it's scripts on unix env...maybe this can be an issue?) Error: " 2022-3-29 13:58:28 | File Copy Writer: Error attempting to move from '/opt/fmeserver/resources/data/Reports/temp/route_gps_pos_arc_20220329.xlsx' to '/route_gps_pos_arc_20220329.xlsx'. Please check for sufficient permissions on the source and destination. Alternatively, if Overwrite Existing File is set to 'No' please ensure output file does not alre
Suppose I have two workspaces A, and B that run sequentially in a scheduled job. I want to start B if A actually runs through and writes something to the writer. If nothing writes in A, I don't want B to start at all. I could think of a few ways to do it, but all require writing intermediate status data to an external file or database. Should there be a simpler way to do this in the FME server automation (I am at 2021.1.2)? Is it possible to do this in the startup python script - if a condition is not met, terminate the workspace?
I have a URL being sent through emailer and everything seems to be working fine until the email comes in. The URL is there except its missing a few characters. Any Ideas why?
Hi, We are implementing FME Server, we have set up server core components on one machine using docker-compose and engines on different machines using docker. All these are done on Linux, the host is a Linux machine and all component is running on Linux containers. I do have a few users who have jobs that have a dependency on arcpy. I came across this article ArcPy on FME server (safe.com). This is more about windows, is there any way to support arcPy with FME on Linux environment? Thanks,Naman
I would like to automate the following processes by a batch job or equivalent. Please advise if you have any idea. Here are the steps what I am working now. Firstly, load the CityGML to a FME workbranch by the "Reader".Secondly, select fme_basename and fme_feature_type in the "Reader" setting.Thirdly, I will select excel file in the writer and link up the "Reader" and "Writer".Finally, go to "Run" > "Run Entire Workspace" to export the result and the following is the result sample.
We have a use case where we need to implement a webhook using FME. This will be called by a partner application.This webhook has a predefined URI (in partner application side) like:https://fmeserver/repo/worskapce1.fmw?attr=?attr2=?Names of parameters cannot be changed and partner application is not willing to update the webhook to pass security token in the header. We are planning to do security by only whitelisting the ip addresses of the partner application. In this case, how we do call the FME workspace? Everytime I try to call my workspace, it returns an following error"401-Unauthorized. The request has not been applied because it lacks valid authentication credentials for the Target resource" Is there no way to call FME workspaces without passing tokens in the header of the call?Is there a way to change the name of the token attribute in the header to something else? I can repurpose attr2 for this and provide a static token to the application.
Hi, I have a workspace that runs successfully on desktop, but fails on FME Server. I want to annotate/highlight validation errors in DWG files. So I created a second workspace, that's being triggered by a WorkspaceRunner/FMEServerJobSubmitter, to write these annotations using the correct original DWG as a template. To collect this output in the output of the master workspace and make it available in the download service, I was thinking of using a File Copy Writer. This writer can then be included in the download service when publishing. As said this works perfectly on desktop. But when running on FME Server, I get the "File Copy Writer: Feature contains an invalid source dataset" error.Though this file is definitely created on FME Server:This file exists and is not corrupted, so I don't have an idea why it's invalid. I tried shortening the paths and filename, but no solution.I also tried to add filecopy_dest_filename and filecopy_type, though these don't seem
Hi,FME's background maps are not showing up when I'm on my company's VPN.I've tested a few ones (STATMEN, ESRI, MaoBox). They all work fine without VPN, but they don't (or sometimes they will for a very short period of time) when I'm connected with VPN. The fun part : I've tested the same maps with QGIS and ArcGIS Pro and they work flawlessly. Anybody ever face that problem ? Thanks Phil
ArcGIS Pro requires an email to license the software for the service account. Once the service account was changed to the UPN format, the FME Web Interface recevied a login failure when logging in using the service account. We have an open case with ESRI, but want to know what other companies did since the account has to be a service account to be used with FME Server and must be used to install and license ArcGIS Pro.
In the documentation, i can only get something like :{"balance":0.0,"available_credit":243.67,"estimated_costs":8.99}Is there a way to get as much details as on the dashboard page through the API? If not is there a way to generate a token to call directly the billing dashboard page?
The FME Server license doesn't recognize the current machine because it is limited to one or more specific machines.Use FME Sever on a machine for which it is licensed. Kindly assist us same.
I used rets-connecter runner to download the source data(CSV file) from vendor , and after that fme will read this file for further process. But My System Caller running forever, it's not coming out, executing continuously.. But in command line , it executes immediately and come to the Drive prompt(i mean E:\temp>) fmw file attached.Can Anyone pls help Command line to run this workspace: "E:\Program Files\FME2021\fme.exe" E:\FME_TEMP\wb-xlate-1647675806459_11696 --FME_LAUNCH_VIEWER_APP "YES" Starting translation...Current FME version: FME 2021.2.1.0 (20211203 - Build 21797 - WIN64)FME_HOME is 'E:\Program Files\FME2021\'FME Database Edition (node locked-crc)Serial Number: Z6XB-SJY8-15LXPermanent License.Machine host name is: PXLLTPRD276Locale: en_INSystem Encoding: windows-1252FME Configuration: FME_BASE is 'no'FME Configuration: FME_MF_DIR is 'E:\FME_TEMP/'FME Configuration: FME_MF_NAME is 'wb-xlate-1647675806459_11696'FME Configuration: FME_PRODUCT_NAME is 'F
Hi all. Is there a way to prevent a scheduled job from being launched, if it's already present as a queued job ? If there is a bulk of jobs that need to be processed first, it clogs up the system. Lower prioritized jobs will be bulked together, and you can end up having a handful of identical jobs waiting to be processed, one after the other. This is a waste of resources. It would be nice, if subsequent job launches could be cancelled in advance, if the very same job with the very same parameters (none in this case) is present as an already queued job (or running). Cheers.
PROBLEM 1 if in column TYP the value is PL than do nothing (keep the cell G1, H1, I1 empty) ******************************************** PROBLEM 2 if in column TYP the value is PEthan calculate value in "x1 in (m)" check condition "F is W" or "F is E" or F is S" here the condition is "F is W" so fill in default value from "Y in (m)" to "y1 in (mm)" and from "Z in (m)" to "z1 in (m)" FORMULA to calculate/obtain value in "x1 in (m)" i.e. 1960.85 from the DIM in (mm) always select the first value before "x" for i.e. 600 and convert it from millimeter (mm) into meter (m) i.e. 600/1000 = 0.6 now add the result i.e. "X in (m)" + "0.6" ******************************************** PROBLEM 3 if in column TYP the value is HOthan calculate value in "y1 in (m)" check condition "F is W" or "F is E" or F is S" here the condition is "F
Hello I have an automation action that generates some files inside the FME Server 2021 Data folder, I need to zip the output folder after the action is complete. Can some one please advise? e.g. after the action is complete, all results will be populated in $(FME_SHAREDRESOURCE_DATA)/ALIM3263/destination/Extraction/I want to compress whatever files in the extraction folder as one single zip file and save it to:$(FME_SHAREDRESOURCE_DATA)/ALIM3263/destination/Compression/
Hello, I'm using FME Server 2019.2.3, and have written a Server app, which runs a data download workspace. How can I get an email sent to the user with a link to download the output? Currently I have an automation which is a triggered by posting to a topic, and sends an email, but am stuck on how pass a parameter from the job with the user's email address to the automation? Thanks, Owen
Hi everyone,I would be happy if somebody can give a thought to address the issue on automating FME. Presently, I am processing .csv files in FME to create some spatial data (points/lines). Problem is the .csv files are located inside Azure Blob storage containers along with several datasets. I am manually finding out the latest containers to download the csv file to local directory and then processing the same using FME workbenches. I have already added a AzureBlobStorage Container in FME and connection parameters successfully, but not getting a sense how to download all the csv files automatically from all containers and store it to a local or temp directory to process further. My Flow is --Creator > AzureBlobStorageConnector Additionally trying to find out any possible way to create a mail or other alert system, so that, whenever new data would be uploaded/downloaded/deleted to Azure, it will show up in fme.