A space to discuss FME Flow
Recently active
I'm running FME Server in AWS using Aurora PostgreSQL Serverless for the FME Server Database and I check the health of the server by calling the fmerest/v3/healthcheck?textResponse=true&ready=true REST API periodically. Everything runs ok for 24hrs but after that, the health checks start to fail and do not recover again. From the errors logged (below), I think it might be a connection pooling issue. I don't get the same issues on an Express install and there's a line on https://aws.amazon.com/blogs/database/best-practices-for-working-with-amazon-aurora-serverless/ that says "Aurora Serverless closes connections that are older than 24 hours. Make sure that your connection pool refreshes connections frequently.", so I think this might be the cause. I've copied some errors from the logs (can provide full logs if required), am I right in thinking this is caused by Aurora Serverless killing the connections or is this something else? Is there a setting anywhere that will force FME to ref
Hi together, I am working with the SharepointOnlineConnector and was successfully downloading the file to any local directory. However, when trying to download the file from SharePoint to the FME sharedresources temp folder, it doesn't seem to work: When running the workspace on FME Server, it rejects everything Do you know by chance what I am missing here? ThanksFerid
Hi,I'm having an issue using FeatureWriters on FME Server (22350). What I'm trying to do is create a File Geodatabase with a feature writer, then later in the same workspace remove selected features from feature classes in the File Geodatabase that has been created.This works in desktop and as a fmejobsubmitter serivce, but when using the fmedatadownload service the second feature writer throws an error that the featureclass/database does not exist. I assume this is related to how FME Server adjusts the paths for data being created for the data download ZIP file? Both FeatureWriters are linked to the same parameter for the output FGDB.I have tested using a FeatureReader with the same parameter for the FGDB, and it successfully reads from the created FGDB. Is there some parameter or configuration I can use to ensure that both FeatureWriters are using the same path for the FGDB? (I've tried the FME_SHAREDRESOURCE_TEMP but that didn't help). I've attached a simplified
Notes on FME and Esri Versions, doesn't mention ArcGIS Pro 3.0, which is being released soon.https://community.safe.com/s/article/notes-on-fme-and-esri-versions-and-compatibilityCould you advise if 3.0 is support by 2022 and if not when this combability might be implemented?
Basically, I have a workbench that produces a CSV that I want to use in other workbenches and get a result. But There doesn't seem to be a trigger that works for me in this idea. Here is how the automation would look: How can I trigger an automation from the result of the first workbench?How can I transfer the resulting dataset into the automation after the trigger? Thank you,Kevin
Hi, I am trying to set up server 2022 with the load balancer. I have 2 core servers working with shared storage and database. I have a load balancer configured to handle ports 443 and 7070 for engine registration. In our architecture we will not have engines running on the core servers, we will deploy engines on dedicated machines and they will use load balancer URL to connect to the core. When I try to start the engine with FMESERVERHOSTNAME = loadblancer I get the following error. FME 2022.0.1.1 (20220617 - Build 22350 - linux-x64) FME Engine (node locked-crc) Machine host name is: 77286cef6ed1 Operating System: Ubuntu 20.04.4 LTS (Focal Fossa) Copyright (c) 1994 - 2022, Safe Software Inc. Safe Software Inc. INFORM: FME_SHARED_RESOURCE_DIR is unsetINFORM: FME_SHARED_RESOURCE_DIR has been changed and is now '/data/fmeserverdata/resources/engine'FME_INSTANCE_NAME 77286cef6ed1Registering with FME Server on host 'fm
Hello,I am using rest api url = f'{SERVER_URL}/fmerest/v3/transformations/transact/{REPOSITORY}/{WORKSPACE}?longPoll=true' but does not get back resultDatasetDownloadUrl in result class. What went wrong? Regards Gerhard
Hi all,I'm looking for a specific FME version: FME(R) 2019.2.3.1 (20200212 - Build 19823 - WIN64) I'm not able to find it in the past versions section: https://www.safe.com/support/downloads/#past-versions Is it still available somewhere?Thanks
Hi there, I'm having some trouble getting an email trigger to work inside an Automation, which is accessing a Shared Mailbox. I am able to authenticate using my email address/password combination via the same IMAP server details, so can rule out the connection between FME Server and the mail server. When accessing a shared mailbox, what are the correct credentials to use in an IMAP trigger? Typically that mailbox will be shared to users, and not have it's own dedicated password. That makes me think that one of the FME Server System Services is the account which is authenticating with the mailbox, and to use the email account with no password populated inside of the trigger. Is this the case? And which system service would be authenticating with the mailbox? When following this action, I get an error saying 'Invalid Credentials'. Am I right in thinking that one of the system services is acting as the authenticated user to the shared mailbox? Any help would be much appr
Changed some old workbenchs from Py 2.7 to Py 3x. Republished and getting this warning: 2022-6-22 13:02:23 | Python: There is a known Windows bug that may cause instability when using Python in the current locale. Please update to Windows 10 version 2004 and greater, or to Windows Server 2022
I am working to develop metrics for my workbench that run on FME Server. I use batch script to do some metrics with FME Server API. I am wondering if is it possible to monitor topic as we can do on FME Server (Topic Monitoring) with the FME Server API. I would like to test if my workbench send topics successfully.
Does anyone has a good example for this script? I copied the script from here and filled out some of the parameters. Not a coder. Hope someone can help me out https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Desktop/Workbench/Startup_and_Shutdown_Python_Scripts.htm import smtplibfrom email.MIMEMultipart import MIMEMultipartfrom email.MIMEBase import MIMEBasefrom email.MIMEText import MIMETextfrom email.Utils import COMMASPACE, formatdatefrom email import Encodersimport osimport fme# FME variables.status = fme.statuserrorMsg = fme.failureMessagelogFile = fme.logFileName # E-mail message values.subject = "FME Translation FAILURE"to = "receiver@domain.com"sender = "Your FME script <sender@domain.com>"text = "FME translation failed with error message: " + errorMsg + "\r\n\r\nSee attached logfile for details." # Credentials.AUTHREQUIRED = 0username = "smtp.user@domain.com"password = "smtppassword"smtpServer = "smtp.server.com" # Create and return a message with a logfile a
I have created an encoded password user parameter and used it with the job submitter, but if the job submitter returns an error, the password is decrypted and shown in the log, as seen in the screenshots below.
Hello,I'm trying to rebuild FME server automatically. I take back up of the server (.fsconfig file) and use this when ever I try to recreate the server automatically using python script. But, I found that the fsconfig does not store the number dynamic engines which were configured previously. So, whenever I recreate server the dynamic engine has default value 0. Is there any way to change this number automatically without manually changing this figure ? Thanks
Hello, I successfully imported AD in FME server and I cannot log into FME Server afterwards with these users. Error from Log:(Directory Server) Exception: "LDAPException(resultCode=82 (local error), errorMessage='An error occurred while attempting to initialize the JAAS login context for GSSAPI authentication: LoginException(null (68)), ldapSDKVersion=4.0.14, revision=c0fb784eebf9d3.... Any ideas? Thank you Nicu
Hi altruist, I am looking for an solution.I have a road name list in three different feature type (two in shape files, one in excel). I have brought them together after editing schema to get a unique list of names. Now I want an automated way to validate a new name whether this is a new name or existing in the list. Can anyone kindly tell the ways of working around? Thanks in advance. attached image: my workspace so far
Hello everyone, I'm using the paramiko and scp python libraries in a pythoncaller to transfer files from my local environment to a remote Linux server. When testing locally I received an import error which I could solve by removing all contents of C:\\Users\\<user>\\Documents\\FME\\Plugins\\Python and reinstalling paramiko and scp. However, when I transferred the contents to the Plugin folder on my FME Server instance, managed by FME Cloud, I received the same import error I previously received on FME Desktop even though the Plugin folder on FME Server was empty to start with. The import error I receive is formatted like this: Python Exception <ImportError>: cannot import name '_bycript' from partially initialized module 'bcrypt' (most likely due to a circular import) (/data/fmeserver/resources/engine/Plugins/Python/bcrypt). The following python code is the source of the import error:import paramikofrom scp import SCPClient I noticed that the importerro
Hi,I have a FME workbench, so i have to use it within my organization and i want to restrict it to outsiders based on domain name or in any possible way. how can i do this ?
I have survey records being written to a database using a work bench. Along the way there is a transformer that checks for null values, if they exist currently the records are wrote to a .csv file to be checked. I would like to send an email to the surveyor so they can edit and resend their records for writing to the database. Currently I have a HTML Report Generator set up for a table of records that have null values. I had tried to use the Attribute File Writer to isolate the surveyor name and then use the html content in the email body. This doesn't seem to work and was hoping someone has a workflow. Basically the Emailer 'To' is conditional based on the survey record submitted and then I would like the email to contain the survey record with null value. Thanks in advance!,Kathy
Hi folks, My FME workspace reads data from Azure Blob Storage. I'd like to run it in FME Cloud, but the account/password credentials do not get published to the server.I am able to replace the SourceDataset user parameter with a custom string containing embedded credentials ("fme://safe.azurestorage....") then run the workspace successfully, but this solution has some maintenance issues (not scalable, and would need to be applied to every workspace). I was hoping that I could create a Web Connection for Azure Blob Storage in FME Cloud, but it looks like I can only create an S3 bucket web resource: I also cannot add a new web connection: Can anyone help solve this issue? Thanks.
We have a large number of JPG images that cover the same area (flown with a drone in a criss-cross pattern). We need to split the set of images into smaller, workable groups. The idea is to, if possible, create an area of 2 rows by 2 columns that cover the same area where the images were taken. If an image falls within one of the four quadrants, it should be moved to a specific folder that representsthat quadrant. That way we can correctly subdivide the set of images into four, more manageable blocks. The 2DGridAccumulator seems to be able to setup a grid, but is there now a way to compare each image to each cell of such a generated grid and then move that image to a folder as explained above? As the drone flew in a criss-cross pattern, the date modified for each file cannot be used to determine in what block it should be placed (ie by just using Windows File Explorer to categorise the images). Apologies if there is a straight forward solution for this which I could not find.
Is it possible to use multiple CRON triggers in the same Automation, also while "passing" values from one workspace block to another using values from an embedded Automations writer? Essentially I would like to set up a single Automation that triggers at a given time, completes a number of steps, and then "waits" for a second CRON trigger to continue with additional steps, and with the additional steps part of the routine using a value from an upstream block.
I've written an FME Server app that uses the ZipExtrator transformer. I've set the Source Zip File as a user parameter so when it is run, the user is prompted to select the file they want to upload. Once the user has selected their file and kicked off the file upload, I've noticed that when the file upload progress bar has reached 100%, the upload process hasn't actually finshed. If I inspect the network traffic in the browser dev tools, the HTTP request for the file upload process does not complete until several seconds after the file upload progress bar shows 100%. If the user clicks OK before the HTTP request has finished, then the job fails. If the user waits until the HTTP request has finished then click OK, the job runs successfully. Has anyone else seen this behaviour? I've upvoted this idea which is similar to this, but this seems to me like a bug and not an enhancement. I'm running FME Desktop 2021.2 and FME Server 2021.2.
If i want to run apps from galery, system send me Repository "xxxxxxxx" doesn't exist or you do not have permission to Read or Run from itBut permissions on repository "xxxxxxxx" is OK - Run and Read.This problem started after i tested changes in permissions on this repositories. Versions: FME Server 2022.0.0.2 Build 22343 - win64 Thank you for your advices
Hi. Im having no luck connect to sql express db. Can FME connect to SQL Express? If so, should I be using the ADO or JDBC reader? Also, is there anything else that could be an issue? Ive put the server and instance name in and port 1433 is open. Thanks