Automation

Hi there,I have a number of FME Workflows on our GIS server that successfully run via scheduled tasks and bat file. However this latest one I have created only runs under my account and not the service account. The difference between this and other workflows is that this one is connecting to web services (Vicmap as a Service). I have made sure the service account has full permissions on any folders it is writing to as well the FME Programs folder. We are currently on FME Workbench 2022 but will soon be upgrading to the latest license structure.Do I need to consider any other permissions when dealing with web services? Regards,Josh

I am running an automation process that collects some data via a webhook ,does some processing then outputs some shapefiles. I am trying to extract the URL to the download zip that you get when you run the workspace outside the automation from a workspace app or just run on flow itself.The issues im having are:-When the workspace is run within the automation it does not create a zip file in the temp/engineresults like when you run from a workspace app-If i explicitly define temp/engineresults as the output location, it will write either a hardcoded zipfile name (not the autogenerated one) OR if i remove the .zip extension it writes each individual file - which i dont want-I am able to extract out the autogenerated URL from the logfile, however because of the bullet points above there is actually no file being created at that URLI've seen plenty of topics around this URL, but none of them seem to cover my situation, im basically asking what configuration do i need on my writer and then

So, I've created an server app that sometimes posts very large datasets and have so far been able to restrict access to the data by just emailing the dataset back as an attachment (user email as parameter)(its not super safe, but safe enough - the data isn't super sensitive but sensitive enough). I've thus been able to restrict the data to the person running the server app by letting the person enter their email and get the data back that way. But now the datasets is growing kinda fast and the email client isn't putting up with 20-50 megabytes of attachments. So I read that it was possible to get the server app to respond with the download link (again not super safe, but safe enough). So: how do I do that? What parameter carries the data download link from server apps? Or, it doesn't work that way? (in wich case I'd have to do a workaround, and nobody likes workarounds :-) Been searching and trying for several hours without luck. Tried the ServerNotifier and the

I have an ID field that is correctly read by FME as varchar(22) when writing using the Feature Writer.However, before that, I use the SchemaScanner, and it incorrectly detects the data type as fme_real64. As a result, the original value is eventually written in scientific notation, like 2.2072213393213062e+21, instead of preserving the original string format.Is there a way to ensure that SchemaScanner correctly detects the field as varchar(22) to prevent this issue? Any suggestions would be appreciated!  

I am doing proof-of-concept testing to create a FLOW APP to collect public input data (public survey).. It’s simple survey, just  a few questions. Everything seems working (I published workspace for ‘job submitter’.. but Is it possible tomodify the ‘Run’ button in the App? e.g. as ‘Submit’.2. disable the ‘Run Again’ after a run?After run complete, is it possible to return some text message? e.g. ‘Your inputs has been recorded. Thank you for your help!...” or a bit more advanced to return the summary of data input by user?Not sure if I am heading a wrong direction. Any help is appreciated. 

Hello Forum, Is is possible within FME Flow to post a dataset (e.g.: a geojson) to an API endpoint, or equivalent function. I would then pass the API details to an external partner, from where they would download the full geojson file. Thanks, 

Hi, every day I monitor hundreds of jobs on an instance of FME Flow. Whenever an error occurs, I look in the log file of that job to figure out what went wrong. Now the problem is that sometimes that log file is empty, or only consists of a few warnings. I found out that it is related to which log-filters was configured when the workspace was uploaded to FME Flow. Is there any way to change the global log-filters on FME Flow, to make sure every workspace uses the same filter? Best regards,Jacques

Hi, we are using an fme flow app do to some export jobs for us.When the job is done, a mail is sent tot he user. This is done by using the transformer “emailer” after FeatureWriter. The mail contains the link to download the data. To generatet he download link we have oriented ourselves here: https://community.safe.com/automation-13/download-urlfrom-server-app-11037 Our download link looks like: {FME Server Web URL}/fmedatadownload/results/{zip file name from FME_SERVER_DEST_DIR} But when I click on the link the message „Download Dataset Expired“ appears Can anyone help us?

Hello,I have an FME workflow that runs perfectly when executed with the FME GUI open, but it fails when launched via a Windows bash script.The error message generated is:SharepointOnlineConnector: Connection 'SharePoint0Online08safe.microsoft-sharepoint9' does not exist. Check connection parameter and connection definitions in FME options and try againIs the SharepointOnlineConnector connection only valid when the graphical interface is active? Do you know how to keep this connection active even when running the workspace from a script?Thank you in advance !

Before I get into the details I see there have been a couple of similar questions asked it the past, specificallyAs well as this idea What I’m wanting to be able to do is have a process, specifically one run with the Data Download Service, that has been run through a Workspace App to post to the DATADOWNLOAD_ASYNC_JOB_SUCCESS Topic. Effectively replicating the ‘Email Result To’ functionality of the Run Workspace interface. Now, I know how you could achieve this by modifying the workspace and include the email functionality there, but that means updating a significant number of workspaces, and ensuring that future workspaces are built with that functionality included. Does anyone have any ideas? Could an automation app be a solution (don’t have much experience with them)?

Greetings!I have a question, is it possible to utilize Microsoft 365 / Exchange Online shared mailboxes in IMAP/SMTP automations, in conjunction with OAuth? This question applies to System Email as well.All our research points towards no at the moment, so this might be an Idea post rather than a Question. At least within FME Flow 2024.1.3 (Build 24627) that we are currently running. Background:Exchange Online shared mailboxes cannot be interacted with directly. Their accounts are technically disabled, they have no valid logon credentials nor any mailbox licenses. Instead, you grant Send as and Full permission to other licensed accounts in Exchange Online, who act on behalf of the shared mailboxes.Therefore, in addition to the shared mailbox (fme@our-company.com) we intend to use for automations, we created a licensed service account (account@our-microsoft-tenant.com) that will act on behalf of the shared mailbox. The problem:Now, provided that all we have for Email automations is a sin

Hi, For user parameter Geometry in FME Form, you can configure what type of “selecting geometry” to allow under the GeoJSON Configuration > Geometry Types (Point, Box, Line, Polygon). But when I publish the workspace to FME Flow and set up the user parameters in Automations, the configuration for Geometry Types is missing for the Geometry User parameter.  For my example, I want only Point as a valid Geometry type for the Geometry user parameter. I publish the workspace to FME Flow with these settings and create an automation app with the same user parameters, but when I run the app the user can choose between all geometry types (Point, Box, Line, Polygon).

I built a workbench that creates 2 excel files with unique names that are created use the Fanout Dataset in the excel writers using a filename attribute that creates the unique file name. However, when I run workbench in FME Flow to set up the automation, it says it created it successfully, and the log seems to show that the files were created with the unique names, however, there are no files to open at all in the destination folder that I set up for it on FME Flow. Please help. Thank you! Pic of the fanout in the workbench. I have tried to add the log file to this post but it will not let me as the file type is “log” and for some reason the FME Forum system does not allow for those files to be uploaded.  

Problem Statement:I need to verify if all the workbenches in an automation for a particular run/trigger are successful. There can be multiple runs/triggers in a day, and the number of triggers per day is unknown. Things I Have Tried:When I attempt to retrieve relevant data from the FME Flow PostgreSQL database, I can't find a unique identifier for each run/trigger of an automation.I can see an event_id in web interface, but unable to find that in the postgres database.  

I want to create a workflow that downloads a file from the internet (SHP file compressed as ZIP file). That file should then be used in my workflow for further analysis and processing. How should I set that up? I now have a "Creator", followed by a 'HTTPCaller'. This HTTPCaller downloads my ZIP file (contains a SHP file). How can I now use this data for further processing? When I use a ESRI SHP File Reader, I can't seem to send this file as an input to that Reader?  

I am trying to upload a project to FME Flow using REST API V3. The curl command is blank in the documentation. I have tried to configure a command based on the documentation and other (working) commands, but I have not had much success. Does anyone have an example of a working command to upload a .fsproject file?

I am using FME Flow 2021.2.Is there a way to change the Directory Watch Poll Interval in an Automation to trigger only Monday through Friday, 8 a.m. to 5 p.m.? 

Hello, I am looking to use attribute value mapper ( or another transformer etc) to  map from multiple input attributes (VEG_SBOIS)  and (CLASSE) to a single output attribute (SURF_COVER) see below screenshots for example I have tried using a tester with  left value filled in and operator  “attribute has a value” but it doesnt work perfectly since im only looking to map certain input values (not all ) to different output values.  any help is appreciated,thanks,Curtis

I have a flow workspace app that simply takes a shapefile and converts it to a 2D grid, previously (most of 2024) this accepted a zip file of the shape components and worked fine. My user has been using this for months with no problem. Seemingly now it stopped accepting zip files and instead through trial and error i got it working ONLY selecting the .shp component from my PC. This seemed a bit weird as i know it needs more than this but it seemed to work.I've since downloaded the workspace, made a tiny adjustment to something unrelated to reading the shapefile, republished. This new version now will only work if you select both the .dbf and the .shp, the previous version still works with just the .shp.I've tried to trouble shoot, recreate the app, anything i can think of but i cant for the life of me explain this inconsistency im finding, has anyone had anything similar?

I understand that FME can only connect to GitLab not others like Microsoft TFS/GIT or its new name Azure DevOps (locally hosted). Is there a way as a work-around to have FME via Jenkins Pipeline be started from FME to connect to the local git repo pull the requested FME project file from GIT into FME for editing or executing?I searched but didn't find much on the 'Jenkins Pipeline' topic or GIT outside of GitLab.

Does anyone know how to add information about the features written to the Action Succeeded output port of the Run a Workspace-action?This is what I tried and where I got stuck:In my automations I like to send an email with information about the execution of the automation.In the email I added information like time started, time finished and a link to the job summary. I wanted to add information about the number of features written. I found this and that works just fine: https://support.safe.com/hc/en-us/articles/25407494315789-FME-Flow-Get-the-Count-of-Features-Written-in-an-AutomationBut now I have a problem: the email I send is connected to the Action Succeeded output port and the summary is on another output port.Is there a way to combine these two output ports? The "Merge" action did not allow me to do this.Of course I could just use the new Summary output-port instead of the Action Succeeded, because I think I can sort of assume that the action succeeded when features were written

import arcpyimport docxfrom datetime import datetimeimport osfrom docx.shared import Inches# Define the pathsinputfilename = r"Y:\GIS\FieldSummary_TEMPLATE.docx"outputfolder = r"Y:\GIS\GeneratedDocuments"sde = r'\\test\gis\ACCS_rw.sde'# Set the workspace to the SDE connectionarcpy.env.workspace = sde# Define the full feature class pathfeature_class = os.path.join(sde, 'FieldWork')# Define field mappingfield_mapping = { "<<PROJECT_NAME>>": "PROJECT_NAME", "<<FIELD_DATE>>": "FIELD_DATE", "<<ARCH_CREW>>": "ARCH_CREW", "<<PERMIT>>": "PERMIT", "<<DIVISION>>": "DIVISION", "<<METHOD>>": "METHOD", "<<DIST_EXIST>>": "DIST_EXIST", "<<DESCRIPTION>>": "DESCRIPTION", "<<DIST_REQ>>": "DIST_REQ", "<<HISTORY>>": "HISTORY", "<<SUB_OB>>": "SUB_OB", "<<ARCH_OB>>": "ARCH_OB", "<<REC>>": "REC"}# Define the feature

I have arcgis pro only on my pc. The FMEServer machine also has Pro only. I am able to successfully run a workbench that accesses .gdb's to read/write on my desktop and on the server desktop. However, when I publish to server and try to run from the repo or with an automation, I get the following error. Unable to connect to the File Geodatabase at 'XXXXXXX.gdb'. Make sure the correct filename was specified, and that the Geodatabase wasn't saved with a newer version of ArcGIS than the one installed locally. The error number from ArcObjects is: '-2147024893'. The error message from ArcObjects is: {} I have forced the workbench to translate as 'Pro' instead of auto. The Pro licence on server is authed correctly. FME desktop and server versions are 2022.1 and 2022.1 respectively and the .gdbs were created prior to these versions of FME being used so there is no issue there. I have also had this error at another workplace and it is driving me crazy.  Any po

Hello ,I would like to automate data extraction from FME Server using UiPath.Currently, I manually select each city from FME Server and extract an Excel file containing the required data for each city ,then i place the extracted Excel file in a specific folder for the UiPath to process and perform tasks using the data , UiPath reads the IDs from the Excel file for processing. I'm wondering if it's possible to establish a connection directly between UiPath and FME Server, perhaps using a REST API, to directly retrieve the data and work on it without manually downloading each Excel file. Is this possible, and how can it be implemented?Thank you in advance!

Using ArcGIS Enterprise 11.3 and FME Server, I am trying to create a Portal Organization Webhook. While I am able to ping the VM on Portal VM and also navigate to the webhook URL in Poral machine browser, I am getting this error Unable to create or update webhook. Non reachable URL : 'https://xxxxxxxx/fmerest/v3/automations/workflows/4c2cbc0e-3df1-4cbe-9154-b866fe5b6a09/2274b9f3-c600-2ead-a2bc-a20dab4d8db0/message' has been specified for the webhook with name or id 'Check_Item_Name'   Can someone please let me know what I am missing here