Automation

Hopefully someone can offer some advice on using ArcGIS Online hosted feature service webhooks and FME Flow. I have set up webhooks on a test hosted feature service, derived from a survey123 form. When implementing a webhook directly via Survey123, I successfully receive a response in the FME Flow log. However, when implementing a webhook on the feature service, there is no response in the log. I’ve done some checks using https://webhook.site/ and I can see that ArcGIS Online is sending data when using that URL, so it’s not a problem with the feature service webhook, but appears to be an issue with FME Flow. I should add, FME Flow is HTTPS enabled. All feature service settings look to be correct and I have default Admin rights on AGOL. Has anyone encountered a similar problem?

Hi guys, I have a doubt, I don’t know if such an option already exists or not, if it does, please guide me to the page. I need to make a notification system within the FME Server to send a live notification to a email if a job fails. Now there are number of methods to do this I believe, and I tried some of them but failed to achieve what I really require. What I need is a live notification system, i.e., it must notify me as soon the job fails. Now this notification message must contain time, workspace name, repository name, and the error message in a clean manner, like for example “Workspace Name : work.fmw”. Here the workspace name and repository name must be there without any fail, the other details I can compromise, but these two information is a must. Now, this notification system must not depend on a workspace, because I know i can create a notification system using FME Flow Notifier within a workspace. But I want the system to be independent of a workspace as it requires the work

Hi, We encountered a strange problem regarding python environment when running multiple jobs via jobsubmitters on FME Flow. We recently updated from FME Server 2022 to FME Flow 2024.2.3Build 24825 which is when the automation stopped working. The automation triggers a sequence of master workspaces, which then runs multiple child workspaces. The first master workspace contains a creator, pythonCaller and 2 FMEFlowJobSubmitters in sequence. The rest of the workspace is not important, as the problem is with these first transformers. When running the master workspace, the Flow engine is loaded with python 3.12+ and runs the first pytonCaller and first FMEFlowJobSubmitter without a problem. However, when running the second FMEJobSubmitter, the following error is given: “FME Engine encountered a Python issue. Workspace requiring Python 2.7 is requested to run on an FME Engine configured to use a Python 3.12+ interpreter. FME cannot continue given the Python version mismatch” However, all mas

Hi, We are creating an FME Flow Automation App to help our land surveyors importing their data. Is there a way to send a message to the FME Flow Automation App interface if an action fails? We are currently using FME Flow 2023.2.2.

I have managed to use The Directory and File Pathnames reader, Attribute Manager and File Copy Writer to copy a file from one location to another. How would I be able to copy that same file into multiple subfolders of a single parent folder? I used this method so far.

I’m trying to set up an automation with a merge process similar to what is described here Getting Started with the Split-Merge Block – FME Support Center However, when I try to add in a Merge action to the Failure port I get the following error message Has anyone encountered this? I’m using the Merge Tool with a Failure Port so I’m not sure why it’s complaining FME 2024.1 Build 24612

I have a routine that extracts property boundaries from a web service and outputs to shp to be imported into our Property and Rating system. I do have a Geometry Validation process to repair geometries where they may self intersect or are corrupted, however there are two polygons that are not repairing, even though they pass the test. Both are like the below. The polygon doesn’t actually cross over itself. Rather, this is two separate vertices where the bottom section meets the top section, and it’s all one polygon. Is there a way to automatically fix these with FME as we can’t edit the original. My workaround is to have the tiniest buffer and dissolve so the vertices don’t touch which passes the validation test in our P&R import, but ideally we should have clean geometries. Any help appreciated. Regards, Josh

Hi there, I have a number of FME Workflows on our GIS server that successfully run via scheduled tasks and bat file. However this latest one I have created only runs under my account and not the service account. The difference between this and other workflows is that this one is connecting to web services (Vicmap as a Service). I have made sure the service account has full permissions on any folders it is writing to as well the FME Programs folder. We are currently on FME Workbench 2022 but will soon be upgrading to the latest license structure. Do I need to consider any other permissions when dealing with web services? Regards, Josh

I am running an automation process that collects some data via a webhook ,does some processing then outputs some shapefiles. I am trying to extract the URL to the download zip that you get when you run the workspace outside the automation from a workspace app or just run on flow itself. The issues im having are: -When the workspace is run within the automation it does not create a zip file in the temp/engineresults like when you run from a workspace app -If i explicitly define temp/engineresults as the output location, it will write either a hardcoded zipfile name (not the autogenerated one) OR if i remove the .zip extension it writes each individual file - which i dont want -I am able to extract out the autogenerated URL from the logfile, however because of the bullet points above there is actually no file being created at that URL I've seen plenty of topics around this URL, but none of them seem to cover my situation, im basically asking what configuration do i need on my writer and

So, I've created an server app that sometimes posts very large datasets and have so far been able to restrict access to the data by just emailing the dataset back as an attachment (user email as parameter) (its not super safe, but safe enough - the data isn't super sensitive but sensitive enough). I've thus been able to restrict the data to the person running the server app by letting the person enter their email and get the data back that way. But now the datasets is growing kinda fast and the email client isn't putting up with 20-50 megabytes of attachments. So I read that it was possible to get the server app to respond with the download link (again not super safe, but safe enough). So: how do I do that? What parameter carries the data download link from server apps? Or, it doesn't work that way? (in wich case I'd have to do a workaround, and nobody likes workarounds :-) Been searching and trying for several hours without luck. Tried the ServerNotifier and the emailer and both are s

I have an ID field that is correctly read by FME as varchar(22) when writing using the Feature Writer. However, before that, I use the SchemaScanner, and it incorrectly detects the data type as fme_real64. As a result, the original value is eventually written in scientific notation, like 2.2072213393213062e+21, instead of preserving the original string format. Is there a way to ensure that SchemaScanner correctly detects the field as varchar(22) to prevent this issue? Any suggestions would be appreciated!

I am doing proof-of-concept testing to create a FLOW APP to collect public input data (public survey).. It’s simple survey, just a few questions. Everything seems working (I published workspace for ‘job submitter’.. but Is it possible to modify the ‘Run’ button in the App? e.g. as ‘Submit’. 2. disable the ‘Run Again’ after a run? After run complete, is it possible to return some text message? e.g. ‘Your inputs has been recorded. Thank you for your help!...” or a bit more advanced to return the summary of data input by user? Not sure if I am heading a wrong direction. Any help is appreciated.

I want a workspace to run on FME Flow at 11pm with a user initiating it at some point within the working day. Currently thinking of having the workspace run within an automation, which is scheduled to run daily at 11pm. User would enable the automation, workspace would run at 11pm and then trigger a second workspace which makes a http call to stop the automation. So the workspace is only run once and won’t run again until the process is repeated. Any ideas of a better way to do this?

Hello Forum, Is is possible within FME Flow to post a dataset (e.g.: a geojson) to an API endpoint, or equivalent function. I would then pass the API details to an external partner, from where they would download the full geojson file. Thanks,

Hi, every day I monitor hundreds of jobs on an instance of FME Flow. Whenever an error occurs, I look in the log file of that job to figure out what went wrong. Now the problem is that sometimes that log file is empty, or only consists of a few warnings. I found out that it is related to which log-filters was configured when the workspace was uploaded to FME Flow. Is there any way to change the global log-filters on FME Flow, to make sure every workspace uses the same filter? Best regards, Jacques

Hi, we are using an fme flow app do to some export jobs for us. When the job is done, a mail is sent tot he user. This is done by using the transformer “emailer” after FeatureWriter. The mail contains the link to download the data. To generatet he download link we have oriented ourselves here: https://community.safe.com/automation-13/download-urlfrom-server-app-11037 Our download link looks like: {FME Server Web URL}/fmedatadownload/results/{zip file name from FME_SERVER_DEST_DIR} But when I click on the link the message „Download Dataset Expired“ appears Can anyone help us?

Hello, I have an FME workflow that runs perfectly when executed with the FME GUI open, but it fails when launched via a Windows bash script. The error message generated is: SharepointOnlineConnector: Connection 'SharePoint0Online08safe.microsoft-sharepoint9' does not exist. Check connection parameter and connection definitions in FME options and try again Is the SharepointOnlineConnector connection only valid when the graphical interface is active? Do you know how to keep this connection active even when running the workspace from a script? Thank you in advance !

Before I get into the details I see there have been a couple of similar questions asked it the past, specifically As well as this idea What I’m wanting to be able to do is have a process, specifically one run with the Data Download Service, that has been run through a Workspace App to post to the DATADOWNLOAD_ASYNC_JOB_SUCCESS Topic. Effectively replicating the ‘Email Result To’ functionality of the Run Workspace interface. Now, I know how you could achieve this by modifying the workspace and include the email functionality there, but that means updating a significant number of workspaces, and ensuring that future workspaces are built with that functionality included. Does anyone have any ideas? Could an automation app be a solution (don’t have much experience with them)?

Greetings! I have a question, is it possible to utilize Microsoft 365 / Exchange Online shared mailboxes in IMAP/SMTP automations, in conjunction with OAuth? This question applies to System Email as well. All our research points towards no at the moment, so this might be an Idea post rather than a Question. At least within FME Flow 2024.1.3 (Build 24627) that we are currently running. Background:Exchange Online shared mailboxes cannot be interacted with directly. Their accounts are technically disabled, they have no valid logon credentials nor any mailbox licenses. Instead, you grant Send as and Full permission to other licensed accounts in Exchange Online, who act on behalf of the shared mailboxes. Therefore, in addition to the shared mailbox (fme@our-company.com) we intend to use for automations, we created a licensed service account (account@our-microsoft-tenant.com) that will act on behalf of the shared mailbox. The problem:Now, provided that all we have for Email automations is a

Hi, For user parameter Geometry in FME Form, you can configure what type of “selecting geometry” to allow under the GeoJSON Configuration > Geometry Types (Point, Box, Line, Polygon). But when I publish the workspace to FME Flow and set up the user parameters in Automations, the configuration for Geometry Types is missing for the Geometry User parameter. For my example, I want only Point as a valid Geometry type for the Geometry user parameter. I publish the workspace to FME Flow with these settings and create an automation app with the same user parameters, but when I run the app the user can choose between all geometry types (Point, Box, Line, Polygon).

If there is an automation where a workspace with an automations writer, triggers a child workspace a number of times is it possible to restrict those jobs to run on the same engine without the use of a queue? I want all child jobs triggered from the writer to run on the same engine as each other for a single automation run, but i don’t necessarily want to say that jobs can only be run on a single engine, as would be the case if I set up a queue.

I built a workbench that creates 2 excel files with unique names that are created use the Fanout Dataset in the excel writers using a filename attribute that creates the unique file name. However, when I run workbench in FME Flow to set up the automation, it says it created it successfully, and the log seems to show that the files were created with the unique names, however, there are no files to open at all in the destination folder that I set up for it on FME Flow. Please help. Thank you! Pic of the fanout in the workbench. I have tried to add the log file to this post but it will not let me as the file type is “log” and for some reason the FME Forum system does not allow for those files to be uploaded.

Problem Statement: I need to verify if all the workbenches in an automation for a particular run/trigger are successful. There can be multiple runs/triggers in a day, and the number of triggers per day is unknown. Things I Have Tried: When I attempt to retrieve relevant data from the FME Flow PostgreSQL database, I can't find a unique identifier for each run/trigger of an automation. I can see an event_id in web interface, but unable to find that in the postgres database.

I want to create a workflow that downloads a file from the internet (SHP file compressed as ZIP file). That file should then be used in my workflow for further analysis and processing. How should I set that up? I now have a "Creator", followed by a 'HTTPCaller'. This HTTPCaller downloads my ZIP file (contains a SHP file). How can I now use this data for further processing? When I use a ESRI SHP File Reader, I can't seem to send this file as an input to that Reader?

I am trying to upload a project to FME Flow using REST API V3. The curl command is blank in the documentation. I have tried to configure a command based on the documentation and other (working) commands, but I have not had much success. Does anyone have an example of a working command to upload a .fsproject file?