Automation

Hi All, I want to extract detailed log messages from FME job running on FME Flow (Ver 2021.2.3). What options are available to extract this information along with basic job information like Workspace, Repository, user, source, start and end time. etc. Appreciate any feedback. Jay    

I am trying to create an automation using a trigger that watches a directory. If a file in the directory is added/created it launches an FME Workspace. However I keep getting the following error:2024-12-14T20:10:08Z | 410109 : (Automations) Creating link from trigger...3 2024-12-14T20:10:08Z | 410108 : (Automations) Creating dirwatch trigger...4 2024-12-14T20:10:08Z | 410112 : (Automations) Unable to assemble automation. There was an issue with component "Trigger". Publisher dirwatch does not exist.The same thing happens when I try add a trigger that watches an FTP? and I get the same error when trying to add a Publication under the Notification.What am I missing? Do I need to add something special for a trigger to work? is it possible that I am missing some part of FME?I am working with a FME FLOW 2024.1that is in a Azure Kubernetes cluster.Any help or hint that could explain the error is highly appreciated.

Hi everyone,I’ve created a python script that has the docx library and arcpy library imported in it that takes field values from a GIS feature class and writes it to a docx document successfully. I would like to trigger the python script to run every time that feature class in an enterprise geodatabase is updated.I am working in the 11.3 Enterprise Environment and have come across this support page regarding implementing webhooks and FMEhttps://support.safe.com/hc/en-us/articles/25407414850061-Integrating-ArcGIS-Enterprise-Feature-Service-Webhooks-With-FMEI will attempt to do the above, but I have a simple question regarding the FME workspace itself.I have read up on the PythonCreator and PythonCaller transformers, with the PythonCreator not requiring an inpput. If all I want is an update to the GIS feature class to trigger the python script to run, would the FME workspace just have a PythonCreator with the python script in it and a logger? Or would it be more beneficial to have a Crea

I have a process that writes a number of graphs to a folder on the network.  It works great in FME Form.  If I attempt to publish this workspace to FME Flow as a Job Submitter it doesn’t write the files to the folder at all like the same file does at the desktop level.  The output path is set up in an RCaller so there isn’t a Writer in the .fmw script like normal.  There are zero errors on the desktop side, and I have made sure the FME Flow portion no R packages are causing errors.  When I run this process, I receive zero errors in Flow, but none of the files write to the directory.  The end process would be that a person could upload a number of spreadsheets run this process from a webpage (Flow) and the output would show up in their department’s folder.  I read in the community about it possibly writing to another directory and I attempted to check that out without success.  Any help or guidance would be appreciated.  

I tried to find an alternative transformer for the system caller to do the pg_dump, but even that did not work out.

Hi,When I run a workspace via an App I get the following error:Microsoft Azure SQL Database Non-Spatial Writer: A suitable Microsoft SQL Server OLE Driver is not found. Install Microsoft OLE DB Driver for SQL Server from http://www.microsoft.com/en-ca/download/details.aspx?id=56730 I can see from earlier on in the logs that it failed to connect :Microsoft Azure SQL Database Non-Spatial Writer: Failed to connect using Microsoft OLE DB Driver 19 for SQL Server. Provider error ''. When I run the same workspace from “Run workspace” it connects and runs fine:Microsoft Azure SQL Database Non-Spatial Writer: Trying to connect using Microsoft OLE DB Driver 19 for SQL Server…Microsoft Azure SQL Database Non-Spatial Writer: Starting execution of BEGIN_SQL commands I tried deleting the app and creating it again but that didn’t seem to work. TIA

I am sure that there is a solution within fme flow automation, but meanwhile I am pulling my hair for not finding it…The scenario:Through a directory watcher triggered automation, I import the content of a variety of geopackage files into postgis tables with corresponding names. This part runs well.For some of these tables, I have ElasticSearch indices, which have to be rebuilt after table import. For the indexing, I have a repo on the flow server named Elastic-Indexer, and therein are workspaces with names corresponding to some of the tables. (n.b. not all tables have corresponding indexer workspaces)Now I try to build up a dynamic system that gets notified with the schema.tablename after import and runs - if it exists - a workspace with a matching name from the Elastic-Indexer repository. My first idea was to read the workspace names from that repository and call the workspace if the name matches, but a) I was not able to read the workspace names and b) this solution looks clunky whe

Hello :) I have some workbenches on the FME Server 2022 and I get for all of them the error:2024-12-11 13:37:46 | java.sql.SQLException: Query failed (#20241211_123746_28965_mxxee): Unknown transaction ID: f6d2afb3-c2fa-4417-970c-375bf47d1c9f. Possibly expired? Commands ignored until end of transaction blockIs that something I can fix or is it a Server error that only admins can fix? It is some time ago I was running the workbench. I tested one on my Laptop for a small country and it went good. all other countries are too big that is why I choose the FME Server. Any suggestions of what I can do?Vanessa

We are running into issues with the user parameter file inputs for Automation Apps.  In this case our end user wants to upload a new csv file every time they run the automation app, and they want to upload it from their local computer/machine.  Right now the only way to accept this user input is to have the csv file uploaded to a data store in FME Server, prior to selecting it as a user parameter, and then running the automation app.  We noticed that this problem doesn't happen for workspace applications and they can upload local files directly as the end user, with no need to upload it to the data store in fme server prior.  Is it possible to have our end user run an automation app and upload the user parameter directly from their local machine?

I have a flow automation runs every 5 minutes, and will send out a notification email if a job failed. That becomes an issue if a problem that caused the job to fail hasn’t been resolved soon since the automation will continue to send out error email every 5 minutes.Is there any way to stop sending email after e.g. 10 emails or to reduce the frequency for sending error emails? I still want the automation to run every 5 minutes, even some job failed, but want to get just reasonable amount of error emails. 

Hello everyone-Hoping that someone may be able to help with this question!Is there a way to provide a specific required JSON Response body (for example:  {“status”:”OPERATION_OK}  ) to a 3rd party application in response to a successful post to an FME Flow Automation with a Webhook trigger? I feel like I’m missing something obvious here….Any help would be greatly appreciated!Mike

I have looked at this: https://knowledge.safe.com/articles/678/create-a-custom-download-link-for-results-from-dat.htmlI want to be able to set the exact-filename of the zip-file within FME Workbench for the download service. Si instead of the URL like this: http://fmeserver/fmedatadownload/FME_2D764B0C_1515155526785_73956.zipI want to be able to define a parameter in a workspace called:ZIPFILENAME = myfilename.zipSo the Datadownloadservice serves the file:http://fmeserver/fmedatadownload/myfilename.zipIn other workspaces I will have completely different zip-filenames.Any way to do this? I manage to create all the data within the correct file and use the filecopy to copy the file to the correct place (within fmedatadownload/) but I can not persuade the fME Datadownloadservice to use that zipfile and not create a random-zipfile.

Hi there,Successfully created an FME Flow Automation App (2023.1.1.1) that allows the user to upload files. However the customer doesn’t like the fact that the + Enter URL/Path link is shown.Where are the webpages stored on FME Flow? Can the html be modified to hide this link?

Hi all, We currently use imap to connect to office365. The FME Imap process currrently uses basic auth which will be disabled my Microsoft in October this year.  I understand that imap with Office365 will still work, but only with modern auth OAuth2. Does anyone have any experience with how to enable Oauth2 for FME IMAP, and can run thorugh how to do this. Thanks,

Hi everybody! How can I fix the HTTP run time error? We have Publication that monitors and email Inbox.  A service request on Cityworks is created when an email is received with a GIFF attachment. SR created should have the GIFF attachment but it randomly fails to attach the GIFF for some SRs. And gives HTTP time out error. I have checked the API calls and they look good in Postman. I checked with my network team as well, no issue on that side either. The log file indicates that it is 401 error- but Authentication is also intact as other SRs gets created successfully with GIFF attached. Please see the image below for errors. Any insights is highly appreciated. Thank you!  

Hi everyone,I am having an Issue which is hard to provoke (because it dies not happen always) and our FME support is also not getting further.We are experiencing in FME Form und Flow Version 1.2.1 in Test and Production Environment that the Workspaces with Esri Writer (after our own analysis) are failing. Also after our analysis I changed the option from persistent connection from no to yes and also installed ArcGIS Pro 3.3.2 only on test Environment.On Test Environment I have Oracle 19.24 and on Productive 19.21. with Spatial Addon and when it occurs both are sending an exception (ORA-24550: signal received: Unhandled exception: Code=c0000005 Flags=0) and FMEEngine.exe and Form exe is shutting down with Kernel Failure (windows server 2022 VM).Talked with Windows server Team - they are saying it is FME Issue caused.Talked with DB Admins - they are saying it is FME Application Issue.Talked with FME Support - they are saying it is Oracle.So hopefully someone has an Idea and can give me a

We have recently upgraded FME flow to the latest 2023.2.2. I am having difficulty locating runtime errors for the job because when you click these runtime errors it will take you to the logs section where you have multiple logs. It's difficult to find which log file has this error. Previous versions directly took you to the error description while this version is not. Please guide me if I am doing anything wrong.Thank you, 

I have workspaces that are run from a job submitter in an automation. Is there away to kick off another workspace if it fails? I want to send an SQS message back to our SQS Queue with success or failure messaging. The successful message is easy but I can’t figure out how to send a failure message unless it fails though a specific transformer. 

HiIn our recent webinar about streamlining metadata automation we got a survey question which showed I didn’t make the functionality clear:“I am not seeing how this will help.  We have over 500 different layers, the bulk example showed over a hundred layers being updated but they were all the exact same layer, which is a situation in my opinion that doesn't exist for most people.”My demo indeed showed 145 portal items of the same type having their metadata updated according to some admittedly bogus business rules.  I failed to make the point that any number of any item type could be handled.  For example if contact detail changes meant a phone number or email contact needed to be changed you might search all items for the string to replace, or if you knew only shared items of a particular type needed license terms changed then operate on only those.Sorry for the confusion. 

I’m new to FME tool and I wanted to pull data from Google BigQuery tables and convert into GeoDatabase and shapefile. I'm using FME Workbench version 2024.1.1 and I'm experiencing an issue with using Google BigQuery as a reader. But I’ve installed Google BigQuery as a transformer and attempted to pull data, but no data is being retrieved. I’ve also authenticated using a service account key file, but the data still isn’t showing up.

I have an Automation on FME Server, which runs a workbench and that workbench runs a SystemCaller which runs a python script.Occasionally, the python script fails to run, and I want this failure to be recognised by the Automation, so that it sends me an email stating that it has failed.How do I do this?I can see how to set up the SystemCaller so that the Output Exit Code Attribute has a value of nonzero (representing failure)But how does this trigger the workbench to fail inside the Automation?I need the Automation to recognise the failure event so that it can generate an email stating that.

Hello,I have a question on the automatic rotation of 3D objects with FME. First I placed my 3D object on different points with the workflow explained in the following tutorial: https://support.safe.com/hc/en-us/articles/25407425765133-Creating-and-Using-Geometry-Instances. Now I want to rotate the 3D objetcs (electric poles railway) in the direction of a 2D Polyline (rail axis). Is there a possibility to rotate the 3D poles rectangular to the rail axis? Best regardsEric

I am on FME Server 2022.2.8, and I have a quite big automation where the workspaces communicate through json messages. Now I have been able to replicate a crash in too machines, but I haven’t been able to isolate the exact problems. I think it might be related to https://support.safe.com/hc/en-us/articles/25407442818189-Known-Issue-FME-Server-Core-java-lang-OutOfMemoryError-Java-heap-spaceIf I start processing that involves some 100 workspaces queued and running with quite long json messages the rest api stops responding eventually (about 30 minutes in, returning 500 errors). Processing seems to continue and automation is running fine, the Server ui seems ok (I think it is relying on REST API v4).Restarting the FME (or the server) does not help the problem, but cleaning up rows in the fme_job_history table seems to help.I have worked around the problem by re-architecting the Automation to make the messages smaller, so we are in the clear now.Just if anyone else have similar problems!

 In a experimental environment I have set FME server in a machine with ArcGIS Pro. (I want to verify some expected behaviors in FME Server, with out the trouble to install ArcGIS Server)It has ArcGIS Pro 3.1.3, As the document https://support.safe.com/hc/en-us/articles/25407724093837-Notes-on-FME-and-Esri-Versions-and-Compatibility states: When I try to run the workspace, it fails, and do not even creates a log file. In the fmeprocessmonitorinengine.log I find this: Wed-13-Nov-2024 03:44:01.898 PM INFORM Thread-19972 ALGTRCPIMSDM01_Engine1 Translation Finished (service '7070'). Return message is '370430:The workspace has Python Compatibility set to 'Esri ArcGIS Python 3.7+', which requires an appropriate version of ArcGIS Pro or ArcGIS Server. If ArcGIS is not required by this workspace, then update Python Compatibility to a non-Esri-ArcGIS Python. Otherwise, please install the required ArcGIS product. Please visit https://community.safe.com/s/article/notes-on-fme-and-esri-vers

Hi,I am trying to trigger an action on FME Flow when a new file geodatabase is added to my network. So I set up a Network or Resource directory trigger to monitor for CREATE events, but when I test it it fires once for each of the files contained in my geodatabase, or about 70 times.Ultimately I want to receive the path to the geodatabase in the File Path automation attribute, in just one trigger. Any suggestions are appreciated, thanks.