- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow
Automation

Automation

Schedules, triggers, events, alerts, and notifications.

712 Posts
2,390 Replies

When you subscribe we will email you when there is a new topic in this category

712 Posts

Recently active

Most replies Most views Newest first

sunsilk11Contributor

asked in Automation

Error running JobHistoryStatisticsGathering

Hi I am getting error message below when running JobHistoryStatisticsGathering in FME Flow. I am using FME Flow 2021If I download the workspace and run it in FME Form, it works OK.Any ideas? 2024-4-26 15:55:20 | JobHistoryReader_TestFilter (TestFactory): Feature specification `TEST_GROUP' in mapping file row `FACTORY_DEF {*} TestFactory FACTORY_NAME { JobHistoryReader_TestFilter } INPUT FEATURE_TYPE JobHistoryReader_TestFilter_INPUTLINE TEST_GROUP TEST { @EvaluateExpression(FDIV,STRING_ENCODED,<at>Value<openparen>timeFinished<closeparen>,JobHistoryReader_TestFilter) CONTAINS_REGEX <backslash>d-<backslash>d<backslash>d:<backslash>d<backslash>d ENCODED } TEST { @EvaluateExpression(FDIV,STRING_ENCODED,<at>Value<openparen>timeFinished<closeparen>,JobHistoryReader_TestFilter) CONTAINS_REGEX <backslash>d<backslash>+<backslash>d<backslash>d:<backslash>d<backslash>d ENCODED } BOOLEAN_OPERATOR

lancecContributor

asked in Automation

FME Server Error Submitting the Job "Could not acquire valid job queue"

Pretty much just as the error says:“There was an error submitting the job. COM.safe.fmeserver.api.FMEServerException: Job submission failed. Could not acquire valid job queue.”This displays immediately after pressing run in the workspace runner on FME Server 2021.2.5.I’m not sure where to start investigating and thought maybe someone could point me in the general direction.

curtisd54Contributor

asked in Automation

find area % within a grid

Hello All,I want to complete this in FME similar to how I did it in ArcPro below using Select by Location Calculating the percentage of area in each Grid Determine the number of pixels within each grid Calculate the % of areas within each grid by dividing the number of pixels by 111 111 and multiplying by 100 Generate the density map with density classes: 7 categories Example: if the grid has 35 000 pixels, then the percentage is 31.50%thanks!

hermannContributor

asked in Automation

FME Flow Workspace App: How to get the Username as variable

In a FME Flow Workspace App can users log in.How can I get the username as a variable in my workspace. Each user shall read and edit diffrent datasetts.

albjohContributor

asked in Automation

Warning when running automations

Hi, I get warnings when running some automations in FME Flow. Running just the workspaces manually does not give these warnings and all data is written as expected in both cases. Any ideas for what is causing these to appear? Thanks Automation log:1 2024-04-04T22:00:00+02:00 | 803022 : Dependent parameters: [] 2 2024-04-04T22:00:00+02:00 | 803018 : Expected parameters: [DestDataset_GEODATABASE_SDE, SourceDataset_MSSQL_ADO_3] 3 2024-04-04T22:00:00+02:00 | 803019 : Provided parameters: [SourceDataset_MSSQL_ADO_3] 4 2024-04-04T22:00:00+02:00 | 803019 : Provided parameters: [SourceDataset_MSSQL_ADO_5, SourceDataset_MSSQL_ADO_6, SourceDataset_MSSQL_ADO_7] 5 2024-04-04T22:00:00+02:00 | 803022 : Dependent parameters: [] 6 2024-04-04T22:00:00+02:00 | 803018 : Expected parameters: [] 7 2024-04-04T22:00:00+02:00 | 803022 : Dependent parameters: [] 8 2024-04-04T22:00:00+02:00 | 803018 : Expected parameters: []

changgeContributor

asked in Automation

Find CAD coordinates in FME and use CAD to build a 3D model

Can anyone help me, I am going to build an indoor 3D model in FME through CAD floor plan, when I import the CAD drawing into FME and execute the stretch command, open the inspector I find the coordinates, and find that the values related to the coordinates are all 0, and the coordinate system is also the location, in addition, after finally converting the CAD file to CityGml format, I opened it with Notepad and found that it was all null values, how to solve it

ponting13Contributor

asked in Automation

FME Flow - Workspace App not allowing additional "Allowed Users" when Authentication is required

I am having trouble setting up an FME Flow Workspace App. We have setup our environment to have many users added to the “fmeguest” group and have them pretty much exclusively use Flow by accessing Workspace Apps. For a while now we have been using the “Requires Authentication” option on our flow apps with “fmeguest” as an Allowed User. However this appears to now not be working. Any time we add any additional allowed user (above the author of the app) and hit ok to host the app, those users are dropped. When we return to the edit screen only the app creator has access again. This means no additional users can gain access to the flow apps, which very much defeats the purpose of them. Just wondering if anyone else has encountered this problem, might be a tricky one for people to replicate to help. We are on FME Flow 2023.1.1.1 Any Ideas are welcome, fire them through and we will give them a go 😊

worjakContributor

asked in Automation

How to trigger automation via costum html-form and API

Hi,I am struggling to trigger a automation from a custom html-form. It seems that the post-action never gets to the automation in FME Flow. My html-page looks like this:html-formThe html-code is this:html-code When I hit the [Submit]-button I get a white page - no error - nothing is logged! I know the automation works because the API-page gives me this: API-pageWhat I think might be wrong is that on the API-page I have a Token - which I don’t have on my custom html-form! How do I add the token to the HTM-form? Another question is wheather the request body coming from the custom html-form is right since I don’t see it? Thanks in advance.Regards Jakob

kathyjbryceContributor

asked in Automation

FME Flow - remove queued jobs from fmeserver database table fme_jobs?

Our FME Server was patched and rebooted, which left it in a bad state. The automations and schedules kept triggering jobs but no jobs were running. It wasn’t noticed over the weekend and we now have over 160,000 queued jobs and I can’t get the FME server to respond (it hangs at the login screen, API calls just hang). I’ve restarted services, the machine etc etc. I think the issue is the fmejobrestore starts restoring all these jobs to the queue when I restart the fme server services. I’d like to cancel all the queued jobs in the back end database. Can I remove the records from the fme_jobs table? Will this cause any issues? Thank you!Kathy

od10Contributor

asked in Automation

Upload Cesium 3D Tiles through Cesium API

Has anyone managed to upload a ZIP file of Cesium 3D Tiles into Cesium Ion through its API? I can upload a CityGML through the CesiumIonConnector but want to try writing Cesium 3D Tiles and uploading the ZIP file. Thanks

clemensbContributor

asked in Automation

Using Arcpy python3.x and additional libraries like pymssql

Hello. We were using some extra libraries like pymssql and Arcpy in some shutdownscripts/startupscripts on our FME Server 2021 with python2.7 and integrated the libraries with sys.path.append ("C:\\Python27\\ArcGISXX.X\\Lib\\site-packages") like in this article https://support.safe.com/s/article/importing-arcpy-troubleshooting-ideasThis was working fine.Now we should upgrade to python3.x and arcgis pro with a new Server/Flow Version.I tried the old method but this isn’t working anymore. I found this article but for the server it’s a dead link https://support.safe.com/s/article/choosing-a-different-python-interpreter-installati Is there a similar way for arcgis pro and python3 to use pymssql in FME Server/Flow?

manuel_hContributor

asked in Automation

Problem with Python module xarray used in FME Flow 2023.2.2

Hello everyone,I have a problem with FME Flow 2023.2.2 and the module xarray 2024.2.0. I need xarray for reading netCDF data and have created a Python script for this in FME Form 2023.2.2. This also runs without any problems. However, when I upload this workspace to FME Flow and start it there, I always get the message that the run has failed.After some research I found out that FME Flow has problems executing the command xarray.open_dataset(). I'll post the script and the logs of FME Form and Flow:import fmeobjectsimport xarray as xrclass FeatureCreator(object): """Template Class Interface: When using this class, make sure its name is set as the value of the 'Class to Process Features' transformer parameter. """ def __init__(self): """Base constructor for class members.""" pass def input(self, feature: fmeobjects.FMEFeature): print("Assign file") file = '/dafis/OpMod/t_file_fine/t_file_fine_2024040300_006_012.nc' print ('File: ' + f

benvkContributor

asked in Automation

Backup & Restore admin tab vs backupConfiguration.fmw

G’day, I have been having all sorts of issues trying to get the Out of the Box backupConfiguration.fmw tool to run via a schedule, I don't think it has worked properly since we installed FME Server about 6 years ago, we have just kind of ignored it and never made repairing it a priority. At one point we recreated the schedule from scratch as a result of me creating this topic (BackupConfiguration.fmw "Unable to retrieve backup from FME Server..." | Community (safe.com)), but that win was short lived. I have only just now realized there is a tab on the admin panel of FME Flow called “Backup & Restore”, and I am wondering if someone can tell me the difference between the two? The Backup & Restore tab has apparently run fine for as long as our logs go back (Sept 2023). Am I duplicating effort by trying to get backupConfiguration.fme to run? Or are they separate things? Just for interest's sake I have attached the log of the most recent run of backupConfiguration.fme including the

vxn43Supporter

asked in Automation

Automation and Engine Log Files - How long are they saved?

How long in terms of days is a log file saved after an Automation is run? is the log file overwritten the next time the same Automation runs? or is the log file archived somewhere? Also, the log files in Resources referenced below, how long are they saved? how often are new ones created and saved?Files & Connections - Resources - Logs - Engine - OldFiles & Connections - Resources - Logs - Core - Old

swethabhupathiContributor

asked in Automation

getting error “QSInvalidRequest”

Often getting error “QSInvalidRequest” while an automation triggering a job at scheduled time

curtisd54Contributor

asked in Automation

transformer to generate grid?

Hello , I am looking to generate a 10km x 10km grid (10 000m x 10 000m)with 30m x 30m pixel what would be the best transformer to complete this ?

od10Contributor

asked in Automation

Reading GDB in FME Flow Gallery App

Hello, I’ve got two user parameters in my gallery app. A Generic reader where i chose what data to read in, in my case a ESRI geodatabase, and a featuretype user parameter to choose which feature class or layer to read in. I can’t seem to get this to work from ESRI gdbs. Anyone have any ideas? I can’t select the gdb, only a file in the gdb folder. Thanks

nchapContributor

asked in Automation

FME Flow 2024.0 - PythonCaller - Could not open the address locator

We recently upgraded to FME Flow 2024.0 and have been struggling with an issue where access to a number of our ArcGIS Server services is being denied at the Flow level. We were first able to circumvent this by using on-network calls using HTTP however a recent job where we use a PythonCaller to geocode addresses is failing when we attempt to hit our Address Point Locator. Job works as expected in Form, and we have ArcGIS Server working on the FME hosts, in addition to the ArcGIS Server host that has our working services. Has anyone else experienced this so we might know where to look? Sounds like HTTPS/SSL but I am not sure where to begin to work with our Network Engineers. Thank you,Nicholas 36 2024-4-2 14:19:09 | Message Type: fme::internal::_v0::py::Exception 237 2024-4-2 14:19:09 | Python Exception <ExecuteError>: Failed to execute. Parameters are not valid. 238 2024-4-2 14:19:09 | ERROR 000005: Could not open the address locator. 239 2024-4-2 14:19:09 | Failed

peterverstContributor

asked in Automation

Reuse my OSM to .GBD template

Hello,I am using FME (ESRI version) and I built a project that reads fileXX.osm.pbf. I use a clipper and schema adjustment and write this to a .gdb (ESRI). In my project, I do this for a part in Norway. All is great so far.Now I want to use the same project but with a different osm.pbf file, a different clip file, and a different .gdb. I see that the project is reading, but when writing, I get a message that it did not work because names are different. I tried to save a template and start a new project from the template, but it's the same result.I hope someone can point out what I am doing wrong here.Greetings, Peter

sam_appletonContributor

asked in Automation

Error when attempting to turn automation off - Have to run jobs via automation

Hi,I get the following error when trying to turn automations off, on a new install of FME Flow:Unable to disable 'run wb': 929028:SQL Query SELECT ncid, connectionname, connectiontype, servicename, username FROM fme_nc_namedconnections WHERE username IS NULL ORDER BY username DESC failed. Error: Could not find prepared statement with handle 1. I had a look in the forums about a similar error with creating db connections but that doesn't seem to be an issue for me. I also can't run workbenches using the 'Run workspace' screen as I get this error which is most likely tied to our SSL certificates? There was an error submitting the job.This is the reason for the automations - I'm having to trigger jobs through the automation screen to run any jobs Unfortunately I wasn't involved in the setup of this environment but any advice is welcome. Many thanks, Sam

goldsteinContributor

asked in Automation

Feed an Http caller values from one column using another column as identifier or pk

Hello everyone,I'm currently in the process of learning FME as it's just been introduced into our projects. However, there's not much guidance available at the moment, so I'm hoping to get some help here.I have a specific task involving two values: Owner ID (OID) and associated account (AA). We have our own API service that can provide additional details using the AA. My aim is to make HTTP calls with the AA values while ensuring the control remains based on OID.DATA format example:In simpler terms, when OID is set to 1, I want to input all associated AA values into the caller (one by one of course).However, I've heard that loops aren't generally recommended in FME workflows.Can anyone advise if this is possible within FME, and if so, how I might go about it without resorting to loops?Any insights or guidance would be greatly appreciated.Thank you in advance!

skosty_fmeContributor

asked in Automation

Email attachments automation fails with permission denied

Hi,I have an email attachment automation that downloads attachments to the shared resource folder, but when it is time to run the workspace I get a permission denied error on email.attachments path.FME Flow 2023.2IMAP email with client keyThe automation runs successfully if there is a single attachment and configured to run email.attachment. The problem is email signatures and multiple attachments are present most of the time so I need to run email.attachements to get down to the xlsx I need to load.Why do I get a permissions error on multi file, but not single file?Thanks,Steve

asablombergContributor

asked in Automation

Email IMAP trigger stopped working

We have an automation that has been running more than a month but now stopped working suddenly. It is supposed to read specific emails from the FME inbox. Yesterday it read the email just fine but today the email isn’t recognized and is still unread many hours later. I don’t see any difference between yesterdays email and todays email, they look the same to me. Other email-reading automations have run just fine after this one stopped working.I have tried restarting the automation, resend the mail to the mailbox but nothing works. Anyone have any ideas?

tb09114Contributor

asked in Automation

Send email with download link

I guess that’s a very easy one, but I can’t find the right answer.I created a gallery app, and the user can provide an email address to receive the results of the run.Unfortunately, while the workspace runs trough, and when staying on the page I get also a working download link for the data, the email is never sent.What I would like to know is, how I should set up the email service on FME Server. I can choose between ‘Automation’ or ‘Notification → Subscription’.The automation keeps me puzzled on what trigger I should use to say a user started the run of a workspace, and please use the provided email address to send the email. The subscription seems to be a bit more straight forward and I would aim for the Email protocol , and set the subscription topic to JOBSUBMITTER_ASYNC_JOB_SUCCESS, but then I am lost in the protocol settings when it comes to the ‘Email To- part, and to know what actually will be in the body of the email.Essentially the only thing I need is a setup that sends an e

asked in Automation

Hi, Has anyone else had issue initiating the FMEWorkspaceRunner class in python 3.9?

I have followed the instructions in the below post to run a workspace from python.https://community.safe.com/s/article/run-an-fme-workspace-from-python-using-fmeworkspacAfter a bit of messing about appending the relevant paths I got the fmeobjects to import but when I try to initiate the FMEWorkspaceRunner class I get 'ERRORFMEException: 1: An error has occurred' with no other details. Extract of code below:import osimport syssys.path.append(r"C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro")sys.path.append(r"C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro\\fmeobjects\\python39")sys.path.append(r"C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro\\python")sys.path.append(r"C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro\\python\\python39")os.environ['FME_HOME'] = r"C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro"os.environ['CONDA_DLL_SEARCH_

1
2
3
4
...
29

Page 1 / 29

Badge winners

anteboy65has earned the badge Student (Grey)
anteboy65has earned the badge Teacher (Grey)
crystalatsafehas earned the badge Expert (Grey)
mariashas earned the badge Student (Bronze)
benichollshas earned the badge Student (Grey)

Show all badges

28,731: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.

Username or e-mail

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.