- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow

FME Flow

A space to discuss FME Flow

2143 Posts

Recently active

Most replies Most views Newest first

sunsilk11Contributor

asked in Automation

Error running JobHistoryStatisticsGathering

Hi I am getting error message below when running JobHistoryStatisticsGathering in FME Flow. I am using FME Flow 2021If I download the workspace and run it in FME Form, it works OK.Any ideas? 2024-4-26 15:55:20 | JobHistoryReader_TestFilter (TestFactory): Feature specification `TEST_GROUP' in mapping file row `FACTORY_DEF {*} TestFactory FACTORY_NAME { JobHistoryReader_TestFilter } INPUT FEATURE_TYPE JobHistoryReader_TestFilter_INPUTLINE TEST_GROUP TEST { @EvaluateExpression(FDIV,STRING_ENCODED,<at>Value<openparen>timeFinished<closeparen>,JobHistoryReader_TestFilter) CONTAINS_REGEX <backslash>d-<backslash>d<backslash>d:<backslash>d<backslash>d ENCODED } TEST { @EvaluateExpression(FDIV,STRING_ENCODED,<at>Value<openparen>timeFinished<closeparen>,JobHistoryReader_TestFilter) CONTAINS_REGEX <backslash>d<backslash>+<backslash>d<backslash>d:<backslash>d<backslash>d ENCODED } BOOLEAN_OPERATOR

lancecContributor

asked in Automation

FME Server Error Submitting the Job "Could not acquire valid job queue"

Pretty much just as the error says:“There was an error submitting the job. COM.safe.fmeserver.api.FMEServerException: Job submission failed. Could not acquire valid job queue.”This displays immediately after pressing run in the workspace runner on FME Server 2021.2.5.I’m not sure where to start investigating and thought maybe someone could point me in the general direction.

curtisd54Contributor

asked in Automation

find area % within a grid

Hello All,I want to complete this in FME similar to how I did it in ArcPro below using Select by Location Calculating the percentage of area in each Grid Determine the number of pixels within each grid Calculate the % of areas within each grid by dividing the number of pixels by 111 111 and multiplying by 100 Generate the density map with density classes: 7 categories Example: if the grid has 35 000 pixels, then the percentage is 31.50%thanks!

zaneta.markContributor

asked in Architecture

FME Server/Flow job logs saved as .json

Hi,Is there a way to configure FME Server/Flow, so that logs are automatically saved not only to standard .log file, but also to .json file (containing JSON formatted data)? It would be very helpful when it comes to further log information processing.

rob_m_esriukContributor

asked in Architecture

FME server doesn't create log for failed workbench

We have a server running many jobs and one of them normally runs successfully and a log can be reviewed but at other times the job fails and when i access it i get the message Error: The log file for job ID "######" does not exist.I’ve seen the post in FME Server 2019 Error: The log file for job ID "2613" does not exist and we have plenty of disk space, the job frequently works successfully, other jobs are still creating log files. I’ve checked all the suggestions in that post.The failed job is recorded as running for a couple of seconds but without the log I have no insight into why it is failing

hermannContributor

asked in Automation

FME Flow Workspace App: How to get the Username as variable

In a FME Flow Workspace App can users log in.How can I get the username as a variable in my workspace. Each user shall read and edit diffrent datasetts.

fionasinContributor

asked in Deployment

Emailer Not Sending Full Zip File

I have a process which creates 4 asc files, and then sends them to a zipped file. At the end of this process, this file is to be emailed. I have an attribute creator which creates the file name as ‘attachment’, as it does contain dynamic elements, before using that attribute as the attachment field in the emailer. When i run it on my local computer, it works perfectly fine, and I get an email with all four files zipped. However, when i run it on FME server, the zip file only contains 1 of the four. Regardless if the files have content or not, they should all write to the folder, and then do, i can see in the fmeserver directory, that all 4 files have been zipped up, but when it is emailed, it just seems to delete three of them. The sampler is there so it only sends one email, but the attribute creator refers to the zipped file, which is created in the system caller, so all four should be sent.

albjohContributor

asked in Automation

Warning when running automations

Hi, I get warnings when running some automations in FME Flow. Running just the workspaces manually does not give these warnings and all data is written as expected in both cases. Any ideas for what is causing these to appear? Thanks Automation log:1 2024-04-04T22:00:00+02:00 | 803022 : Dependent parameters: [] 2 2024-04-04T22:00:00+02:00 | 803018 : Expected parameters: [DestDataset_GEODATABASE_SDE, SourceDataset_MSSQL_ADO_3] 3 2024-04-04T22:00:00+02:00 | 803019 : Provided parameters: [SourceDataset_MSSQL_ADO_3] 4 2024-04-04T22:00:00+02:00 | 803019 : Provided parameters: [SourceDataset_MSSQL_ADO_5, SourceDataset_MSSQL_ADO_6, SourceDataset_MSSQL_ADO_7] 5 2024-04-04T22:00:00+02:00 | 803022 : Dependent parameters: [] 6 2024-04-04T22:00:00+02:00 | 803018 : Expected parameters: [] 7 2024-04-04T22:00:00+02:00 | 803022 : Dependent parameters: [] 8 2024-04-04T22:00:00+02:00 | 803018 : Expected parameters: []

changgeContributor

asked in Automation

Find CAD coordinates in FME and use CAD to build a 3D model

Can anyone help me, I am going to build an indoor 3D model in FME through CAD floor plan, when I import the CAD drawing into FME and execute the stretch command, open the inspector I find the coordinates, and find that the values related to the coordinates are all 0, and the coordinate system is also the location, in addition, after finally converting the CAD file to CityGml format, I opened it with Notepad and found that it was all null values, how to solve it

marta.podsiadContributor

asked in Deployment

Run ArcPro Python from FME

Hi, I have a toolbox in ArcPro that is creating a csv with list of all layers present in webappliction. Is there a way that I can run that script from FME and get the same result? I cannot access the content of the webmap in FME as I am using SingleSignOn to log in into EsriEnterprise.

krlemContributor

asked in Security

Is there a way to restrict access to python os module in FME Flow?

As we all know, FME supports use of Python in workbenches, either via PythonCaller, scripted parameters, etc. The risk I see though is, that unexperienced user or malicious insider could potentially run Python code with access to Operating System commands (os.system for example) and create some damages (delete shared data folder contents, remove some files or corrupt Engine host, map external drives and copy data there, etc., you name it).What are the best practices to restrict access to this type of Python modules? Is there any built-in functionality in FME Flow that could help to address this security concern?

adrian_farrellContributor

asked in Deployment

SharePoint Issues

Hi Could anyone help please? I have created two connections to Microsoft SharePoint, one for SharePoingOnlineConnector and one for SharePoint List Reader/Writer in FME Form.When i use either after uploading to FME Flow i get this error from Flow when running a published Flow App but it seems to work when running directly from the Flow UI SharepointOnlineConnector: Connection 'xx SharePoint Files' does not exist. Check connection parameter and connection definitions in FME options and try again I have gone into the group settings and granted full control to every user group that can use the Flow App, we are using AD authentication and that appears to be working fine. If anyone can assist i would be very grateful Thanks Adrian

ponting13Contributor

asked in Automation

FME Flow - Workspace App not allowing additional "Allowed Users" when Authentication is required

I am having trouble setting up an FME Flow Workspace App. We have setup our environment to have many users added to the “fmeguest” group and have them pretty much exclusively use Flow by accessing Workspace Apps. For a while now we have been using the “Requires Authentication” option on our flow apps with “fmeguest” as an Allowed User. However this appears to now not be working. Any time we add any additional allowed user (above the author of the app) and hit ok to host the app, those users are dropped. When we return to the edit screen only the app creator has access again. This means no additional users can gain access to the flow apps, which very much defeats the purpose of them. Just wondering if anyone else has encountered this problem, might be a tricky one for people to replicate to help. We are on FME Flow 2023.1.1.1 Any Ideas are welcome, fire them through and we will give them a go 😊

asked in Deployment

Uninstallation process takes an unusually long time (tested with FME Form and Flow 2023.1.2)

Uninstalling FME Form (and FME Flow) takes an unusually long time. We’re talking about 15+ Minutes on a powerful desktop PC (i9-10900k @ 3,70 GHz, 32GB RAM, fast SSDs). This is somewhat annoying, as there is still no way to update the program “in place”. Tested with FME Form and Flow 2023.1.2 Build 23641. I wonder what could be the reason? Maybe some kind of Windows real-time protection? Changing the Windows security settings is not an option as these are dictated by the IT department. Edit: I’m unable to create this thread in the “General” category (can’t be selected from the drop-down menu). So please move this thread if it doesn't belong here.

worjakContributor

asked in Automation

How to trigger automation via costum html-form and API

Hi,I am struggling to trigger a automation from a custom html-form. It seems that the post-action never gets to the automation in FME Flow. My html-page looks like this:html-formThe html-code is this:html-code When I hit the [Submit]-button I get a white page - no error - nothing is logged! I know the automation works because the API-page gives me this: API-pageWhat I think might be wrong is that on the API-page I have a Token - which I don’t have on my custom html-form! How do I add the token to the HTM-form? Another question is wheather the request body coming from the custom html-form is right since I don’t see it? Thanks in advance.Regards Jakob

kathyjbryceContributor

asked in Automation

FME Flow - remove queued jobs from fmeserver database table fme_jobs?

Our FME Server was patched and rebooted, which left it in a bad state. The automations and schedules kept triggering jobs but no jobs were running. It wasn’t noticed over the weekend and we now have over 160,000 queued jobs and I can’t get the FME server to respond (it hangs at the login screen, API calls just hang). I’ve restarted services, the machine etc etc. I think the issue is the fmejobrestore starts restoring all these jobs to the queue when I restart the fme server services. I’d like to cancel all the queued jobs in the back end database. Can I remove the records from the fme_jobs table? Will this cause any issues? Thank you!Kathy

swachContributor

asked in Deployment

How to control FME Flow distributed engines

I have finished a fresh install of FME Flow 2023 with a core machine and a distributed engine machine. The distributed engines show up on the web interface but I can’t control them. I can’t tell it how many of them to start (or stop). What additional configuration do I need to do?

od10Contributor

asked in Automation

Upload Cesium 3D Tiles through Cesium API

Has anyone managed to upload a ZIP file of Cesium 3D Tiles into Cesium Ion through its API? I can upload a CityGML through the CesiumIonConnector but want to try writing Cesium 3D Tiles and uploading the ZIP file. Thanks

clemensbContributor

asked in Automation

Using Arcpy python3.x and additional libraries like pymssql

Hello. We were using some extra libraries like pymssql and Arcpy in some shutdownscripts/startupscripts on our FME Server 2021 with python2.7 and integrated the libraries with sys.path.append ("C:\\Python27\\ArcGISXX.X\\Lib\\site-packages") like in this article https://support.safe.com/s/article/importing-arcpy-troubleshooting-ideasThis was working fine.Now we should upgrade to python3.x and arcgis pro with a new Server/Flow Version.I tried the old method but this isn’t working anymore. I found this article but for the server it’s a dead link https://support.safe.com/s/article/choosing-a-different-python-interpreter-installati Is there a similar way for arcgis pro and python3 to use pymssql in FME Server/Flow?

virtualcitymattInfluencer

asked in Architecture

404 not found from jobsubmitterservice

I’m trying to debug an issue with the Job Submitter Service (I haven't actually tried any of the other services) .I have a process which runs fine from the FME Server UI (FME Server 2021). I can fill in the parameters (also upload an input file) etc. The jobs runs.If instead I try and run this using the jobsubmitter service via REST call - e.g., http://Host/fmejobsubmitter/Repository/workspace.fmw?parametersThe response is a 404. What is interesting to me is that I’m able to use the URL without the parameters and get back a proper response - that is for example: http://Host/fmejobsubmitter/Repository/workspace.fmw. It seeeeems like the issue is somehow related to the input file, however, in that case I would expect the job to fail rather than return a 404. so to me it seems like there is a problem actually submitting the jobI’ve checked permissions and the user definitely has access to the repository where the workspace is, and in my testing removing the permissions returns a 401 ERROR

todd_davisContributor

asked in Security

Moving user data between Active Directory (AD) to Azure Active Directory (AAD or ME-ID) in bulk

Hi,I have a basic outline of how I would do this with FME Rest API, but wondering if anyone else has done it already in a comprehensive fashion, or whether Safe may have already created something for it? @siennaatsafe We are moving from Active Directory to Azure Active Directory (new name: Entra ID) in FME Flow. I just need to be able to move all user content and roles to a new AAD (new name: ME-ID) user.For instance:group: FME from AD already exists, but I am going to import group: FME from AAD and then switch all the content and role capabilities for all the underlying users. Happy to take anyone's learnings as well, just to ensure we don’t overlook anything? Cheers,Todd

missp29Contributor

asked in Architecture

Can I still run a workspace in command line on a separate distributed machine when the FME Flow Core server down?

Hi All,I am new to FME Flow. We are installing FME Flow 2023.1. We are setting up a two-tier distributed FME Flow environment with a machine which hosts FME Flow Core and Web server, and two separate distributed machines where the workspaces will be executed within the same network. Let’s say I have an automated scheduled job which supposed to run at one of distributed machine at a certain time. For some reasons, the FME Flow Core machine is down at the time when the scheduled job supposed to run. When the FME Flow Core machine down, is the scheduled job still able to start to run at the scheduled time automatically? If not, am I able to start the job manually on the command line on the distributed machine without the FME Flow Core machine available?Your help is great appreciated. Thanks, -John

jiranek_hsroObserver

asked in Security

how to integrate Flow Apps through iframe into another web site?

Hi everyone, is there a way how to integrate Flow Apps through iframe into another web site page. There is a block in CORS setting Flow Apps strict-origin-when-cross-origin. Any idea? Kindly regards

manuel_hContributor

asked in Automation

Problem with Python module xarray used in FME Flow 2023.2.2

Hello everyone,I have a problem with FME Flow 2023.2.2 and the module xarray 2024.2.0. I need xarray for reading netCDF data and have created a Python script for this in FME Form 2023.2.2. This also runs without any problems. However, when I upload this workspace to FME Flow and start it there, I always get the message that the run has failed.After some research I found out that FME Flow has problems executing the command xarray.open_dataset(). I'll post the script and the logs of FME Form and Flow:import fmeobjectsimport xarray as xrclass FeatureCreator(object): """Template Class Interface: When using this class, make sure its name is set as the value of the 'Class to Process Features' transformer parameter. """ def __init__(self): """Base constructor for class members.""" pass def input(self, feature: fmeobjects.FMEFeature): print("Assign file") file = '/dafis/OpMod/t_file_fine/t_file_fine_2024040300_006_012.nc' print ('File: ' + f

benvkContributor

asked in Automation

Backup & Restore admin tab vs backupConfiguration.fmw

G’day, I have been having all sorts of issues trying to get the Out of the Box backupConfiguration.fmw tool to run via a schedule, I don't think it has worked properly since we installed FME Server about 6 years ago, we have just kind of ignored it and never made repairing it a priority. At one point we recreated the schedule from scratch as a result of me creating this topic (BackupConfiguration.fmw "Unable to retrieve backup from FME Server..." | Community (safe.com)), but that win was short lived. I have only just now realized there is a tab on the admin panel of FME Flow called “Backup & Restore”, and I am wondering if someone can tell me the difference between the two? The Backup & Restore tab has apparently run fine for as long as our logs go back (Sept 2023). Am I duplicating effort by trying to get backupConfiguration.fme to run? Or are they separate things? Just for interest's sake I have attached the log of the most recent run of backupConfiguration.fme including the

1
2
3
4
...
86

Page 1 / 86

Badge winners

anteboy65has earned the badge Student (Grey)
anteboy65has earned the badge Teacher (Grey)
crystalatsafehas earned the badge Expert (Grey)
mariashas earned the badge Student (Bronze)
benichollshas earned the badge Student (Grey)

Show all badges

28,731: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.

Username or e-mail

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.