A space to discuss FME Flow
Recently active
Hi, I have a toolbox in ArcPro that is creating a csv with list of all layers present in webappliction. Is there a way that I can run that script from FME and get the same result? I cannot access the content of the webmap in FME as I am using SingleSignOn to log in into EsriEnterprise.
As we all know, FME supports use of Python in workbenches, either via PythonCaller, scripted parameters, etc. The risk I see though is, that unexperienced user or malicious insider could potentially run Python code with access to Operating System commands (os.system for example) and create some damages (delete shared data folder contents, remove some files or corrupt Engine host, map external drives and copy data there, etc., you name it).What are the best practices to restrict access to this type of Python modules? Is there any built-in functionality in FME Flow that could help to address this security concern?
Hi Could anyone help please? I have created two connections to Microsoft SharePoint, one for SharePoingOnlineConnector and one for SharePoint List Reader/Writer in FME Form.When i use either after uploading to FME Flow i get this error from Flow when running a published Flow App but it seems to work when running directly from the Flow UI SharepointOnlineConnector: Connection 'xx SharePoint Files' does not exist. Check connection parameter and connection definitions in FME options and try again I have gone into the group settings and granted full control to every user group that can use the Flow App, we are using AD authentication and that appears to be working fine. If anyone can assist i would be very grateful Thanks Adrian
I am having trouble setting up an FME Flow Workspace App. We have setup our environment to have many users added to the “fmeguest” group and have them pretty much exclusively use Flow by accessing Workspace Apps. For a while now we have been using the “Requires Authentication” option on our flow apps with “fmeguest” as an Allowed User. However this appears to now not be working. Any time we add any additional allowed user (above the author of the app) and hit ok to host the app, those users are dropped. When we return to the edit screen only the app creator has access again. This means no additional users can gain access to the flow apps, which very much defeats the purpose of them. Just wondering if anyone else has encountered this problem, might be a tricky one for people to replicate to help. We are on FME Flow 2023.1.1.1 Any Ideas are welcome, fire them through and we will give them a go 😊
Uninstalling FME Form (and FME Flow) takes an unusually long time. We’re talking about 15+ Minutes on a powerful desktop PC (i9-10900k @ 3,70 GHz, 32GB RAM, fast SSDs). This is somewhat annoying, as there is still no way to update the program “in place”. Tested with FME Form and Flow 2023.1.2 Build 23641. I wonder what could be the reason? Maybe some kind of Windows real-time protection? Changing the Windows security settings is not an option as these are dictated by the IT department. Edit: I’m unable to create this thread in the “General” category (can’t be selected from the drop-down menu). So please move this thread if it doesn't belong here.
Our FME Server was patched and rebooted, which left it in a bad state. The automations and schedules kept triggering jobs but no jobs were running. It wasn’t noticed over the weekend and we now have over 160,000 queued jobs and I can’t get the FME server to respond (it hangs at the login screen, API calls just hang). I’ve restarted services, the machine etc etc. I think the issue is the fmejobrestore starts restoring all these jobs to the queue when I restart the fme server services. I’d like to cancel all the queued jobs in the back end database. Can I remove the records from the fme_jobs table? Will this cause any issues? Thank you!Kathy
I have finished a fresh install of FME Flow 2023 with a core machine and a distributed engine machine. The distributed engines show up on the web interface but I can’t control them. I can’t tell it how many of them to start (or stop). What additional configuration do I need to do?
Has anyone managed to upload a ZIP file of Cesium 3D Tiles into Cesium Ion through its API? I can upload a CityGML through the CesiumIonConnector but want to try writing Cesium 3D Tiles and uploading the ZIP file. Thanks
I’m trying to debug an issue with the Job Submitter Service (I haven't actually tried any of the other services) .I have a process which runs fine from the FME Server UI (FME Server 2021). I can fill in the parameters (also upload an input file) etc. The jobs runs.If instead I try and run this using the jobsubmitter service via REST call - e.g., http://Host/fmejobsubmitter/Repository/workspace.fmw?parametersThe response is a 404. What is interesting to me is that I’m able to use the URL without the parameters and get back a proper response - that is for example: http://Host/fmejobsubmitter/Repository/workspace.fmw. It seeeeems like the issue is somehow related to the input file, however, in that case I would expect the job to fail rather than return a 404. so to me it seems like there is a problem actually submitting the jobI’ve checked permissions and the user definitely has access to the repository where the workspace is, and in my testing removing the permissions returns a 401 ERROR
Hi,I have a basic outline of how I would do this with FME Rest API, but wondering if anyone else has done it already in a comprehensive fashion, or whether Safe may have already created something for it? @siennaatsafe We are moving from Active Directory to Azure Active Directory (new name: Entra ID) in FME Flow. I just need to be able to move all user content and roles to a new AAD (new name: ME-ID) user.For instance:group: FME from AD already exists, but I am going to import group: FME from AAD and then switch all the content and role capabilities for all the underlying users. Happy to take anyone's learnings as well, just to ensure we don’t overlook anything? Cheers,Todd
Hi All,I am new to FME Flow. We are installing FME Flow 2023.1. We are setting up a two-tier distributed FME Flow environment with a machine which hosts FME Flow Core and Web server, and two separate distributed machines where the workspaces will be executed within the same network. Let’s say I have an automated scheduled job which supposed to run at one of distributed machine at a certain time. For some reasons, the FME Flow Core machine is down at the time when the scheduled job supposed to run. When the FME Flow Core machine down, is the scheduled job still able to start to run at the scheduled time automatically? If not, am I able to start the job manually on the command line on the distributed machine without the FME Flow Core machine available?Your help is great appreciated. Thanks, -John
Hi everyone, is there a way how to integrate Flow Apps through iframe into another web site page. There is a block in CORS setting Flow Apps strict-origin-when-cross-origin. Any idea? Kindly regards
Hello everyone,I have a problem with FME Flow 2023.2.2 and the module xarray 2024.2.0. I need xarray for reading netCDF data and have created a Python script for this in FME Form 2023.2.2. This also runs without any problems. However, when I upload this workspace to FME Flow and start it there, I always get the message that the run has failed.After some research I found out that FME Flow has problems executing the command xarray.open_dataset(). I'll post the script and the logs of FME Form and Flow:import fmeobjectsimport xarray as xrclass FeatureCreator(object): """Template Class Interface: When using this class, make sure its name is set as the value of the 'Class to Process Features' transformer parameter. """ def __init__(self): """Base constructor for class members.""" pass def input(self, feature: fmeobjects.FMEFeature): print("Assign file") file = '/dafis/OpMod/t_file_fine/t_file_fine_2024040300_006_012.nc' print ('File: ' + f
G’day, I have been having all sorts of issues trying to get the Out of the Box backupConfiguration.fmw tool to run via a schedule, I don't think it has worked properly since we installed FME Server about 6 years ago, we have just kind of ignored it and never made repairing it a priority. At one point we recreated the schedule from scratch as a result of me creating this topic (BackupConfiguration.fmw "Unable to retrieve backup from FME Server..." | Community (safe.com)), but that win was short lived. I have only just now realized there is a tab on the admin panel of FME Flow called “Backup & Restore”, and I am wondering if someone can tell me the difference between the two? The Backup & Restore tab has apparently run fine for as long as our logs go back (Sept 2023). Am I duplicating effort by trying to get backupConfiguration.fme to run? Or are they separate things? Just for interest's sake I have attached the log of the most recent run of backupConfiguration.fme including the
How long in terms of days is a log file saved after an Automation is run? is the log file overwritten the next time the same Automation runs? or is the log file archived somewhere? Also, the log files in Resources referenced below, how long are they saved? how often are new ones created and saved?Files & Connections - Resources - Logs - Engine - OldFiles & Connections - Resources - Logs - Core - Old
Often getting error “QSInvalidRequest” while an automation triggering a job at scheduled time
Hello , I am looking to generate a 10km x 10km grid (10 000m x 10 000m)with 30m x 30m pixel what would be the best transformer to complete this ?
Hello, I’ve got two user parameters in my gallery app. A Generic reader where i chose what data to read in, in my case a ESRI geodatabase, and a featuretype user parameter to choose which feature class or layer to read in. I can’t seem to get this to work from ESRI gdbs. Anyone have any ideas? I can’t select the gdb, only a file in the gdb folder. Thanks
Hi, We’ve recently upgraded our FME Flow install from 2022.2 to 2023.2.1I had a published workspace that used the Google Sheets v4 package. Previously when I published this workspace, the included Google Sheets package uploaded to FME Flow and became available to use in FME Flow. This all seemed to work fine.Since the upgrade to 2023.2.1 I seem to be having trouble getting this to work. When I publish the workspace, using FME Form 2023.2, I get the option to upload the Google Sheets package, and this appears to work fine.But when I run the workspace from FME Flow I keep getting this error:File D:\Program Files\FMEFlow\Server\fme\metafile\SAFE.GOOGLE-SHEETS.GOOGLESHEETS4.fmf could not be openedIf I look in the Resources>Engine folder I can see that the file safe.google-sheets-3.3.4.fpkg has been copied in here (with the appropriate timestamp when I published the workspace).Is there something else that has to happen to make this package available?ThanksKeith
I am starting with FME Server and can someone help me understand and learnI have a download process that runs on a virtual machine with Windows Server 2019 data center (Server 1) and it must write a file to a disk of another virtual machine that also has Windows Server 2019 data center (Server 2), but I gives permissions error. I understand that the process is executed with a user created in the FME Server, in this case of type System.My doubts are:Should the user created on the FME Server also be created as a user on Server 1 and have write permissions to the Server 2 disk?Should the user be changed in FME Server to Directory Server type or is it not necessary?
A client has a website that allows for uploading and downloading of data. That’s not the issue here. There is one button on their website that when clicked it lists all of the feature types and their last time an upload was completed. This output is in HTML.At the present time we are now realizing that the results from an FME Workspace, that is sitting on FME Server, properly formats the output in HTML. But here’s the issue … We discovered there was no job set up to run in FME Server which also means it is not set up to do anything related to automation. We have also discovered that the results of that job were just periodically being manually run and then directly uploaded to their website (We are the ones that built the site and maintain it, but none of those individuals who originally did this are with our company today).So, it was just a stagnant picture in time, and totally dependent on someone always remembering to go in every day, week, month, or year (We truly do not know what
Hi,We have installed the FME Flow on a new server and successfully licensed it. However, I do not see any available engines in FME Flow. I tried to use the old server license, then removed it and installed the new licensed version. I noticed that the workspaces are running. I checked the web connection and found it is connected to the new server, and the host is related to the new server. However, on the deployment status page, the host is related to the old server.I want to ensure that everything is related to the new server and to see the available engineswe use FME FLOW 2023
A client has a website that allows for uploading and downloading of data. That’s not the issue here. There is one button on their website that when clicked it lists all of the feature types and their last time an upload was completed. This output is in HTML. At the present time we are now realizing that the results from an FME Workspace, that is sitting on FME Server, properly formats the output in HTML. But here’s the issue … We discovered there was no job set up to run in FME Server which also means it is not set up to do anything related to automation. We have also discovered that the results of that job were just periodically being manually run and then directly uploaded to their website (We are the ones that built the site and maintain it, but none of those individuals who originally did this are with our company today). So, it was just a stagnant picture in time, and totally dependent on someone always remembering to go in every day, week, month, or year (We truly do not know wha
Hello,I am using FME (ESRI version) and I built a project that reads fileXX.osm.pbf. I use a clipper and schema adjustment and write this to a .gdb (ESRI). In my project, I do this for a part in Norway. All is great so far.Now I want to use the same project but with a different osm.pbf file, a different clip file, and a different .gdb. I see that the project is reading, but when writing, I get a message that it did not work because names are different. I tried to save a template and start a new project from the template, but it's the same result.I hope someone can point out what I am doing wrong here.Greetings, Peter
Hello ,I’m wondering if FME Flow can handles multiple simultaneous jobs for a single workflow . For exemple , how does the Easy Translator Demo handle the case where simultaneous translations of CSV files to SHP ( coming from different users ) without their data and their results being overlapped. Is it handled by FME Flow , or handled manually by the developers of this web app?Also in case of only one engine , how does FME Flow process this use case ?