A space to discuss FME Flow
Recently active
Hello. We were using some extra libraries like pymssql and Arcpy in some shutdownscripts/startupscripts on our FME Server 2021 with python2.7 and integrated the libraries with sys.path.append ("C:\\Python27\\ArcGISXX.X\\Lib\\site-packages") like in this article https://support.safe.com/s/article/importing-arcpy-troubleshooting-ideasThis was working fine.Now we should upgrade to python3.x and arcgis pro with a new Server/Flow Version.I tried the old method but this isn’t working anymore. I found this article but for the server it’s a dead link https://support.safe.com/s/article/choosing-a-different-python-interpreter-installati Is there a similar way for arcgis pro and python3 to use pymssql in FME Server/Flow?
FME Flow 2023.2.2.We are modifying most of our workspaces and automations to take advantage of deployment parameters but we are finding some difficulties to fully use them inside automations.As an example, we often write data to SFTP directories both inside workspaces and automations. FTPCaller URL, user and password can easily be configured through deployment parameters but I can’t see how to use deployment params to configure SFTP Directory external action host, port, user and password. Is there any trick to do so?If there’s no possibility to do so we’ll have to rebuild a number of workflows to write data to SFTP together with other related actions inside workspaces instead and I’d prefer to keep the SFTP Directory actions and error control inside the automations as they make the whole thing more graphic and manageable.
I have automations that read sql tables an read the filenames in specific tables. in order to iterate through the records the automation updates a flag (i.e. PF = 0, 1, 2, 3) The automation runs on an interval and gets the next record PF=0 and sets the flag according to how far it gets through the automation. It’s seems like it would take quite a bit to rig a method to get the PF=0 count and corelate that to how many times the automation runs. I am looking for suggestions on how i could determine there are no more pf=0 records and stop the automation. Is there a transformer for Flow that will use data to stop the automation?Probably with python (right?) non python?
The connection works in FME Form, but while uploading the workspace I get the following error: Failed to update definition of database type 'Microsoft SQL Server (JDBC)' - FME Flow encountered an error and reported the following message.Database type Microsoft SQL Server (JDBC) cannot be edited.Request to https://xxxxxxxxxxxxxx/fmeapiv4/databasetypes/Microsoft SQL Server (JDBC) returned status code 422. Any tips and help greatly appreciated.
Hello All, We are currently using FME server as an integration platform. There are many FME jobs (triggered via external system call) that writes data in to database via ArcGIS portal service. Is it possible to (hold)queue all the jobs in FME server when ArcGIS enterprise will be down ? Also, would like to know if there is a provision to hold all the jobs that is directed to a specific queue? Thanks,Naveen
Hi all,I’m having an issue getting some Flow App users to be able to successfully write to an ArcGIS SDE database. I am getting the following error.“An error occurred while attempting to retrieve the connection parameters from the connection file ‘SDE Connection’”This had previously been working fine, but with the upgrade from 2022 to 2023, connecting to SDE now requires a stored database connection, which then gets uploaded when it is published. Previously, at 2022, I think it was just storing the UNC pathing to the SDE connection file, and as long as FME Flow had access to this folder, everything was fine.Initially the App users were set up with Access permission to the Flow Workspace Apps, and nothing else. After a bit of hunting around I then added Access permission to the Connections, as this seemed like it might be necessary.But unfortunately this seems to have made no difference, and the users are still getting the same error.Are there any other permission requirements that are
Hi All, I am seeking assistance in developing an FME workflow to perform clearance analytics for both roads and power lines in terms of trees - utility vegetation management. Our source data includes:Mobile Laser Scanner (MLS) Point Clouds: Representing the surrounding environment. The data includes the canopy and branch classification of each individual trees. Pre-defined Clearance Profiles (Vectors): Defining the acceptable clearance zones for roads and power lines. Linear Reference Data (Polylines): Representing the road edges or power line geometry.Workflow Goal:The objective is to identify and classify obstacles within the pre-defined clearance profiles. This involves:Spatial Analysis: Identify point cloud data falling within the designated clearance profiles. Obstacle Classification: Classify the identified points as potential obstacles. Obstacle Dimensioning: Measure the dimensions of the classified obstacles.Risk Assessment Output:Based on the identified obstacles, we aim to g
Hi.I’ve encountered this before, but now it blocks the saving of a 28K large table, and is so no more a mere nuisance.It seems that FME fails to catch that SQL statements fails typically due to constraints in the database. FME happily reports that all posts were saved, although none were in this case.My latest error message from the log file looks like this:Microsoft SQL Server Spatial Writer: Failed to write a feature of type `VEJLE_GADELYS.Elledning' to the database. Provider error `(-2147217873) The INSERT statement conflicted with the FOREIGN KEY constraint ...Because FME fails to catch these errors, and thus not failing in the automation, we’re putting invalid datasets into production.This is bad.
I have two questions about hosting on the FME Flow Hosted ServiceThe first is, when the Cloud Flow is offline, is it possible to show another page or change the standard offline page? I am trying to save some costs to run the Cloud instance for only certain hours, and it would be nice to give users feedback, which informs them of the times the service is live.The second is,how can I use my own domain for the Flow Cloud Hosting? I would like to change it for pure simplicity and because it avoids confusion to users who don't know what fme is. Is there simple ways to change these two things, any help would appreciated, or links on how to achieve this. RegardsFred
Event Description: Error was recorded in fmeserver.log file.Event Title: Error LogsMessage: Failed to register FME Engine. This also keeps on repeating:Event Description: Error was recorded in fmeserver.log file.Event Title: Error LogsMessage: FME Server license does not allow more than maximum of 1 FME Engine(s).
Hi All,First, I am an ArcGIS Pro/Enterprise user with the “Data Interoperability Extension” for both Pro and Enterprise. I do not believe that I have access to FME Flow (Server).My installs on the server are ArcGIS Portal/Server and Data Interoperability at v11.3 - which installs FME…Edition: Data Interoperability, Fixed OEM LicenseVersion: FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)I want to automate a Spatial ETL tool that reads GeoJSON from a URL and ends up writing the results to an ArcGIS Online Feature Service. I thought, why not just do it on the server and skip the exporting/importing the Web Connection from my laptop to the server? (from reading Schedule Spatial ETL tools on a server—ArcGIS Data Interoperability | Documentation for ArcGIS Enterprise) When I created the workspace on the server with FME Workbench, everything seemed fine. I could insert an Esri ArcGIS Online (AGOL) Feature Service writer and connect to the feature service that I wanted to write to.But
We have FME Flow 2023.2.1 installed, we have chosen PostgreSQL running in AWS RDS as our database. This has been setup and configured at installation using the silent Windows installation method.We are seeing vulnerabilities on the server FME Flow is installed on relating to Microsoft OLE DB Driver. This seems to have been installed as part of FME Flow. Is the Microsoft OLE DB Driver a required driver if we’re not using SQL Server?If so, can this be removed or do we now need to manage patching of this driver?
Hello,I am submitting job through my FME api and not keeping job id in application, Though I want to check status of my job through Published parameer which is always unique.I know we can get all jobs and then we can do filtering but it will bit costly operation hence I dont want to do that.How to track Submitted job status with Published parameter? (Eg: I am supplying “batchId” as published parameter and want to track job status based on my that batchid only)
Hey everyone, On FME Server (2021.2.6) I have resources that I want to make available on an HTML page. I want users to be able click on the link and immediately download the data that's in the resource folder: https://fmeserver.EXAMPLE.com/fmeserver/#/resources/browse/FME_SHAREDRESOURCE_DATA/EXAMPLE?name=Data Seems like a pretty standard deal.
Hi,Just a quick question about this scenario:we are going to send an Email from an Automation in the case that a translation fails. To populate the body of this Email we can use several parameters (workspace name, automation name, repository name, job id, start and end time of the job, etc.). Now we would also like to add the URL of the FME Flow server to the Email body.Why? Two reasons:We have got 4 different FME Flow environments - D, T, A & Production - and we want the server who sends the email to identify itself It would be cool to add a hyperlink to the job log to the Email body and with the URL and the Job ID we would be able to compile such a linkSo, the question is: would this be possible? Where and how could we retrieve this URL? It is not a parameter in the list provided, as far as I know.Any ideas would be greatly appreciated.TIA,Egge-Jan
Hi all,I have a workbench which has a parameter that asks for a .ZIP file for input.Specifying extension filters works in workbench - user can only add/view files with an extension “.ZIP”When i publish this to FME Flow, and create a flow app, the extension filters are ignored and the user can select/view any file of any type.Bug?Using FME 2023.2.0.0.FME Flow 2023.2, Build 23747 - win64thanks
We have a domain account setup to run the 3 services required for FME Server 2022 to function. My question is simple, does this account need to be apart of the Administrators group?
Hi All,I am getting this error when i open FME Workbench and I am not sure what to do at this point this was working for me. I am no longer able to connect to my FME Flow established connection. 2024-05-30 11:14:36| | |WARN |SQL Query UPDATE fme_nc_namedconnections set connectiontype = connectiontype WHERE fme_nc_namedconnections.ncid = ? failed. Error: attempt to write a readonly database
Is it possible to construct an FME Flow/Server (I currently have Server 2022.2) process that can monitor an Esri Enterprise (10.8.1) hosted layer? We are trying to build something that notifies particular people when changes are made. ThanksCarl
I have an automation with several workspaces in series, the last one taking results from the previous and sending them as a series of API requests to a software. general outlinethe software has an antiforgery token that has to first be requested, then updated, so the final POST ends up being the 4th HTTP Caller. API Call WorkspaceThe problem i’m having is slowing down the rate at which concurrent API calls are happening, so if multiple requests hit at approximately the same time, one of them will fail due to not receiving a new antiforgery token.High priority has a second engine assigned only to it, and this is the only workspace that utilizes that job queueRetry Settingsi have added a queue to the workspace runner, with it’s own engine, I also added a decelerator to the beginning of the workspace with a 20 second delay in the hopes that the “first” API workspace would complete before the second one started, but, so far it has not been effective. when it fails, it fails with an empty
Can anyone help me, I am going to build an indoor 3D model in FME through CAD floor plan, when I import the CAD drawing into FME and execute the stretch command, open the inspector I find the coordinates, and find that the values related to the coordinates are all 0, and the coordinate system is also the location, in addition, after finally converting the CAD file to CityGml format, I opened it with Notepad and found that it was all null values, how to solve it
Hello!i have an URL from a WebSocket API:wss://[IP]/api/v1/devices/[DEVICE_ID]/readings/socket?auth=[KEY]The output is a json.In the documentation of the WebSocket API is no port mentioned. I only have the URL above - that's it.Is it possible to use the trigger "WebSocket Message (received)" (Automation in FME Flow) with this URL to constantly receive data? What exactly is the stream ID in this context?Or is this the wrong way?Sorry, i'm new to this and i can't find any up-to-date guidance which gets me on the right track.We are using FME Flow 2023.2.2.Thank you very much in advance!
Hello,I am performing a data stream in FME Flow that reads two independent datasets with the same schema from the BC Wildfire Service’s (BCWS) Public ArcGIS Online Feature Service. These datasets are the BCWS current fires found on their Wildfire Dashboard:Known fire start locations (points) Wildfire perimeters (polygons)What my data stream does:(Read) Read both points and polygons of current wildfires, also read a previous copy of both datasets merged as a PostGIS table → (FeatureJoiner) Join and overwrite points where polygons exist → (ChangeDetector) Detect major changes from the PostGIS table: point-to-polygon updates, polygon area increases, and fire status indicators → (Write) Write all changes to the saved copy in PostGIS, and write the major changes to a PostgreSQL update logging table.This workflow runs fine when performed manually. However I noticed when I apply the workbench to run as a data stream, my logging table will go crazy every once in a while and log every featur
I have set up a project in our test environment containing two workspaces in a repository, a workspace app and an automation. Workspaces use a resource\data subfolder. The automation writes data to a database through a database connection. All this is set up with my admin account.When I try to export the project to move to our production environment I get the error: “Exporting the project is not permitted. This project contains items that don't exist or are inaccessible by you.”In the project I have added the automation, connection, repository, resource path and workspace app, 5 items in total. I have verified that the resource\data path is migrateable as per the first note here: https://docs.safe.com/fme/html/FME-Flow/WebUI/Exporting-Importing-Projects.htmAny tips on why I am not allowed to export? The items defined in the project all exists and as an admin I have access to all items...
I am making a self service map generator workspace app. My want is to be able to verify a username by using either SSO/Windows authentication. then I have a script that has outputted all the groups and its users in our ArcPortal in a spreadsheet. so I can relate their username to the group they’re in which then I’ll use a testfilter as to what layers each group is allowed to use in their map. Unless there’s an easier way to go about this?