A space to discuss FME Flow
Recently active
Hi All, I am seeking assistance in developing an FME workflow to perform clearance analytics for both roads and power lines in terms of trees - utility vegetation management. Our source data includes:Mobile Laser Scanner (MLS) Point Clouds: Representing the surrounding environment. The data includes the canopy and branch classification of each individual trees. Pre-defined Clearance Profiles (Vectors): Defining the acceptable clearance zones for roads and power lines. Linear Reference Data (Polylines): Representing the road edges or power line geometry.Workflow Goal:The objective is to identify and classify obstacles within the pre-defined clearance profiles. This involves:Spatial Analysis: Identify point cloud data falling within the designated clearance profiles. Obstacle Classification: Classify the identified points as potential obstacles. Obstacle Dimensioning: Measure the dimensions of the classified obstacles.Risk Assessment Output:Based on the identified obstacles, we aim to g
Hi.I’ve encountered this before, but now it blocks the saving of a 28K large table, and is so no more a mere nuisance.It seems that FME fails to catch that SQL statements fails typically due to constraints in the database. FME happily reports that all posts were saved, although none were in this case.My latest error message from the log file looks like this:Microsoft SQL Server Spatial Writer: Failed to write a feature of type `VEJLE_GADELYS.Elledning' to the database. Provider error `(-2147217873) The INSERT statement conflicted with the FOREIGN KEY constraint ...Because FME fails to catch these errors, and thus not failing in the automation, we’re putting invalid datasets into production.This is bad.
I have two questions about hosting on the FME Flow Hosted ServiceThe first is, when the Cloud Flow is offline, is it possible to show another page or change the standard offline page? I am trying to save some costs to run the Cloud instance for only certain hours, and it would be nice to give users feedback, which informs them of the times the service is live.The second is,how can I use my own domain for the Flow Cloud Hosting? I would like to change it for pure simplicity and because it avoids confusion to users who don't know what fme is. Is there simple ways to change these two things, any help would appreciated, or links on how to achieve this. RegardsFred
Event Description: Error was recorded in fmeserver.log file.Event Title: Error LogsMessage: Failed to register FME Engine. This also keeps on repeating:Event Description: Error was recorded in fmeserver.log file.Event Title: Error LogsMessage: FME Server license does not allow more than maximum of 1 FME Engine(s).
Hi All,First, I am an ArcGIS Pro/Enterprise user with the “Data Interoperability Extension” for both Pro and Enterprise. I do not believe that I have access to FME Flow (Server).My installs on the server are ArcGIS Portal/Server and Data Interoperability at v11.3 - which installs FME…Edition: Data Interoperability, Fixed OEM LicenseVersion: FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)I want to automate a Spatial ETL tool that reads GeoJSON from a URL and ends up writing the results to an ArcGIS Online Feature Service. I thought, why not just do it on the server and skip the exporting/importing the Web Connection from my laptop to the server? (from reading Schedule Spatial ETL tools on a server—ArcGIS Data Interoperability | Documentation for ArcGIS Enterprise) When I created the workspace on the server with FME Workbench, everything seemed fine. I could insert an Esri ArcGIS Online (AGOL) Feature Service writer and connect to the feature service that I wanted to write to.But
We have FME Flow 2023.2.1 installed, we have chosen PostgreSQL running in AWS RDS as our database. This has been setup and configured at installation using the silent Windows installation method.We are seeing vulnerabilities on the server FME Flow is installed on relating to Microsoft OLE DB Driver. This seems to have been installed as part of FME Flow. Is the Microsoft OLE DB Driver a required driver if we’re not using SQL Server?If so, can this be removed or do we now need to manage patching of this driver?
Hello,I am submitting job through my FME api and not keeping job id in application, Though I want to check status of my job through Published parameer which is always unique.I know we can get all jobs and then we can do filtering but it will bit costly operation hence I dont want to do that.How to track Submitted job status with Published parameter? (Eg: I am supplying “batchId” as published parameter and want to track job status based on my that batchid only)
Hey everyone, On FME Server (2021.2.6) I have resources that I want to make available on an HTML page. I want users to be able click on the link and immediately download the data that's in the resource folder: https://fmeserver.EXAMPLE.com/fmeserver/#/resources/browse/FME_SHAREDRESOURCE_DATA/EXAMPLE?name=Data Seems like a pretty standard deal.
Hi,Just a quick question about this scenario:we are going to send an Email from an Automation in the case that a translation fails. To populate the body of this Email we can use several parameters (workspace name, automation name, repository name, job id, start and end time of the job, etc.). Now we would also like to add the URL of the FME Flow server to the Email body.Why? Two reasons:We have got 4 different FME Flow environments - D, T, A & Production - and we want the server who sends the email to identify itself It would be cool to add a hyperlink to the job log to the Email body and with the URL and the Job ID we would be able to compile such a linkSo, the question is: would this be possible? Where and how could we retrieve this URL? It is not a parameter in the list provided, as far as I know.Any ideas would be greatly appreciated.TIA,Egge-Jan
Hi all,I have a workbench which has a parameter that asks for a .ZIP file for input.Specifying extension filters works in workbench - user can only add/view files with an extension “.ZIP”When i publish this to FME Flow, and create a flow app, the extension filters are ignored and the user can select/view any file of any type.Bug?Using FME 2023.2.0.0.FME Flow 2023.2, Build 23747 - win64thanks
We have a domain account setup to run the 3 services required for FME Server 2022 to function. My question is simple, does this account need to be apart of the Administrators group?
Hi All,I am getting this error when i open FME Workbench and I am not sure what to do at this point this was working for me. I am no longer able to connect to my FME Flow established connection. 2024-05-30 11:14:36| | |WARN |SQL Query UPDATE fme_nc_namedconnections set connectiontype = connectiontype WHERE fme_nc_namedconnections.ncid = ? failed. Error: attempt to write a readonly database
Is it possible to construct an FME Flow/Server (I currently have Server 2022.2) process that can monitor an Esri Enterprise (10.8.1) hosted layer? We are trying to build something that notifies particular people when changes are made. ThanksCarl
I have an automation with several workspaces in series, the last one taking results from the previous and sending them as a series of API requests to a software. general outlinethe software has an antiforgery token that has to first be requested, then updated, so the final POST ends up being the 4th HTTP Caller. API Call WorkspaceThe problem i’m having is slowing down the rate at which concurrent API calls are happening, so if multiple requests hit at approximately the same time, one of them will fail due to not receiving a new antiforgery token.High priority has a second engine assigned only to it, and this is the only workspace that utilizes that job queueRetry Settingsi have added a queue to the workspace runner, with it’s own engine, I also added a decelerator to the beginning of the workspace with a 20 second delay in the hopes that the “first” API workspace would complete before the second one started, but, so far it has not been effective. when it fails, it fails with an empty
Can anyone help me, I am going to build an indoor 3D model in FME through CAD floor plan, when I import the CAD drawing into FME and execute the stretch command, open the inspector I find the coordinates, and find that the values related to the coordinates are all 0, and the coordinate system is also the location, in addition, after finally converting the CAD file to CityGml format, I opened it with Notepad and found that it was all null values, how to solve it
Hello!i have an URL from a WebSocket API:wss://[IP]/api/v1/devices/[DEVICE_ID]/readings/socket?auth=[KEY]The output is a json.In the documentation of the WebSocket API is no port mentioned. I only have the URL above - that's it.Is it possible to use the trigger "WebSocket Message (received)" (Automation in FME Flow) with this URL to constantly receive data? What exactly is the stream ID in this context?Or is this the wrong way?Sorry, i'm new to this and i can't find any up-to-date guidance which gets me on the right track.We are using FME Flow 2023.2.2.Thank you very much in advance!
Hello,I am performing a data stream in FME Flow that reads two independent datasets with the same schema from the BC Wildfire Service’s (BCWS) Public ArcGIS Online Feature Service. These datasets are the BCWS current fires found on their Wildfire Dashboard:Known fire start locations (points) Wildfire perimeters (polygons)What my data stream does:(Read) Read both points and polygons of current wildfires, also read a previous copy of both datasets merged as a PostGIS table → (FeatureJoiner) Join and overwrite points where polygons exist → (ChangeDetector) Detect major changes from the PostGIS table: point-to-polygon updates, polygon area increases, and fire status indicators → (Write) Write all changes to the saved copy in PostGIS, and write the major changes to a PostgreSQL update logging table.This workflow runs fine when performed manually. However I noticed when I apply the workbench to run as a data stream, my logging table will go crazy every once in a while and log every featur
I have set up a project in our test environment containing two workspaces in a repository, a workspace app and an automation. Workspaces use a resource\data subfolder. The automation writes data to a database through a database connection. All this is set up with my admin account.When I try to export the project to move to our production environment I get the error: “Exporting the project is not permitted. This project contains items that don't exist or are inaccessible by you.”In the project I have added the automation, connection, repository, resource path and workspace app, 5 items in total. I have verified that the resource\data path is migrateable as per the first note here: https://docs.safe.com/fme/html/FME-Flow/WebUI/Exporting-Importing-Projects.htmAny tips on why I am not allowed to export? The items defined in the project all exists and as an admin I have access to all items...
I am making a self service map generator workspace app. My want is to be able to verify a username by using either SSO/Windows authentication. then I have a script that has outputted all the groups and its users in our ArcPortal in a spreadsheet. so I can relate their username to the group they’re in which then I’ll use a testfilter as to what layers each group is allowed to use in their map. Unless there’s an easier way to go about this?
Y’all.I thought it was possible to export a single automation, and install it on another server ?But now I can’t seem to find this feature anywhere (on 2022.6).They’re backed up in the general configuration backup, but you can’t restore parts like a single automations from a backup.Am I missing something ? What to do ?Cheers.
Hi - We recently set up a new server for fmeflow for a test environment. As the jobs are running, fme flow is opening source files like csv files or trying to create a new directory on the old server. The old server has the FME services turned off but it still seems like it’s reading from the old server with the old server folder path for the source location. The path of the source file is in the Resources on the new server. I’m afraid once we shutdown the old server completely, the new server with fmeflow is going to fail all the jobs. Is there a setting to change to the new server for all the path locations in Resources or something? Thanks,Eva
Out of curiosity, does anyone know if there is a limit to the number of jobs which can be queued on FME Server/Flow?
HiI am currently looking to create a CityGML model of the buildings in a specific area using various spatial data. I have followed this tutorial Point Cloud to 3D Terrain Model with Buildings and obtained an Adobe 3D PDF model of the buildingsBut I now want to convert this model into a CityGML LOD2 model. Is this possible?Since I have just started using FME and am not very familiar with the software, what should my next steps be? Could you provide some useful references? Thanks for your advice😊
Hello, I want to read AGOL polygon feature service and write in SQL server feature class. Reading is not problem, I can see the geometry but writer is only writing attributes and not geom in SQL.I am using feature writer (SQL Server Spatial) and want to understand how I can write geom in SQL table “GDB_GEOMATTR_DATA” column. Any help is appreciated. TIA
Hi,We cannot get FME to work behind an AWS loadbalancer.Using fme-flow-2024.0.2.1-b24217-linux-x64~ubuntu.22.04.runDeploying FME behind an AWS Application load balancer with a HTTPs listener, works for signing in and browsing https://.../fmeserver/. However, when testing the installation using the following instructions, this error is returned “400 - Bad Request The plain HTTP request was sent to HTTPS port”https://docs.safe.com/fme/html/FME-Flow/AdminGuide/Test-Installation-Linux.htmThe FME server has a security group that only allows HTTP and SSH connections and so connections to port 443 are not possible. The Browser issues two requestshttps://.../fmeapiv4/workspaces/Samples/austinApartments.fmw/encodeparametervalues-> 200https://.../fmeserver/run/form/fmedatadownload/Samples/austinApartments.fmw-> 400 The AWS Application Loadbalancer terminates the HTTPs connection and forwards to FME on HTTP port 80. Nginx receives these requests on HTTPNginx10.xxx.1.144 - - [21/May/2024:09: