A space to discuss FME Flow
Recently active
I'm tasked to create a webpage, that will present the user a list (about 15 long) of polygon "things" with unique name. after the user selects a "thing" I will need to generate a list of postal codes that overlap that polygon "thing". The things are temporary, so the list changes in time. I get the feeling that I need to create 2 workspaces, one producing the list of features to be used in the dropdown, then another to process the selected feature. But I'm afraid I might be overthinking this ? surely this is an often-encountered scenario ? I have not found any example using actual data in input parameters, just static enumerations. I'd love to hear which general approach fits my requirement best.Regards, Ronald
HelloI managed to create an automation in FME server and successfully linked the webhook of FME to the Azure Event Grid as shown in the attached snapshot. Currently I just read the event as JSON to the logger. The output is like this:{ "data": { "storageDiagnostics": { "batchId": "c10819b2-b006-00a8-00f0-187e50000000" }, "clientRequestId": "3f49ecb9-a829-406c-948e-d57c85c4104f", "requestId": "a4247e74-601e-005f-0cf0-1854c2000000", "eTag": "0x8D9E70737425603", "contentLength": 17600, "api": "PutBlob", "blobType": "BlockBlob", "contentType": "image/png", "url": "https://fmeserverin.blob.core.windows.net/in-files/augmented-reality.png", "sequencer": "00000000000000000000000000014D700000000001f44698" }, "dataVersion": "", "subject": "/blobServices/default/containers/in-files/blobs/augmented-reality.png", "eventTime": "2022-02-03T11:20:42.751Z", "topic": "/subscriptions/acc9023a-4f9b-447c-b394-8da2c7b9d1f5/resourceGroups/CDEMVP-APP-DEV-RG/provider
We recently upgraded FME Desktop (and also FME Server) from 2021.0.2.0 (b21321) to FME 2021.2.2.0 (b21806). In the past it seemed that the floating licence settings would only have to be configured once (the first time opening FME Desktop), but now users are confronted with a (floating) licence activation screen every 2-3 days or so. It's manageble, but a bit of a nuisance for our FME Desktop users. Has something changed on this front? And if so, is there an option to make sure that the (floating) licences configuration is stored for a longer period of time? Kind regards, Thijs
I have a question that is indirectly related to FME.In short, we have a series of ETL scripts that process data that eventually gets used for FME transformations. These scripts populate a Postgresql database and are scheduled to run on a periodic basis.Occasionally, a script will fail in its processing, leading to some database table to remain locked, for example. Currently we are using the pgadmin tool dashboard to manually detect such events and to resolve them.I was wondering if you are aware of any tool that could be used to automate the monitoring of database sessions, like sending alerts if a query takes longer then "n minutes" to complete. Thanks!Bruno
Hello,I have set up a IMAP publisher to poll one of our inboxes. The idea is for it to trigger a workbench to download and process data when our supplier informs us of an update. When I send a test email which is either blank for in plain text it works, but the supplier emails are HTML and the JSON in the Topic is invalid. The part of the JSON that is invalid is in the imap_publisher_content{0} section. This is the HTML message which I think it treats and JSON so fails when it’s expecting a : or }. Please can you help? Thanks, David
I remember that the number of processes in parallel processing had been determined by "Parallel Processing Level" and the number of CPU cores, in the old days. The attached screenshot is from FME 2017 Help.However, I cannot find the table above anywhere in the documentations for the current version of FME.The table above can be applied to parallel processing with a custom transformer in the current version?
I have an existing workspace that uses 2 feature writers to create a single excel output file. The first feature writer creates the file and writes data, the second feature writer adds additional data to the same file. [Yes, I needed to use 2 feature writers because data is written to the same sheet but in different locations on the sheets.]The target spreadhseet uses a template.I also have a parameter(s) to set the file name- $(tgtFileLoc)\\$(tgtFileName).xlsx If I run the workspace from a server App as a 'job submitter' it works as expected. A single file is created with all the data and the file is renamed. If I run the workspace from a server App as 'data download' I receive a single file with only the information from the second feature writer, the file is not renamed, and the template information is missing. Why was the file not renamed?Why is the template info missing?Why is info from only the second feature writer showing? Thanks.
Hi everyone, I am working with transformer FMEServerJobSubmitter to propagate the information about the files .dbf to PgAdmin table. Previously in the child-workspace we used a WorkspaceRunner and it was showed of the next way: It was something very simple where it just counted with 3 parameters and it used a parameter path_windows because it referenced a file route where the 56 files .dbf were saved and there was no problem because it wrote all the information in the PgAdmin table because it worked in a local way. Now, it is working on FME Server and the transformer WorkspaceRunner was changed to the transformer FMEServerJobSubmitter and they are using the values in the parameters including the path_windows value and when we try to run, it doesn't propagate the information of the 56 .dbf files, it just sends a message of successful in JobSubmiter and the 56 logs that should be created result with status failure. Reviewing the log, I realize that all process works until it execut
I wanted to centralize assignment of Database Connections in my FME Server automations. I currently have a published user parameter on each of my workspaces, connected to the transformers in each workspace, that I can set in each workspace action individually in an automation to switch between databases to load. Each time I want to switch the location I have to change the user parameter on each workspace action in the automation which feels a bit clunky and prone to error if you have many workspace's in an automation. I was wondering is there a way to centralize assignment of Database Connections in the FME Server Automation? I thought perhaps creating a Global Key for the database connection might work but that doesn't look like it's possible. Is there a better way to do this?
Hi, I installed FME Server 2021.2 on a new machine then did a restore with the overwrite option (oops). So I overwrote the Dashboard and Utilities repository workspaces with old versions. Is there somewhere I can download these workspaces? Thank-you, Kathy
Hi together, I am wondering if it is possible to pre-configure the favicon, header and footer section whenever we build a new FME workspace app on FME server. The idea is to replace the generic FME server icon and to replace it with our corporate color(s) + icons and a custom footer (e.g. our contact details) in a way that anytime we create a new workspace we would not have to reapply the color scheme, icons, favicon etc. Is this possible via an out-of-the-box FME server workspace app (e.g. configuring this from the backend on the server machine)? Do you know?Many thanks and kind regards!Ferid
This workbench is run on the server and uses the FME Server email generator. We want it to generate a text which includes the original total records read from 2 separate tables used as input eg 2913 from table 1 and 7429 from table 2the total number of records in the output file geodatabase.We have got it to the point that it automatically fills in the total records from input table 2 but not the other 2 numbers. What could we be doing wrong?
Hi, I see these warnings in some of our logs (FME Server 2021): FME Configuration: Extremely low initial memory conditions detected. To improve stability and performance please increase the memory available to FME. It seems to be random, not correlated to any particular jobs. However, when it happens, it seems to affect two to four jobs in a row - I don't have many jobs yet (recent installation), so this might be a coincidence. On the bright side, it doesn't seem to prevent the jobs from finishing. After reading a few articles, I see a few points I suspect I could look into: FME Server configuration - specifically, MAX_TRANSACTION_RESULT_SUCCESSES and MAX_TRANSACTION_RESULT_FAILURES. We have the default values at this moment (100 and 10).Memory parameters - in the examples I see "Start freeing memory when the process exceeds 71.99 GB". In our system we see much lower values, e.g., "Start freeing memory when the process exceeds 2.83 GB or address space exceeds 3.4
Hello. my script in Workbench provides nicely zipped result from FeatureWriter. one excel sheet and one shapefile, named using User Parameter ("someID") When I publish this to FME Cloud, the structure of resulting zipped is completely mangled, and the user attribute value is not provided to the final file names (SomeID is fallback default value)(picture shows the flat view, each zip is in one of those folders) Can this be fixed so the result output of Cloud workflow has the same structure as the Workbench result? if I set the publish parameters in following way, the final zip file contains only one of the result files, either SHP or XLS
Hi list.We're still running FME Server 2020.2.5, and now our IT department is fuzzing over questioning the version of Tomcat that runs FME Server. Something with potential vulnerabilities.Is it possible to update this Tomcat without updating FME Server itself ?If so, what are the caveats ?Cheers
Currently running FME Server on Windows Server 2019. The Windows server is being handicapped by high CPU usage by the FMEWebSocket java process. Please see the screenshot attached.
For a couple minutes a few days ago one of my scheduled workbenches on 2021 FME Server sent over 1000 emails in error. It hasn't done it since. It uses the emailer transformer to inform user of changes to data. Does anyone know what would cause this and what log file to look in to see what was going on? I looked through all of them and couldn't find anything. It could be a Windows Server issue but I need to rule out FME as a cause/prevent it from happening again.
I want to install FME Server 2021.2.2 on CentOS 7.9 offline. When I run the installer, after answering all the questions and waiting 5 minutes, i get an error saying : "no package postgresql11-server available". I tried to install the rpm of postgresql11-server, postgresql11 and postgresql11-lib but now i have a second error, more instantany, saying "Postgres is already installed on this system. If you would like to use the existing Postgres with FME Server, see https://docs.safe.com/fme2021.2/html/FME_Server_Documentation/AdminGuide/Configure-FME-Server-Database-on-Separate_Server-2-Tier.htmOtherwise please uninstall postgres and rerun this installation". Could you please help me to resolve this problem ?
Hey everyone. Our company rented server (Windows Server 2016) where we've got ArcGiS Server (Enterprise) + FME Server. And some FME jobs (workbenches) using FME SDE Readers. So reades takes some vector objects from SDE base and then make some transformations with them. And all works fine. Week ago we are migrated to another server. So we are reinstall ArcGiS Enterprise (+ restore backups) and then reinstall FME server (+restore backups too). All jobs working fine except those, which are using FeatureReader "Esri Geodatabase (ArcSDE Geodb)". Is some reason when I'm tried to start jobs I've got an error 74 2022-1-12 18:57:56 | Creating reader for format: Esri Geodatabase (ArcSDE Geodb)75 2022-1-12 18:57:56 | Trying to find a DYNAMIC plugin for reader named `GEODATABASE_SDE'76 2022-1-12 18:57:56 | Loaded module 'GEODATABASE_SDE' from file 'C:\Program Files\FMEServer\Server\fme\GEODATABASE9.dll'77 2022-1-12 18:57:56 | FME API version of module 'GEODATABASE_SDE' matches current internal ver
Hi. I have a folder name PLAN. In the folder PLAN i have a lot of subfolders (B53, B54, B89, etc..). More then 500. In each subfolder (b55 for example) i have a subfolder name TERRITOIRE (PLAN/B54/TERRITOIRE, PLAN/B109/TERRITOIRE), and also other folders with other name. I want copy TERRITOIRE subfolder from each subfolder in a new folder with the name of subfolder.NEWFOLDER/B56/ TERRITOIRENEWFOLDER/B55/TERRITOIRE. Thank for help.
The result of my workspace is several geojson files. For usability purposes, I want to include a fixed template .qgz file which is already on the server in the zip, so end users can immediately open it in QGis.However, I can't find a way to get this to work with the Data Download service.As a proof of concept, I created a minimal example that just loads a binary file, and writes it again. However, the AttributeFileWriter can't be selected as a Writer output for the Data Download service. Is there another way to include arbitrary binary files with data download?
I am very new to the FME tool, I downloaded it to change my LAZ files to LAS. I have gone through a few tutorials, and my output is not empty. I have LAS point elevations, but visually it is empty. I have a big reg square, representing the outline of the LAZ tile I downloaded, located in the correct place on earth. There is nothing in the red square. Where do I go from here?
We are using a VIP (Virtual IP) for LDAPS and DNS request and I wanted to know if someone had implemented SSO with FME using a VIP for DNS and LDAPS.We are facing an issue that when we are using the VIP in the configuration of FME server, the KDC attempt fail.
Hi, I finally managed to install my FME Server on a linux server without internet access (RedHat 7.1) on a distributed mode and the 2tier architecture. Allow me to say it was really not my best experience to say the least..Now I want to install a new fme-engine on the same machine but it looks like I have no choice upon the install directory. Am my missing something here ?We have plenty of space in the destination directory (/var/opt/data/...) with a symbolic link in /opt that points to the right place.Unfortunately the installer wants more free space in /opt which we don't have.Anyone have an idea on a way to install an fme-engine in a specific directory ?Thanks in advance
Hi list.I have a job being submitted multiple times, although I've added a sampler of "first 1" before the serverjobsubmitter (just in case). Is there a way to see, which process (job) that launched the jobs in question ?Cheers