- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Search

Recently active posts

280 Posts

Most replies

Most views

antoineContributor

Machine learning : Pycaret transformersNew

Apart of those calling web API, dedicated machine learning transformers are currently missing in FME. Pytorch is heavy and requiring gpu while sklearn is also a bit hard to directly set up as transformers (due to the complexity/flexibility of the pipelines). Why not try to leverage the work done on PyCaret? Those standardized steps, while limited compared to a dedicated sklearn pipeline, would streamline simple machine learning operations in FME. If others have ideas on this, don’t hesitate. I think that those are missing blocks in current FME tools.

4 days ago

tfn_wv

asked in Integration

Oauth 2.0 token ESRI - not refreshing the token

Dear community, I have implemented a workflow with FME and ArcGIS Enterprise, in which an automation is triggered in FME via a referenced feature service with a webhook. Based on the entries in the ArcGIS Field Maps App, an e-mail is then to be sent via FME.This is set up accordingly according to the following documentation: https://support.safe.com/hc/en-us/articles/25407414850061-Integrating-ArcGIS-Enterprise-Feature-Service-Webhooks-With-FME The connection from the application in ArcGIS Enterprise to FME is also set up accordingly: https://support.safe.com/hc/en-us/articles/25407772142733-How-to-Create-an-ArcGIS-Enterprise-Portal-Web-Connection-OAuth-2-0 The problem that arose is that the OAuth refresh token created in ArcGIS Enterprise has a default lifetime of 2 weeks and I therefore have to authorize myself every 2 weeks (see https://enterprise.arcgis.com/de/portal/latest/administer/windows/specify-the-default-token-expiration-time.htm).Based on this community entry: https://comm

402

4 days ago

davtorghContributor

asked in Authoring

Dynamic Excel Writer loses font settings

Hi,when writing using a dynamic Excel Writer (in my case there are no columns defined at design time - see attached screenshot), the font settings get lost in the output file and also in the Feature Type Writer itselfs when I double-check it.Has anyone solved this issue?Thanks!

302

4 days ago

siennaatsafeSafer

Add Option To Rate Limit Emails Sent In An AutomationNew

As a:FME Flow user responsible for monitoring automations that run continuously or on frequent schedules.I want to:Implement rate limiting or batching in the email actions.So that I can:Avoid receiving a flood of emails if an automation encounters repeated errors during overnight or unattended runs. Stay informed about issues without being overwhelmed by redundant notifications. Focus on resolving the underlying issue rather than managing an overflowing inbox.Acceptance Criteria:Have configurable limits that can be set on the email action. I’d like set to thresholds for the maximum number of emails sent within a time period and log when an email is not sent due to this limit. Ideally, we could have some way to batch emails as well.

180

5 days ago

fmelizardContributor

asked in FME Hub Alerts

RangeNormalizer

FME Hub user mark2atsafe just uploaded a new transformer to the FME Hub.This transformer fits a range of numbers into a different range (or scale), in a process called Normalization (specifically Unity Based Normalization), or Min-Max Feature Scaling.Input PortsInput: Incoming data. Values to be normalized must be numeric. Features with non-numeric values will be rejected and the results calculated from the remaining records.Output PortsOutput: The outgoing data with the result in a new attribute called _NormalizedValueRejected: Any features rejected by the process.Feature order is unaffected by any processes in this transformer.ParametersAttribute to Normalize: The attribute containing the values to be normalized.New Scale Minimum: The minimum value for the new scaleNew Scale Maximum: The maximum value for the new scaleExampleThe area of each country in the world is calculated and passed to the transformer.The area value is the attribute to be normalized. The new scale minimum is set

5 days ago

danielleatsafeSafer

posted in Question of the Week

Question of the Week: What’s in Your FME Community Year-End Recap?

How did you engage with the FME Community in 2024?Now you can find out with your 2024 FME Community End-of-Year Recap! Built by @mark2atsafe, the recap page is powered by FME and integrates it with the same type of custom community pages as the 12 Days of FME Contest.Check out your personalized stats here, including:Questions Asked & Answered Votes on Your Questions Your Most Upvoted Question Categories You Contributed To Events You Attended General Stats for the FME CommunityYou must be logged in to see your stats - otherwise, you’ll get a fun look at the FME Lizard’s activity instead. See how you compare!For this week’s Question of the Week: Share some highlights from your 2024 recap in the comments below.Thank you for being part of the FME Community in 2024! We hope you found it valuable and inspiring, and we can't wait to see what you do in 2025.

16213

5 days ago

ohashkiiContributor

asked in Transformers

Grouping in FME

HiI am having an excel sheet like below. I need to group them in Field name route and assign a value for route field .let's say (routeNo) or any other unique value.the grouping is based on finding a value that is considerable above of other previous records below is 48. which is very big than other previous ones.Any help is highly considered. Route 1Route 2

823

5 days ago

nordpilContributor

Desktop alert when FME Form finished processingOpen

A fair bit of time working with FME Form is waiting, while you run your workbench to test and develop. To improve my productivity, wouldn't it be neat if I could get a little alert/notification when the workspace is finished? There are various hacks one can implement to work around - I solved it this way:https://gist.github.com/fraxen/ccca53cb496864123c82c7abdd4e12ee...but it would be neat if it was built in and did not require dirty hacks… :)

1376

5 days ago

fmelizardContributor

Desktop notification when workspace completedArchived

It would be nice to have a desktop notification occur when a workspace has completed running in FME Desktop. That way when a large workspace is running I can navigate away and work on something else until I see the notification without having to go back and check.

335

5 days ago

louielou1234Contributor

asked in Authoring

How to delete (shape)files from a folder

Overwritting .shp files gives mixed results so my workaround is to delete the .shp file(s) first and then create the new version. But I can not figure out how to do that --I read somewhere that writers have a ‘delete’ setting for the ‘fme_db_operation’ parameter but I can not locate that anywhere. Can anybody tell me if FME has the ability to delete the .shp files in a folder? Thanks! Lewis

413

5 days ago

geomancerEvangelist

asked in Deployment

Alternative for external stylesheet?

HTML Pages created with FME use an external stylesheet:<html> <head> <title>Report</title> <meta charset="UTF-8"> <link href="https://cdn.jsdelivr.net/npm/bootstrap@4.5.3/dist/css/bootstrap.min.css" rel="stylesheet"> </head> <body> ...... </body></html>This is somewhat of a problem when FME Flow has no access to this location, as HTML pages displayed from FME Flow Apps in that case will show without this stylesheet, thus maiming the layout.Are there alternatives for using this external stylesheet, like placing a copy of it somewhere on the FME Flow machine? Then the <head> of the HTML page could point to this local stylesheet.The stylesheet contains a lot of information, so adding the contents of the stylesheet to the header of the HTML file does not look like a viable option.

192

5 days ago

mcsjoParticipant

Hyperlinking within workspaces for improved efficiencyNew

At our workplace, we heavily rely on templates and standards when working with FME Desktop/FME Form to streamline the development and management of workspaces by multiple administrators. However, many of our workspaces are large and complex, making it challenging to navigate and understand them at a glance, especially for new or less experienced users.To address this, it would be incredibly useful if we could create hyperlinks within the workspace. For example, hyperlinks could be added in annotations that are tied to specific transformers/bookmarks etc. (see attached example image). Clicking on the name of a transformer (e.g., "AttributeExposer_2") in the annotation would take the user directly to that transformer in the workspace view. This feature would allow us to:Simplify the visual layout of workspaces by reducing clutter (e.g., hiding connections while still maintaining clear logical flow). Save significant time by making navigation within large, complex workspaces much more int

300

5 days ago

r_hueskenContributor

Customize columns in Job Overview on FME Flow homepageNew

Hi, In the Homepage of FME Flow, there is a nice dashboard. I would like to be able to adjust the columns, since I would like to see the Repository of the job (and I'm not interested in the 'Source Type’ and 'Ran By’ columns), so it would look like this (forged) screenshot.

5 days ago

johannafalk1Contributor

asked in Automation

REST API Cannot upload files

Hello community,I am currently facing problems uploading files to FME Flow. Previously I was handling this with a “FMEFlowResourceConnector”. One of our instances was now updated to version FME Flow 2024.2 (Build 24783 - win64).As the transformer “FMEFlowResourceConnector” was deprecated in FME 2024.1.0 (and it anyway refused to work with the transformer) I tried to go directly through the Flow REST API with a POST request. My request:/fmerest/v3/resources/connections/{connection}/filesys/{path}In my concrete example:/fmerest/v3/resources/connections/FME_SHAREDRESOURCE_DATA/filesys/Test I get this as a response:"message": "Error communicating with FME Flow host XXXXXX.\nContact your FME Flow administrator who can investigate the log files for further details.\nAlso see: http://fme.ly/e100007#error-communicating-with-fme-server-hostConnection refused: connect" However, when I try the same approach on my local installed Flow (same version), it works using this POST request. Does anyone h

120

5 days ago

davethebraveContributor

asked in Authoring

Hi all I am trying to compare two databases which contain similar and different geometry files. I am trying to figure out which geometry's are the same and which are unique to each database. A few big issues I have is the complex of the geometry and even the SAME geometry's has been captured slightly differently; even thou it's of the same area.I also have no data to help identify which geometry's are the same.Example of 2 similar complex geometry's - zoom in to show compilation differencesI am currently struggling to figure the best solution to my problem, the geometry can be complex with donuts and multiple areas representing the “same” geometry. I can't find the sweat when I simplify the data enough to get a match and not corrupt the data too much that everything matches. I have added two SHAPE file, containing 7 Features each, with 6 that should match and 1 that should not.Any help or ideas would be appreciated

11612

5 days ago

SagitAtSafeSafer

FME 2024.2 - Feature Highlights

FME 2024.2 is here, delivering powerful new features that enhance your data integration experience. The improved Quick Add now offers smarter, faster search results with a refined algorithm that boosts accuracy and ease of use. Strengthen your security with support for encrypted deployment parameter passwords, and discover a revamped Examples Gallery designed to inspire and accelerate your workflows. Plus, stay tuned for a deep dive into the upcoming FME Hub redesign. This redesign will make it easier than ever to find verified, high-quality content, ensuring you get the best resources FME Hub is committed to delivering.Feature HighlightsImproved Quick Add: The Quick Add dialog in FME Workbench is now powered by a new search algorithm, with results sorted by relevance by default. Improving search accuracy by handling mistyped terms, expanding keyword matches, and suggesting related transformers makes it easier to find exactly what you're looking for. Paired with the filters feature (in

17688

5 days ago

rob_m_esriukContributor

asked in Architecture

FME server doesn't create log for failed workbench

We have a server running many jobs and one of them normally runs successfully and a log can be reviewed but at other times the job fails and when i access it i get the message Error: The log file for job ID "######" does not exist.I’ve seen the post in FME Server 2019 Error: The log file for job ID "2613" does not exist and we have plenty of disk space, the job frequently works successfully, other jobs are still creating log files. I’ve checked all the suggestions in that post.The failed job is recorded as running for a couple of seconds but without the log I have no insight into why it is failing

1609

5 days ago

mariakaContributor

asked in Data

3D object appears transparent

IssueI have several 3D objects (coming from IFC) with variable appearance styles. In one case the style seems transparent. Both in FME inspector and in the final writer (Cesium3DTiles) these objects are kind of transparent.(see feature informations in annex)the dark-red “wall” seems transparant by contrast with the two parts ontopWhat I did so farChanged/Reset appearance (AppearanceSetter) → no effect checked on Geometry (GeometryValidator, VertexNormalGenerator, GeometryRefiner, etc) → no effectQuestionsHow can I make the transparent objects opaque? What’s the difference to the other objects?

383

5 days ago

mferwerda3Contributor

asked in Authoring

HDFS FME 2024

I am getting this error with the HDF connector, it seems imp was removed in 3.12 which ships with FME 2024, it seems IMP is deprecated in python 3.12 that ships with FME, would a repoint to a custom python interpreter of 3.11 fix this issue ? or any other thoughts 2025-1-21 12:20:37 | Message Type: fme::internal::_v0::py::Exception 59 2025-1-21 12:20:37 | Python Exception <ModuleNotFoundError>: No module named 'imp' 60 2025-1-21 12:20:37 | PythonFactory failed to load python symbol `hdfsconnector.hdfsConnector.HDFSConnectorFactory'. An outdated FME packaged transformer may be in use. Please check Tools > FME Options > FME Packages to confirm that all FME Packages are up to date

161

6 days ago

sworkmanContributor

asked in Data

Split list by keyword to individual lists.Or something??

Hello, I have a pdf report that I need to parse out. I can read it and create a line by line list. It has a line with employee code/name, then subsequent lines with codes and their values associated to the employee. Here is a sample of the report and then what it looks like when it is read in. I can get it split nicely into rows/columns/attributes no problem. My issue is that I dont know how to break it up in each employees portion and add the employee number to each row.There would be a few hundred employees. So in the end I want to be able to spit out a table that has the columns:Employee num, Code, Description, units, extensions,etc I am very new to FME and just struggling to get it figured out. I dont know if I should be using some kind of loop, python code, aggreator etc. Any help would be greatly appreciated!

502

6 days ago

arenscottContributor

asked in Authoring

Classifying polygon by shape

Hi all, I’d like to classify polygons by shape, these might include: pie shaped, L shaped, T shaped.I was originally thinking that I’d have to convert them to raster and use some sort of supervised classification. Another method might be to convert them to centerlines and compare their linework: a T shape polygon would have 1 or 2 lines at the top, meeting at 90degrees to another line point downwards

425

6 days ago

nathanherzogContributor

asked in Automation

Copy email attachments from FME Flow Resource folder to UNC network path

The trigger is an incoming IMAP email with potentially more than one attachment. I wasn’t able to use the “Send Event As JSON” option because the email body is being delivered as HTML which fouls up the JSON parser in FME Flow. So I’m sending individual components of the email to a workbench+From:{email.from}+Subject:{email.subject}+Sent:{email.sent}+BodyType:{email.contentType}+Attachments:{email.attachments}+Body:{email.body} I’m splitting up the individual sections of the delivered data in the workbench using StringSearchers with Regex. I wind up with a string with the location that email attachments have been saved to in Flow, which is something like this:$(FME_SHAREDRESOURCE_TEMP)20250121124721-IMAP_Email_Testing-FW_Attachment_test-98e024d4-2316-4cd5-9905-1eb756d02a09I’ve been struggling with what to do with this string in order to access the attachments to save them somewhere on the network. The ultimate goal is to have the inbound email trigger a workbench that automatically cre

6 days ago

oliver.morrisContributor

DuckDB new version supportOpen

Can the next version of FME please support the latest release of DuckDB - We released DuckDB v1.1.0. This now supports spatial support for geoparquet natively. Thanks

422

6 days ago

ebygommInfluencer

asked in Automation

Jobs submitted via automation go to job queue intermittently

FME Flow 2024.1 Build 24612 - distributed setupI’m raising with Safe but if anyone has any bright ideas before Vancouver wakes up :-)Recently upgraded our pre-production environment to the above version. Noticed an issue however with some jobs getting stuck in a queued state and never moving on. The jobs are triggered by automation that runs every 10 minutes and assigns the jobs to a specific queue which in turn has two engines available. Sometimes the job gets submitted and runs successfully, sometimes the job gets put in a queue where it remains forever. e.g. the job triggered at 11:20 was processed successfully, the job triggered at 11:30 ended up in the queue, the job triggered at 11:40 was processed as expected The automation log (running in debug mode) doesn’t show any errors or warnings, the queued jobs show as submitted but with no other information Other perhaps relevant information, the jobs should also expire once in the queue beyond a certain length of time and that is not

121

6 days ago

9valContributor

posted in Authoring

Adding PrimaryKey (PostgreSQL PostGIS database) - Best Practices

Hello all, I would like to create a simple FME workspace in which PostGIS writer automatically reads attributes from the reader and adds an attribute with PrimaryKey (there are 30+ feature types in total). Is it possible to do it somehow? I have seen and tested this method:postgresql - FME PostGIS writer define column as serial/PrimaryKey with pre-existing id values - Geographic Information Systems Stack ExchangeHowever, the goal is to set up a straightforward process with automatic attribute definition. I would really appreciate it if you could share what methods you use.

281

6 days ago

Page 3 / 12

Badge winners

kimohas earned the badge Community Engagement Day
User15958810874244398630has earned the badge Welcome Back
whichwayisnorthhas earned the badge Community Engagement Day
j.botterillhas earned the badge Community Engagement Day
apence231has earned the badge FME Certified Professional

Show all badges

30,536: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.