Shape the future of FME with your ideas
Open ideas have been reviewed by our Customer Success team and are open for commenting and voting.
I propose that more options be added to the Polling Interval for a Directory Watch Trigger:Allow for the Trigger to check only the hours of Mon - Fri 8a to 5p, or Sat & Sun only, for example. I will suggest adding CRON Expressions if that will achieve what I suggest in #1.
Hi everyone,I think a new action “delay” (like the Decelerator transformer) would be a good addition to automations.My current scenario:Data is inserted into an external system and I need to check via HTTP calls if the external system has processed the data yet. I don’t want to do this check in the main Workspace, since the external system can take between 1 and 30 minutes. I’ve solved this for now using the Workspace Retry in automations. However, this results in a unpleasant Job history, since I need to design the Check-Workspace to run into an error to trigger the retry. A delay would allow me to loop back to a Check-Workspace on my own terms. I’m sure there are plenty more use cases where a delay could be useful. Especially in combination with loops. What do you think?Kind regardsDennis
In our standard FME Flow training course we have one excercise where Workspace A does some checks on user parameters and if they are succesful it runs Workspace B through an FMEFlowJobSubmitter.One of our trainees accidentally set up the FMEFlowJobSubmitter to run Workspace A instead and when he published it to Flow he made a recursive loop: every time Workspace A ran, it queued Workspace A again. I was busy helping somebody else at that time so when I got around to his question I noticed it had ran 17000+ jobs in a matter of minutes. These were low-impact jobs, so it wasn’t an immediate problem, but it’s safe to say that this has the potential of completely overwhelming an FME Flow setup.After talking to Safe we decided to post it as an idea here to see if others have come across this as well or have opinions about it.The big question would be:Should FME be able to detect these recursion risks?And in a broader sense: have you had this happen to you? Or something similar that you think FME should be able to detect and warn you about?
WEBP makes MBTiles a lot smaller than using current options.WEBP is now supported in GDAL writing MBTiles.
I would like to request the reactivation of the Workspace Viewer as it has been marked as obsolete and is no longer available on the platform.This tool was essential for my work, as it facilitated my understanding of the data transformation process and was very useful for debugging and optimizing my workflows.I would like to know if there is any possibility of recovering it or if there is an alternative that I could use.Thank you in advance for your attention
This would be helpful for exposing attributes that are already passed in as a comma separated list for a oslc.select statement and would allow for better encapsulation when creating custom transformers. This would be very similar to the way the AttributeKeeper works.
Using letters that are not in the standard english alphabet is causing issues when running workspaces. To take one exemple, passing a user parameter to a child workspace using WorkspaceRunner, will fail if the parameter contains ie. norwegian letters. “å” becomes “ Ă¥” (unicode \u00E5 ). If the parameter is a file path, child workspace will fail finding the folder/file.A workaround is to manually convert unsupported unicode characters with StringPairReplacer.This is suboptimal for 3 main reasons:Most often we need to handle these characters in inputs and outputs. Non english letters are meaningful, they convey sense for users. Scaling down to an english subset can sometimes create confusion between two similar words that are differentiated with these extra letters. Creating datastructure (and being able to handle these characters in our FME flows) in native language is adding value to our customers.
Like running a workspace normally, it would be nice to have the option to select which service to run the workspace as within an Automation.
As per https://gisgeography.com/arcgis-shapefile-files-types-extensions/ a shapefile is made of a number of manditory and optional files.Shapefile Writers output some of these optional files.In some cases these can cause issues in external/legacy systems.It would be helpful if there was an advanced option in the writer to select what optional files are in/excluded
Apart of those calling web API, dedicated machine learning transformers are currently missing in FME. Pytorch is heavy and requiring gpu while sklearn is also a bit hard to directly set up as transformers (due to the complexity/flexibility of the pipelines). Why not try to leverage the work done on PyCaret? Those standardized steps, while limited compared to a dedicated sklearn pipeline, would streamline simple machine learning operations in FME. If others have ideas on this, don’t hesitate. I think that those are missing blocks in current FME tools.
It seems FME can not read CityJSONSeq (CityJSON Text Sequences)https://www.cityjson.org/cityjsonseq/If you use the reader NDJSON (Newline Delimited JSON) you get the data - however you do not get them converted to CityJSON objects - missing geometry.Any way to do this either with some Transformers in FME or with a dedicated reader?Format described in more details in this article: https://arxiv.org/html/2407.00017v1
Main request:ArcPRO desktop provides option to save a layer symbology to a SD (service definition) file to disk.Can Safe add support > allowing the user to browse to .sd files when they update or publish as a feature service (hosted), FME will use the ArcGIS for Python API to overwrite the symbology styleThis may also be an option to include in the Arcgis online connector transformer, when the use select publish. Secondary requests:LYRX files in ArcPRO as coded in JSON. Perhaps ESRI and Safe can work together to support updating arcgis online styles, where the user can browse to a desktop LYRX file they saved outin QGIS and OGC they have an option to save SLD (styled layer descriptor) files. As a stretch goal, allowing Arcgis to use these for style definition would also assist in data migration projects
Hi, How many of us (and let’s be honest) have mistakenly pressed the stop automation while actually going for the refresh?These two are way to close to each other and with a little change some serious BS&T can be spared from us all…. Itay
Hi,This functionality is great but does not make sense (the way it is now) inside a split merge block.Let say you enable the retry in a split-merge block to try for 3 times before giving up, if it is successful the third time a feature will still come out of the failed port of the split-merge block and ruin you translation.So either disable this functionality in the split-merge block (not preferred) or make is smarter and even if 2 of the 3 retries have failed don’t let any feature go out of the failed port of the split-merge block (preferred)Let make the retry in a split-merge block usable (and great)Itay
In the lists in FME Flow, it’s typically only possible to sort on a few items.It would be a much better interface, if sorting was available for (almost) all columns in the lists.It would also be nice, if one could open especially job logs in separate tabs in the browser.Too much time is wasted clicked back and forth and resetting various settings.Actually, the one-tab approach is in general a bad decision and a time-waster.Is this really a requirement with Java server pages ?
Hi there,There are some resources in the community for visualizing schedules and automations such as:https://support.safe.com/hc/en-us/articles/25407600463245-Create-a-Calendar-for-FME-Server-Scheduleshttps://support.safe.com/hc/en-us/articles/25407670993677-Creating-a-Visual-Calendar-of-Schedules-as-an-FME-Server-DashboardHowever these require additional effort from the end user and in some cases API’s for external services (Google Calendar).I feel like an integrated visual representation of all scheduled tasks in FME would be very valuable to users publishing workspaces, and would help to prevent resource contention and workspace conflicts.Additionally if the user wants to create their own calendar view they have to understand how to process cron job formatting, manage time zones differences, write html and javascript, etc, etc; it is quite complex.Please provide a supported workspace in the FME install that can be run regularly to write to a dashboard that allows us to visualize all schedules in a calendar view, ideally with the ability to zoom to a month, week or day view.
Add to the scheduling screen the ability to view schedules in a calendar view. It would be nice to be able to format it daily/weekly/work week/monthly. It would also be nice to be able to click on an opening in the calendar to start scheduling a new job.Merged Ideas:FME Server Schedule - Ability to identify the schedule(s) that gets executed on by atiul on August 8, 2018***Note from Migration:***Original Title was: FME Server Schedule - Ability to identify the schedule(s) that gets executed on a give time range (future date/time range)It would be great, if FME Server provides an interface that can list out the schedules that get executed during a give time range (future date/time range). This would be helpful to disable the affected schedule(s) during outages (server maintenance activities).
True curves are now supported in ArcGIS Online! Yay! Does SafeFME plan on updating the AGOL feature service reader to work with true curves in the near future? Any insights would be greatly appreciated!
Need a enhancement on AGOL and Enterprise connection to read credentials from secret manager using script and supply it has parameters at run time. This will help save efforts to update password manually.
Hi There, Most of my users do not log into FME Flow and use the apps, it would be very helpful if I can broadcast messages to my users via the FME Flow apps.Cheers,Itay
As a:FME Flow user responsible for monitoring automations that run continuously or on frequent schedules.I want to:Implement rate limiting or batching in the email actions.So that I can:Avoid receiving a flood of emails if an automation encounters repeated errors during overnight or unattended runs. Stay informed about issues without being overwhelmed by redundant notifications. Focus on resolving the underlying issue rather than managing an overflowing inbox.Acceptance Criteria:Have configurable limits that can be set on the email action. I’d like set to thresholds for the maximum number of emails sent within a time period and log when an email is not sent due to this limit. Ideally, we could have some way to batch emails as well- this would be especially helpful for system events.
When attempting to access the text of websites with extra ‘hitches’ / ‘security’, the HTTPCaller doesn't bypass the extra formatting of the website. Example: https://www.ogj.com/general-interest/companies/article/14234505/oasis-petroleum-to-spend-295-million-in-2022?utm_source=OGJ%20DailyHTTPCaller Output: <strong>www.ogj.com</strong> is using a security service for protection against online attacks. The service requires full JavaScript support in order to view this website. </p> <p> Please enable JavaScript on your browser and try again. </p> </div> </div> <style type="text/css"> #loading-content{display: none;}</style> </noscript> </div> <div class="layout__main" id="loading-content"> <p> <strong>www.ogj.com</strong> is using a security service for protection against online attacks. This process is automatic. You will be redirected once the validation is complete. </p>
Hi, In the Homepage of FME Flow, there is a nice dashboard. I would like to be able to adjust the columns, since I would like to see the Repository of the job (and I'm not interested in the 'Source Type’ and 'Ran By’ columns), so it would look like this (forged) screenshot.
Default filename using the DataDownloadservice is : http://fmeserver/fmedatadownload/FME_2D764B0C_1515155526785_73956.zipCreate an FME_SERVER_PARAMETER on FME Desktop like : FME_SERVER_ZIPFILENAME that can override this name if not empty. Then you can easily create a complex output-file based on both published parameters and attributes created during the workspace. For instance in a workspace you have:PUBLISHED PARAMETERStartfilename = "3Dmodels"attribute created within the workspace:timestamp = "20180101"FME_SERVER_ZIPFILENAME = "Startfilename + _ + timestamp"Will give the filename:http://fmeserver/fmedatadownload/3Dmodels_20180101.zipand automatically this will be the downloadlink instead of the default:http://fmeserver/fmedatadownload/FME_2D764B0C_1515155526785_73956.zip
When using the Data Download service on FME Server and clickling on the link the file is immediately dowloaded but the name of the zip file is very generic. There should be a way to edit in the workspace or FME Flow it so if people have multiple workspaces running on data downoad it will be less confusing.
In-depth courses for all FME skill levels.
Explore our extensive collection of how-to guides and tutorials.
Log an issue with us. Our support team is ready to help.
