Shape the future of FME with your ideas
Open ideas have been reviewed by our Product Management and are open for commenting and voting.
In stead of typing in the right attribute value in de tester parameters, one should be able to select the attribute value from a populated unique values list for a specific field. This option would be the equivalent of the Arcmap "Get unique values" button in the select by attribute dialog box and has two major advantages for more complicated attribute values:- selecting is faster then typing in- selecting decreases the chance of typing errors to 0.
Cross-Chain Message Passing (XCMP) scheme is a subset of the Polkadot protocol. It defines how messages can be passed among parachains with no additional trust assumptions beyond the economic security of the relay chain.The XCMP scheme achieves the following properties:Trustlessness Since the same set of validators secure one parachain as another while they also guarantee correct message passing, XCMP requires no more trust than a single blockchain would.Consistency We provide absolute guarantee that the messages received were exactly those sent, even despite any chain reorgs.Availability Polkadot guarantees that the messages will not be lost and are kept available. This is achieved by distributing erasure-coded pieces that can be used to reconstruct messages.Maintaining the right ordering for messages output by parachain blocks is guaranteed by Input/Output validation.Efficiency The protocol avoids too much bandwidth overhead and allows messages to arrive as quickly as possible.Here is a little bit more information:https://research.web3.foundation/en/latest/polkadot/networking/4-xcmp.html# https://medium.com/web3foundation/polkadots-messaging-scheme-b1ec560908b7 This would allow FME to talk with blockchain technology create parachains that could tie into spatial data.
I would like to write out all file properties such as Version, Status and State etc not just the output attributes available under List
I often find myself needing to do certain things on list members such as removing or extracting the first/last element, or extracting/removing the nth elementh, reversing the list, etc. It would be great to have a transformer that allows these types of operations so you can manipulate list data easily (spoken by someone that doesn't do Python for a living!). I have also found one of @takashi's custom transformers (ListSampler) that is sometimes useful, but doesn't have the options I use most in the Sampler such as "Last Nth Element", which would be a great workaround to drop the last element in a list by picking the unsampled output. Thanks!
I'm just going to put this out there:Takashi needs his own badge. A badge or a statue - whichever one is easier.Ed
FME Server Automations provide the ability to set most workspace parameters via Global Keys but date/time parameter values are not supported. There is no option to select a Global Key as a value for workspace date/time parameters and the parameter value must be set individually for each workspace in the automation.Please add support for date/time values as Global Keys in FME Server Automations.
It would be helpful to have the ability to schedule jobs to repeat on a monthly basis. We recently got an FME Server license and I had planned to move our FME job runs from Windows Task Scheduler to the FME Server Scheduler. However, one of the jobs needs to run on the 7th of every month. But the longest time unit (in the FME Scheduler) for repeat scheduling is "Days". So I think this job will have to stay in Task Scheduler, unless we do some customizing. It would be nice if "Months" was added to the drop-down.
Sieving is removing clumps of contiguous cells in a categorical raster that are less than a threshold tolerance (number of pixels). The replacement pixel value can be one of NoData, default value, majority filter, value of largest neighboring clump, depending on what algorithm is used.This is used to clean up noise in categorical rasters without contaminating the boundaries of 'good' pixels the way a simple majority filter would.GDAL already has an implementation:https://gdal.org/api/gdal_alg.html#_CPPv415GDALSieveFilter15GDALRasterBandH15GDALRasterBandH15GDALRasterBandHiiPPc16GDALProgressFuncPv as does R:https://www.rdocumentation.org/packages/bfastSpatial/versions/0.6.2/topics/areaSieve as well as various python packages:ex. https://rasterio.readthedocs.io/en/latest/api/rasterio.features.html#rasterio.features.sieve but it would be nice to have a native FME version.
In order to test FME you can use python and fmeobjects. You can inject a certain geometry with specific attributes with just a few lines of python code, and of course we can run it using the behave library or your favorite test framework. In the following example, we check the geometry if it has a Z value, and if this Z value is between certain boundaries. The following example is in dutch, but should be fairly readable for non native speakers. check_punt_geometry.feature # language: nl Functionaliteit: Check punt geometrie Afsluitmiddel Punten (punt x,y,z) liggen tussen de drempel waardes en hebben 3 dimmensies Scenario: Afsluitmiddel punt heeft geen Z-waarde Gegeven de testset bevat "CHECK_3D_POINT" En heeft de volgende geometrie """ POINT (10 20) """ En de drempel waardes voor Z liggen tussen 7 en 300 En het attribuut "meta_feature_type" is "Afsluitmiddel" En het attribuut "OBJECTID" is "55017666" Als de check uitgevoerd wordt voor Afsluitmiddel Dan staat de volgende melding in het log bestand """ WARN | Afsluitmiddel (ObjectID: 55017666) heeft geen Z waarde. #1005 """ Scenario: Afsluitmiddel punt heeft een geometrie met een Z waarde tussen de drempel waardes Gegeven de testset bevat "CHECK_3D_POINT" En heeft de volgende geometrie """ POINT Z (10 20 30) """ En de drempel waardes voor Z liggen tussen 7 en 300 En het attribuut "meta_feature_type" is "Afsluitmiddel" En het attribuut "OBJECTID" is "55017666" Als de check uitgevoerd wordt voor Afsluitmiddel Dan staan er geen warnings in het log bestand Scenario: Afsluitmiddel punt heeft een geometrie met een Z waarde onder de drempel waardes Gegeven de testset bevat "CHECK_3D_POINT" En heeft de volgende geometrie """ POINT Z (10 20 0) """ En de drempel waardes voor Z liggen tussen 7 en 300 En het attribuut "meta_feature_type" is "Afsluitmiddel" En het attribuut "OBJECTID" is "55017666" Als de check uitgevoerd wordt voor Afsluitmiddel Dan staat de volgende melding in het log bestand """ WARN | Afsluitmiddel (ObjectID: 55017666) de Z waarde ligt buiten de drempel waardes (minimum: 7.0, maximum: 300.0). #1005 """ Scenario: Afsluitmiddel punt heeft een geometrie met een Z waarde boven de drempel waardes Gegeven de testset bevat "CHECK_3D_POINT" En heeft de volgende geometrie """ POINT Z (10 20 400) """ En de drempel waardes voor Z liggen tussen 7 en 300 En het attribuut "meta_feature_type" is "Afsluitmiddel" En het attribuut "OBJECTID" is "55017666" Als de check uitgevoerd wordt voor Afsluitmiddel Dan staat de volgende melding in het log bestand """ WARN | Afsluitmiddel (ObjectID: 55017666) de Z waarde ligt buiten de drempel waardes (minimum: 7.0, maximum: 300.0). #1005 """ steps.py from behave import * from sys import path path.append(r"C:Program FilesFMEfmeobjectspython36") from fmeobjects import FMEFeature, FMELogFile from src.checks import * import unittest from unittest.mock import patch def test_macroValues(self, mock_macroValues): mock_macroValues.return_value =3D 7 @given(u'het attribuut "{key:w}" is "{value}"') def step_impl(context, key, value): if not hasattr(context, "input"): context.input =3D FMEFeature() context.input.setAttribute(key,value) @when(u'de check uitgevoerd wordt') def step_impl(context): context.logger =3D FMELogFile() context.logger.holdMessages(True) processFeature(context.input) context.logger.holdMessages(False) @then(u'staat de volgende melding in het log bestand') def step_impl(context): heldMessages =3D context.logger.getHeldMessages() heldWarning =3D next((message for message in heldMessages if message.s= tartswith("WARN")), None) assert context.text.rstrip() =3D=3D heldWarning @then(u'staan er geen warnings in het log bestand') def step_impl(context): heldMessages =3D context.logger.getHeldMessages() heldWarning =3D next((message for message in heldMessages if message.s= tartswith("WARN")), None) assert heldWarning =3D=3D None @when(u'de check uitgevoerd wordt voor afsluitmiddel') def step_impl(context): context.logger =3D FMELogFile() context.logger.holdMessages(True) processAfsluitmiddel(context.input, context.testset) context.logger.holdMessages(False) @given(u'heeft de volgende geometrie') def step_impl(context): if not hasattr(context, "input"): context.input =3D FMEFeature() context.input.importGeometryFromOGCWKT(context.text) @given(u'de drempel waardes voor Z liggen tussen 7 en 300') def step_impl(context): pass src/ check.py from enum import IntEnum, unique import fme from fmeobjects import FME_WARN, FMELogFile @unique class Seed(IntEnum): ... CHECK_3D_POINT = 1005 CHECK_3D_LINE = 1006 CHECK_3D_POLYGON = 1007 ... def processFeature(feature, logger = None, seeds = frozenset(range(1000,9999))): if logger is None: logger = FMELogFile() logger.logMessageString("Kunstwerkdeel check gestart.") ... logger.logMessageString("Kunstwerkdeel check uitgevoerd.") def processAfsluitmiddel(feature, seeds = frozenset(range(1000,9999))): logger = FMELogFile() logger.logMessageString("Afsluitmiddel check gestart.") meta_feature_type = feature.getAttribute("meta_feature_type") object_id = feature.getAttribute("OBJECTID") ... process3DPoint(feature, meta_feature_type, object_id, logger, seeds) logger.logMessageString("Afsluitmiddel check uitgevoerd.") def process3DPoint(feature, meta_feature_type, object_id, logger = None, seeds = frozenset(range(1000,9999))): if logger is None: logger = FMELogFile() try: minZ = float(fme.macroValues["Geometrie_MinimaleZ"]) maxZ = float(fme.macroValues["Geometrie_MaximaleZ"]) except AttributeError: minZ = 7.0 maxZ = 300.0 if Seed.CHECK_3D_POINT and feature.hasGeometry(): if feature.getDimension() == 2: logger.logException(ValueError(f"{meta_feature_type} (ObjectID: {object_id}) heeft geen Z waarde. #{Seed.CHECK_3D_POINT}"), FME_WARN) elif not(minZ <= feature.getAllCoordinates()[0][2] <= maxZ): logger.logException(ValueError(f"{meta_feature_type} (ObjectID: {object_id}) de Z waarde ligt buiten de drempel waardes (minimum: {minZ}, maximum: {maxZ}). #{Seed.CHECK_3D_POINT}"), FME_WARN) processFeature(feature, logger, seeds)Running this against behave gives the following output: Functionaliteit: Check punt geometrie # features/check/3010_afsluitmiddel/check_punt_geometrie.feature:2 Afsluitmiddel Punten (punt x,y,z) liggen tussen de drempel waardes en hebben 3 dimmensies En heeft de volgende geometrie # features/steps/steps.py:74 0.793s """ POINT (10 20) Dan staat de volgende melding in het log bestand # features/steps/steps.py:25 0.000s """ WARN | Afsluitmiddel (ObjectID: 55017666) heeft geen Z waarde. #1005 """ En heeft de volgende geometrie # features/steps/steps.py:74 0.803s """ POINT Z (10 20 30) Dan staan er geen warnings in het log bestand # features/steps/steps.py:31 0.000s En heeft de volgende geometrie # features/steps/steps.py:74 0.830s """ POINT Z (10 20 0) Dan staat de volgende melding in het log bestand # features/steps/steps.py:25 0.000s """ WARN | Afsluitmiddel (ObjectID: 55017666) de Z waarde ligt buiten de drempel waardes (minimum: 7.0, maximum: 300.0). #1005 """ En heeft de volgende geometrie # features/steps/steps.py:74 0.800s """ POINT Z (10 20 400) Dan staat de volgende melding in het log bestand # features/steps/steps.py:25 0.000s """ WARN | Afsluitmiddel (ObjectID: 55017666) de Z waarde ligt buiten de drempel waardes (minimum: 7.0, maximum: 300.0). #1005 """This way, you can automaticly verify your FME workbench without relying heavily on the available test sets. Things to improve are the ugly try ... except AttributeError: block to inject a macroValue into the test, possible solution for this is creating a mock. Also a next step might be testing this on a server, while I have been able to run a docker instance of FME server, I have yet to discover where the fmeobject is located so I can run this test. Also obviously, you need an FME license for this, so we need to figere out how to inject the licence key to get the code to work in a secure way. So, you might ask, can we extend this to also test our workbench. Actually, that is super easy and barely an inconvenience! According to this knowledge.safe.com blog post, you can automaticly run a workbench from the python API, hooking this up to a Given step in behave is trivial, you could also check if certain links exists using a textual graph parser in the dot notation for example. I leave this as an exercise for the reader to implement.
Hi,It would be very useful if access to set the text annotation tool in sketchup would be possible. Reason is that we try to establish a sketchup template file, containing a cutout area from a geo-location. The sketchup file is grouped and layered with geometry of terrain and existing buildings. A predefined text annotation would enhance the usecase of the sketchup template. Please see attached screenshot.Thanks!
I finally encountered the first WFS-T service I can to talk to, at a client. With all security in place it was officially switched on today.Thinking about all the neat possibilities, eating a small cake, I found out there is no WFS-writer in FME.Arrrrrgggg!!!!!Will have to take into account I'll have to craft all XML-bodies myself if I propose something.
The DGNStyler transformer works fine, but what I miss is a parameter where you can add the "igds_level" for a specific item. Specifying colour, line weight, line style, text size, etc for an element is possible in the DGNStyler, but the most important parameter (igds_level) is not available. At this moment I have to use an extra transformer (AttributeCreator) to perform this.
With huge XML files (regular and Landxml) it takes a lot of time to read. Possible to improve this by using bulk mode or something? Many xml formats, so many formats will benefit from this. Goal should be to be able to read a 50MB or 100MB) faster than 1min ?
villeles variablesvaleurParisDont nombre de maisons vacantes en 20187000MilanNombre d'appartements en 20175000Bonjour, J 'aimerais que les années qui sont à la fin de chaque variables soient supprimées peu importe la longueur du nom de la variables .Merci.J'imagine bien qu'il fallait récupérer le 4 derniers nombres dans les colonnes "les variables" pour les supprimés.Du coup, j'ai essayer "StringReplacer" pour récupérer la date mais comment la soustraire du nom de la variables?
If you want to access your FME Server repository on a MSSQL database via windows (integrated authentication) follow these steps: Follow the normal installation process for FME Server in combination with a MSSQL databaseCheck if everything is working fineGive the designated Windows domain user db_owner privileges to the database "fmeserver"Stop FME ServerChange FME Server Core service properties to run under the windows userChange the config in Server fmeServerConfig.txt" (the user and pw entry are meaningless) DB_TYPE=sqlserver DB_DRIVER=com.microsoft.sqlserver.jdbc.SQLServerDriver DB_JDBC_URL=jdbc:sqlserver://localhost:1433;databaseName=fmeserver;integratedSecurity=true DB_USERNAME=fmeserver DB_PASSWORD=$FME$1ser$ver DB_CONNECT_EXPIRY=60 DB_SQLSTMTS_PATH=C:/bin/FMEServer/Server/database Copy "<FMEServerHome>Serverfmesqljdbc_auth.dll" to "<FMEServerHome>Serverlibfmeutilsqljdbc_auth.dll" Restart FME Server Services (Optional) Delete the default "fmeserver" database user
To be able to enjoy AR fully, I think FME should look into AR cloud support, so that when a FMEAR workspace is run, the resultfile automatically updates in the app. In this matter you won't have to export, download and choose the FMEAR app to open it with. E.g. you have made an AR file for FMEAR, but it needs modification, then if you are on site of the actual place of the building etc, another person could in the office run the workspace with the changes, and then the model automatically updates in the FMEAR app without having to recieve a new file, and upload a new file again.
Such feature would allow tidier and friendlier UI especially when a workspace has many user parameters that can be logically put into two or more groups. This is similar to the menu item dividers used in FME Desktop's menu system.
Is it possible to get FME Automations more similar to FME Workbench? The GUI feels like a "completely different software" than when working within FME Workbench. For people that have used FME Workbench the FME Automations feels a bit "old and rusty" with respect to how to easily add and remove items, connect items etc. My wishlist:- Easier add new items (start writing on dashboard, same as FME Workbench)- Easier to connect items (drag and drop, click and click, same as FME Workbench)
Every time you PAUSE an instance on FMECloud the Monitoring gets "deleted". So its not possible to compare memory/disk/cpu usage from a run today with the one 2 months ago. Make it possible to keep logging across multiple PAUSE/START.
Print Job ID, immediately When FmeServerjobsubmitter Triggered, So that we will know the job id in advance. Now its printing only after finishes. And We do not know how many child scripts ran by master.My master workspace running , child scripts in batches.
I have a situation where a user needs to select the relevant web connection for authentication, but as there is no means to get the base url from that web connection, they still need to enter an additional URL that the web connection should be used against. This leads to cumbersome double entry and is therefore prone to mistake, when the relevant information is currently held, but inaccessible to the workspace.I believe it would be beneficial to have the URLs that is held in a Web connection accessible in the workspace. For Aoauth2 this would be the URLs stored in the Web services, while thing like FME Server wuld be the Server URL stored in the connection. I would suspect that this could be an additional transformer that could extract details from a selected webconnection and extract them out into attributes within the workspace.
I like a clean workspace and I make groups of readers, writers and transformers the same width whenever possible. It can be time consuming to resize objects all the time even when grids and snapping are enabled.An option in the "align" menu to make all selected objects the same width would be nice.
The new concept of Packages is superb... but, for organisations who want to have a little more control over what is downloaded from the web, especially in this time of a need to comply with things like Cyber Essentials, allowing everyone to be able to download and locally install a package doesn't fly for lots of larger companies. Can packages be downloaded once and stored at the end of a 'shared' path, like the concept with custom transformers and database connections please. Then central IT can be given the option to control the packages in use and importantly the version deployed to end users. Thanks!
It seems this was turned of for FME 2019. I don't understand why. At least make it and option.This way you can examine your data in the custom transformer. This makes result sets easier to diagnose and develop.
I usually use Sublime or another tool to examine the logfiles, make this easier after a run by adding a button visualized below.
In-depth courses for all FME skill levels.
Explore our extensive collection of how-to guides and tutorials.
Log an issue with us. Our support team is ready to help.
