Using transformers to modify data.
Recently active
I'm trying to create a re-usable template that uses a dynamic reader to allow it to read a table from a database, the 'connection', 'feature types to read' and 'where clause' attributes would be defined before the reader but this approach seems to be causing me problems.Β The process so far looks like this...Β The FeatureReader looks like this...If I define the connection, table and where parameters within the feature reader everything works fine, the reader recognises the schema and creates an appropriate output port. Using the above approach and defining the same parameters as attributes doesn't create a output port (which I understand as how can it create a port for a feature type it hasn't read yet), next stop was the generic port but I can't seem to get anything useable out of this.Β I've read numerous articles on here about using a feature merger to merge the schema and the generic ports but this doesn't seem to give me anything useab
Hi All,Iβm working on a workbench to help my team to convert E57 point cloud data into SLPK and publish these into a 3D Scene in Portal for GIS. Initially I was converting the E57 into LAS files and then use ArcPro to convert the LAS files into SLPK and upload them into Portal.Before doing any publishing on Portal I wanted to do a simple test on my machine to makesure the E57 point cloud export fine to my machine,I have read the slpk can be created in FME by using βEsri Indexed 3D Scene Layer (I3S)β but, for some reason, I canβt get it to work. Below a screenshot of basic workflow that read the E57 and tries to export to slpkβ¦.but it doesnβt export anything? thereβs no slpk at all, see below:Β Β Any ideas if Iβm missing something?Cheers
I am getting the following error in a FME Form Workspace:Starting translation...ERROR : INCLUDE -- failed to evaluate TCL expression ` if { {-1} == {0} && {ORIGINAL} == {ORIGINAL} } { puts "MACRO REAL_MODE LAST"; puts "MACRO REAL_RATE <Unused>"; } else { puts "MACRO REAL_MODE ORIGINAL"; puts "MACRO REAL_RATE [expr <Unused> * ( -1 ? -1 : -1 ) ]"; } ' -- missing operand at _@_in expression "_@_<Unused> * ( -1 ? -1 :..." (parsing expression "<Unused> * ( -1 ? -1 :...") invoked from withinexpr <Unused> * ( -1 ? -1 : -1 ) invoked from withinif { {-1} == {0} && {ORIGINAL} == {ORIGINAL} } { puts "MACRO REAL_MODE LAST"; puts "MACRO REAL_RATE <Unused>"; } else { ...Program TerminatingTranslation FAILED.In a general context , what does this error mean?Β What are examples of issues that can trigger it and what FME form workspace design approach
I have a collection of geopackage files, several of which have different feature attribute schemas (attribute names, numbers of attributes).Β I have read the schemas using a FeatureReader, and created a list for each FME_Feature_Type_Name.Β (Iβve built a concatenated text string here just for visibility):Β Β Where I am getting stuck is in using this in a subsequent FeatureReader to define the attributes to expose for each file. Iβm using fme_feature_type_name in the read location to grab one file at a time.Β Β But am struggling to use the Schema list or concatenated attribute to drive the attribute exposure.Β I can get all attributes exposed via AttributeExposer, but then I have to use a TestFilter and an AttributeManager to remove the attributes that donβt apply to particular files (because βexpose allβ picks up all attributes from all files).Β Is there any way this will work?Β Β
I need to get data from my Bing subscription into the MapnikRasterizer. At least that how I think it should be done.It works of course in the preview because I made the Bing maps available through the options. But as I see it for the MapnikRasterizer I will have to provide the background as an image and I am struggeling to get the Bing data into my workflow.Β background settings in MapnikRasterizerHow can I get the Bing data into the MapnikRasterizer?
For normal Reader feature types, to update for schema or attribute changes you simply go to Readers > Update Feature Types. I can't find the same functionality using a FeatureReader. Is there a way to do that? The only workaround I've found is to drop the FeatureReader and re-add it.
Hi,Β why does the attribute pivoter no longer work? I have already read several questions about this. Β There is an alternative somewhere with the aggregator, but that doesn't work very well for me either. Β Isn't there an easier way or a reason why the pivoter doesn't work?
Hello all,I have some point (electricity poles) and line (overhead conductors) features which I need to connect up for our utility network model.Β I am trying to insert a vertex on the line at the nearest point to the pole. I have a neighbor finder and vertex creator, but neither are actually adding a vertex to the line (the neighbor finder has insert vertex on base feature set to yes).Β Is there something I am missing or another way to go about this?thanks.Β
Hello,In FeatureWriter, User Attributes,I want to use a User Parameter as the name of my primary key.User Parameter (in french: Primary key name)Feature Writer (not working)Β
[Edit] I solved this by fiddling about. Se solutions at the bottom. Will leave post as is, incase it can be of help to someone else.Visual Preview and Data Inspector are behaving very erratically on my computer in Form 2025.0. Bordering onΒ making the software unusable.Some of my issues:One specific to a workspaceΒ Today FormΒ refuses to show the results from inspectors inside Custom Transformers, it will only show those in Main. This worked fine yesterday. Only difference is a computer restart.This issue prevails if I open the workspace in 2024.2. I created a new empty workspace and got the previews working from within Custom Tranformers.The issue below goes for all workspaces.Β Form is behaving like a raging toddler when I try to turn on Enable Feature Chaching. I try to get it to work with me byΒ clicking the setting over and over and over again, but it just resets and does noting each time I press run. Then suddenly it complies without me understanding how thatΒ happened.There is simply
Hey, Iβve been trying to get FME (Feature Manipulation Engine) by Safe Software to use Python libraries from QGIS (like qgis.core) so I can mix their cool features in my temp.fmw workspace. The idea is to use QGISβs Python (version 3.9) inside FME by setting it up with PowerShell commands. But itβs not working, and hereβs why, explained like Iβm talking to a 5-year-old and then a bit more grown-up:The Toy Box Story (Simple Version)Imagine Python is a kid who needs toy helpers to do jobsβlike QGIS toys (for maps) and FME toys (for data tricks). These toys are called DLLs (little helper files). I want Python to borrow toys from both QGISβs toy box and FMEβs toy box at the same time.Step 1: I told Python, βLook in QGISβs box (C:\Program Files\QGIS 3.32.0\apps\Python39) and FMEβs box (C:\Program Files\FME\python)!β Thatβs like setting PYTHONHOME and PYTHONPATH.Step 2: Python found some QGIS toys (like qgis.core), but then it yelled, βWhereβs my Qt5Core.dll toy? I canβt play!β Itβs like a t
In my workbench I am taking points, buffering them, and using those buffered areas to clip small portions of a raster mosaic.Β After clipping I then run a raster calculator on each of those pointsΒ to find the sum, mean, min, max range, etc and create an excel file with all the values calculated and collected.Β My workbench runs successfully, however in several of my datapoints I get empty rows with no stats being calculated.Β When I check the area in ArcGIS Pro there arenβt any null values in those areas and it runs without any issue.Β I have tried using RasterBandCoercer to change any null values to 0, rasterbandnodataremover, and nullattribute mapper to help deal with these issues but none of them give me results that I can actually use without skewing the data and giving me invalid results.Β Does anyone have any suggestions or ideas on how I can fix this issue?Β Currently runningΒ FME(R) 2024.0.1.0Β Thanks!Β
Dear FME Users,In our organization, we frequently work with Esri Geodatabases, and we often use FeatureWriters to write data to these databases. This process has always worked smoothly for us until we updated our FME Form to version 2024.2. Since the update, we've encountered an issue where the geometry of a feature class is no longer auto-detected when adding a connection to a .sde file (we always embed these connections) and then adding a feature class from the dataset. Previously, this functionality worked perfectly, and we appreciated not having to manually set the geometry.Could this issue be related to the version of FME Form, the transformer itself, or are we possibly missing a setting in the FeatureWriter setup?ExampleInterestingly, when we select a table without geometry, it is auto-detected as a 'geodb_table'. However, for some reason, geometries are not being detected.Any helpΒ would be appreciated!
Given the height, length and width of an underground vault, I'd like to create a 3D box of the vault. I'd also like to create a flattened box out of the same dimensions.I've started out with a creator, cloner and a 2dBox replacer then a 3D extruder for the box. I'm a bit lost with the flattening of the box in a 2d plane. Any suggestions on how to get the bottom corners of boxes 1,2,3, & 4 align with the corners of box 5?The bigger challenge is how to project this so I can draw this in a DWG file later in my translation. I have a lat/long as the center of each vault and I could probably start at zed value of 0 initially.me dimensions.
Upgrading 2023 workspace to 2024.2.Β When upgrading or adding a new LenghtToPointCalculator transformer and referencing existing attributes for the X/Y coordinates, FME adds 2 rejected ports to the transformer.Β If you then run the workspace you get the error:Cannot have multiple factories with the same name. Β Multiple factories were assigned the name 'LengthToPointCalculator_<Rejected>'Β Β Any suggestions on how to get only 1 rejected port?Thanks.
Hi everyone,Β I've just uploaded my very first custom transformer to the FME hub which I'm very excited about. However when downloading the transformer it doesn't show my name next to the community publisher. Any idea how to show my name there?A lot of time went in this transformer so a little bit of credits would be nice :)Β
I have a workbench that creates a table based on a number of joins that are on occasion, filtered on an attribute. Instead of manually entering the attribute values, IβdΒ to read a list of attributes from, say,Β an Excel doc e.g. NSG001, NSO001, TES001 so I donβt have lots of duplicated transformers. How do I iterate through a list of values and plug them into FeatureJoiners without duplicating lots of stuff.Β
Hi,I need using attribute value to create another attribute, but theΒ @Value<attributeName> no work in attribute creator.Can you help me?Β ThankΒ΄s
Β Hi everyone,I have a set of consecutive lines, and I need to detect when there is a digitization direction conflict between them. As shown in the image below, the green arrows represent the direction of my lines, but Line 2 is oriented differently compared to the others.Is there a way in FME to detect such conflicts? Ideally, Iβd like to flag or filter out the lines that have a reversed direction compared to their neighbors.Β Β
Iβve read a couple of posts on this, but Iβm still not perfectly sure on how this works.I have over almost a year been working on and refining a flow. Since I keep getting new updates from the project, the flows has became large. It became into 3 flows, that could maybe have become 1, but I donβt think it would be that easy, at least Iβm not up for that task.Β It consist of multiple feature readers and multiple feature writers. Each flow takes up some data from the other. For example something can have been made in a file Geodatabase or on ArcGIS Online, and the next flow would then use that content.So, I easily enough just want to run those 3 flows, by one click in workbench. I would expect just to create something like this. I just find itβs strange to connect it like that.Is it that easy?Β Β
I have different IFC files which I want to read and transform.The geometries each contain a Transformation Matrix. From the FME Form Documentation I know they are not applied.How can I apply them?I tried to extract the parameters (withΒ TransformationMatrixExtractor) and then used the 3DAffiner, but with no result.Ther must be a more convenient way, right?!
Hi all,Β I have a workspace that preps allΒ input features by reprojecting them to GDA94/ Australian Albers and then calculates input area. When I run the same feature (as a shapefile, but different different coordinate systems) I get different Area values even though theyβre both in the same Coordinate System.I ended up testing the features with an AreaOnAreaOverlayer and turns of thereβs really tiny sliversΒ across the boundary of the feature (I donβt know where these slivers are coming from?). I added both the shapefiles in ArcGIS Pro and followed the same process- reproject and calculate area andΒ bothΒ area valuesΒ are coming out as the same in Pro.Β I am unable to figure out why Iβm getting this difference in areas in FME but not ArcGIS Pro. The difference is tiny but ends up changing the final stats.Screenshots attached.Β Any help would be greatly appreciated.Β Β
How to convert polyhedralsurfaces(voxels) stored in database with addtional attributes stored in columns into cesium 3dtiles?Additionaly to export the data in a suitable format to view voxel and its attributes?
Hi Everyone,Β Iβm kind of stuck with a problem with my Geopackage writer.Β For a client, Iβm working on building a script that generates multiple Geopackage tables, each with its own name. Each Geopackage table writer uses a fanout to automatically provide the writer with the needed file name. The writer also uses a Geopackage with styling embedded in the database, with 0 features, as a template file. This template is provided by an engineer from the team, which should automatically style the Geopackage based on the attributes it has.Β The problem occurs when I have both fanout and template file enabled. This causes the Geopackage to only write certain features. I canβt find any logic behind why it writes some features and not others. The template file and the Geopackage writer are 1-to-1 copies of each other, and I get no errors/warnings regarding feature issues. For example, one table, which consists of 470 features, will write 233 features, and 237 features end up somewhere in space. :
Β Β Im fairly new to FME, I have a programming background, and I was hoping to bring those skill here, but i can see is not fully the same. So I apologize before handΒ πΒ I have a custom transformer that does a API calls and loops until it finds βlast-batchβ set to true from the Header area.Β For Reference Here is the custom transformer:The first call uses uses the InitialHTTPCaller, which uses the the request url and access token from the main workbench. Here is a screen cap:Β The _response_header list will have the variables I need to determine if the its the last-batch = true and the next batch url.Β The JSONFragmenter, is exposing the values forΒ _response_header{5}.value,_response_header{6}.value.I have a tester that checks if _response_header(5) is true to go the pass else it will fail and will go to Output and call upon the Loop to the NextPage.Β Β When the NextHTTPCaller gets called it will be using the User Parameter named NextUrl of which im setting it with the @Value(_response_header