Using transformers to modify data.
Recently active
Hii all,How can I optimize the performance of my FME workflows when dealing with large datasets? Any best practices or recommended settings to consider?Thanks in adavnce.
I'm working in FME2023 build 23283 using an Intergraph SQL Warehouse reader. I have a rather lengthy process that deals with comparing a single 'target' feature class against multiple other 'candidate' feature classes (defined by published parameter via Features Types to Read on the reader. This process needs to be reiterated for several 'target' feature classes. So instead of trying to implement Group By throughout the workspace, I've decided to use a WorkspaceRunner to run the workspace separately for each 'target' feature class. The issue I'm running into is passing the Features Types to Read parameter from the parent workspace to the child. I have simply copied all the published parameters from the child to the parent workspace. This is the command line being passed (non-pertinent info redacted): This is the warning/error I'm getting. It seems as though the WorkspaceRunner is not respecting the space-delimited format of the Features
I am using a featurewriter to update 3 three fields. For this update, I am only exposing the fields that need to be updated, because I have found that works best.However, I need the rest of the fields in the dataset downstream.I ran an attributeexposer to reveal the other fields, but they all come in with null values. These fields do exist in the dataset, and they do have values. How do I access the fields in such a way that I can see the values in them?Thank you,Randy McGregor
Hi everybody, I was wondering if anyone can help me with clamping 3D Building Tiles to the Cesium World Terrain. We are developing a 3D web application with Cesium JS and we need to have our 3D buildings sit flush with the Cesium World Terrain. Our input into the application are 3DTiles. I know you can clamp citygml files to the terrain with the in-built clamp to ground tool in Cesium ion but is there any way to get 3DTiles clamped to the ground in cesium JS or with the help of FME?We use FME to create our 3D Tiles but we have not found a way to get the buildings to line up with the terrain. Is anyone here aware of anything I can do in FME to get my 3D Tiles output lined up with the Cesium Terrain? I would really appreciate some help on this! Thank you,Jan
Dear Sir/Madam, I would like to export fbx to cesium tiles. My FBX model structures are follow11-NE-12A\\BXXXXXX11-NE-17A\\BXXXXXX I would like to export at the same folder structure in Cesium tiles.It gives me an error when I use the fanout expression. And now, I only able to create the following folder structure. 11-NE-12A\\BXXXXXX\\BXXXXXX11-NE-17A\\BXXXXXX\\BXXXXXXMay I know how to fix it? I have attached my sample data and fmw in this email. And I hope some experts can give me a hand. Thank you
Hello, I imported a point GIS dataset into FME to export it with datasmith into unreal engine. The dataset is point based (I used vertex creator). When exporting to unreal, the scene is empty. Essentially, I need to convert each point into a 3d object (like identical cubes) which will be read as a static mesh with UE. I am banging my head against the wall trying to figure out how to do that.... I tried to play around with 2dboxreplacer and 3dforcer but they don't give me any results.Any help or tips will be very much appreciated. Thank you so much!!!
"extent" field stores information like '0103000020430D000001000000050000009C43A5BC013D5EC15.............'
Hi, I'm really new to FME, and am a little confused about how to do something. I have an existing automation built by an integrator that parses some emails for specific text. those are then bundled up various ways and sent out to various entities via email. I want to also send an API request with some of that data in it - the vendor i'm sending it to doesn't support a login auth, just tokens, though so i ended up making a workspace to send the call. However, i'm kind of confused as to how i get the outputs from the previous workspace into this one? I see the output keys from the writer, but, I don't understand how to get those keys into the next "run a workspace" My schema for the API looks like:{ "version": "v1", "alert_text": "route.Email**#.RAWMESSAGE", "title": "route.Email**#.AlarmName", "IsTicker": false, "lifetime": "1d", "computers"
I'm working on data transformation and trying to achieve a task using FME. I have a dataset with two columns(From and To), and I need to match values from one column(From) with values in another column(To). The third column(ID) corresponds to the value present in col From, so eventually, I have to match the value in col From, find it in another col To, and populate the ID value(in new col ID2) in a new column.Essentially, I want to find instances where a value from the first column exists in the second column.Could someone guide me on how to set up an FME workflow to accomplish this? I got an understanding that it can be performed using AttributeCreator using Enable Adjacent Feature Attributes, though not sure if it can, and how!I appreciate any help or insights you can provide. Thank you in advance for the assistance!The ID1 values in the below image are IDs of col From. I have to populate ID2 values that refer to To column.
Hello Community, I am currently working on a project that requires me to integrate spatial data from various sources like Shapefiles, GeoJSON, and CAD files into a unified database. While trying to use FME to accomplish this task, I've run into some challenges. Specifically, I am having difficulty with the coordinate transformation and managing attribute schema mismatches. I've followed the tutorials and documentation available but still find myself stuck. Could anyone with experience in this area guide me through the process, or perhaps point me to some advanced resources or tools within FME that may assist with these issues? Thank you in advance for your assistance!
Hi.I have a workspace, built with 2020.2.5, that utilizes FeatureWriter to build a zipped shape file for attachment to an email.In FW I'm adding some variables to be propogated along with the datasets, i.e. adding them to "Additional Summary Port Attributes". This works fine in 2020.When uploading the 2020 workspace to our 2022.2.2 FME server, it still works fine.I just tried to create a workspace in 2022.2.2 (open+save as), and now the additional variables are all set to blank strings. This is so both on desktop and when uploaded and run on server.I then did the same test with 2023.0, and the same problem exists, at least on desktop (can't test it on server as my server is 2022). The version of FeatureWriter is 0 in all versions, suggesting that it is the same transformer since forever. Please advise.Cheers.
FME beginner here, I'm trying to do a pretty straight forward export from an sde based database to file geodatabase, the only real criteria I'm after is preserving the ObjectId values in the output. Everything tried results in the ObjectId resequencing itself in the output per normal, our client has built relationships on the OID (why I'll never know) so we need to preserve them in the extract. Any help is appreciated.
After georeferencing CAD in ArcGIS Pro, generating World (wld3) and Projection files (prj), FME doesn't position the drawings correctly despite enabling advanced options. Why?
I've tried using FME Desktop on one of the new M1-based MacBooks. When running workflows I notice that I get considerably more memory optimization messages and warnings than I do when running on an Intel Mac or on Windows. The result seems seems to be lower performance. I'm not really surprised as it is a brand new platform and Safe probably haven't had time to test this properly. It would be interesting to hear if anyone else have experienced the same thing. I'm also curious to hear if anyone from Safe can shed some light on the matter.Judging by my tests so far it looks like FME could potentially perform very well on Apple Silicon once the memory issues have been addressed and a universal executable for FME Desktop is available. For more details and results from running FME workspaces on Apple Silicon (and Intel Macs / Windows) I wrote a blogpost here. I also uploaded the workspace I used for testing.
Hello friends,Im a new user of FME. I have a dgn file with hundreds of points with or without tags. i need to convert this dgn to shp with unique custom ids. Is it any procedure or transformers to do this in fme. I mean each point should get unique id number I tried with many videos and tutorials didn't solve my issue thanks
Hello, In my current project, i mostly use UTC datetimes, except for one process, where we need local time (Paris). For example, i need to convert "2020-04-29 12:00:00" (UTC) to "2020-04-29 14:00:00" (local). To convert my UTC datetimes, I could use the rule "+01:00:00 winter" and "+02:00:00 in summer". However, the day the times changes is never the same from one year to another.For example, in 2020, Winter time (one hour difference with UTC time) was adopted on October 25th, and Summer time (two hours difference with UTC time) was adopted on March 29th. In 2021, Winter time change will be adopted on October 31st and Summer time will be adopted on March 28th. Moreover, the conversion will not occur at the specified datetime ! This conversion could be run six months later, a year later… because we are processing data long after it was created. So I can not rely on the time of the computer doing the calculs to compute a time difference. I need t
Hello, I'd like to add a geo-referenced and framed text (see attached) to a GeoTIFF.I've used the transformers on the attached screenshot.Everything runs without error but the framed text does not appear on my output GeoTIFF.Could you help me? I'm new to FME. Thank you in advance,Camille
I have a polygonal tax lot feature class where about half of the features are being rejected from the Point On Area Overlayer Transformer with a rejection code of "INVALID_POLYGON_GEOMETRY_VERTICES". How do I fix these so they are recognized by the transformer?
Hi all one more time,I didtutorial example: Transpose a Table Using FME. Is it possible to further modifythe table according to the images below, please? Values could be"x" or any other. Thankyou all :)
Dear All, I am facing the following issue. I have 2 datasets (which are quite large) that contain a series of common attributes. I have a 3d table that stores the attribute names that I would like to compare (no geometry comparison). What I would like to do sounds very simple (sorry, I am newbie to FME...) :loading the 2 data, add prefix, merging them based on a key attribute (they will then have attributes like source1_col1, source2_col1, source1_col2, source2_col2, etc.)load the data that contain the column names I want to compare (e.g. col1, col2, etc.)iterate over col1, col2, etc. and for each of this value use TestFilter testing sth like "@Value(source1_$(column)) = @Value(source2_$(column))", write the unfiltered in an excel file on "$column" sheet) I have tried thousand things (custom transformer, ChangeDetector, workspace runner), but could not achieve exactly what I would like to do. One solution works rather well : I have a parent workspace that loads the
Is there a way to take a table as input and split it out into multiple outputs based on the value of an attribute (that I may not know)?I have a table of data that refreshes daily and one of the columns is for an object value. Most of the features (non-spatial) will have the same value for this field but people do have the option to set it to a different value that would be specific to them. Depending on the person adding data, the value could be different from one day to the next. Is there a transformer that will split a table out based on the value of a single field and then let me do different processing for each output? I've looked around and saw a few mentions of a "Fanout" but that looks to be something that happens on the writer and that's usually geospatial. I'm looking for something more like this:I see that there is an "AttributeFilter" transformer but it seems like I need to know what the values are that I would need to split by in advance. In
In the same workspace, I have 2 "lines" of attributes.I have to test an attribute value in line 1 to pass an attribute value of the line 2.I tried with an Aggregator, but all the attribute values are gone just after the Aggregator.Maybe it's just for geographical data.Is there another way?Or is it just my parameters in the Aggregator not right?
I'm wanting to see how many of a list of 34 overlays intersect each of 25,000 cadastral parcels, and get attributes from any that intersect. I'm currently using the SpatialRelator transformer, to see if each of parcels intersect the 34 overlays. However the output only appears to contain the attribute information of the first of the 34 overlays found, and I'm wanting all attribute information of all intersecting overlays. I would be able to achieve what I'm after if I used 34 different SpatialRelators, so each parcel could check if it touches any of the 34 overlays, however I'm hoping for a more concise solution. I wished that the SpatialRelator could do group processing that applies to only one layer, so that it effectively runs 34 times. AreaOnAreaOverlayer isn't doing what I'm wanting, as some of the parcels overlap and entirely contained by one another, which appears to be blocking the overlayer from reading them.
Dear All, I am facing a very weird issue : I want to run another workspace using a workspacerunner with a set of user parameters. Sometimes it works, or sometimes I get a UNDEFINED MACRO error. What is really strange, it is that in some FME workspaces it works very well and the workspacerunner does the job - but in another workspace a workspacerunner (that calls exactly the same script with exactly the same set of input parameters) fails with the UNDEFINED MACRO failure. Even stranger : when I copy-paste the workspacerunner that does not work in the same workspace of the workspacerunners that works, it also does not work -> so in the same workspace I have 2 workspacerunners exactly identical, one working and the other raising a UNDEFINED macro error ???!!! I've spent days trying to understand what was wrong in my script and/or parameter settings, but I end up thinking something else might be wrong... Do you have any ideas what could cause the issue ?Particular cache files to del
When I populate a FeatureReader with dynamically generated values containing the options I want, it works but not completely. It reads the parcel data I want, but returns no schema/attribute data: If I manually fill in the values in the exact same reader. It produces the output I do want (I.E. the parcels and their data). This is super inconvenient since our process is based on the assumption that we will not have to populate workspace objects manually each time we run them. I feel like I am missing something fundamental here that will great enhance my understanding of FME. Please help me to understand why this behavior is happening. Any help pointing me to how I might get the automated values to generate the output I want would be greatly appreciated. Thank you for your time. Kim