Using transformers to modify data.
Recently active
Workbench contains 7 individual sql queries that produce shapefiles.When run all together six work, but one of the processes fails with a no schema error. However, the process that fails works when run on its own.What could be the problem?Thanks.
Hey FME'ers. I just wanted to draw your attention to this useful piece of information I found.See my tweet here: https://twitter.com/FMEEvangelist/status/1151516193263640577Basically, when doing a Dataset Fanout you can set the folder to be a zip file when you write to it, or you can set the Fanout Expression to have a zip file extension, or you can use both!I'm not sure when this got implemented. I think the first method has been around for a long time, but the other two might only be in 2019 or newer.Hope you find this useful!
I have tested some attributes of a Shapefile which are empty, with a StringLenghtCalculator and those empty fields returned a value of 254 characters. That's weird. I have tried to replace those empty values with '0' or with 'EMPTY' using the NullAtributeMapper with all options and with the StringReplacer using this regular expression: [^a-zA-Z\\d\\w,.\\-/\\s/+_\\\\] All with no success.... still the attribute value seems to have 254 characters A familiar problem to someone? And maybe there is a solution?
Hello I have two tables below This was done in excel, in essence, I want to assign the Pos_ID from the first table to the PosKey in the second table depending on the values on the date/time column on both tables. Is there a way to do this in FME? Thank you
Hi All, I'm wondering if there is an efficient way to flatten part of a mesh. I have a large mesh and in part of the mesh I simply want to set the z value to say 0. I don't want to recalculate the triangles, just offset the effected vertices. The only way I can see to do this is to break the mesh down into it's vertices which seems super inefficient. open to any ideas
Hi all, I am new to FME and I am trying to solve the following problem: I have a set of 24 .shp. Each shp comes from the buffer line, and each has more than 50,000 characteristics. Each one contains polygons and donuts. When I read it together, I have a lot of polygons and holes overlapped.I have to dissolve the shp set because I need the fused surface of the buffers clearly, without overlays.Although I have tried to dissolve it by different methods such as extracting holes, dissolving and adding holes afterwards, or dividing the data set with a tiler and dissolving it based on groups (row, column), the output is never what you expect, having filled holes or partially undissolved areas. I think the dissolver does not work properly because there are too many overlaps, holes in a single feature and holes between features -from reading the entire set .shp in a single reader- I have attached an image of a shp containing the 24 shp merged, but with no dissolver and a image of unexpected out
Hello folks, I am wondering whether there are any tools that can help me clip one 3D city model with another? This might be unusual thing to do, but its for analysis purposes (thesis). I want to substract one from another and vice versa to see differences between the two. Both files are in Shape format. Any way I can do that in FME?
Hi, I'm trying to use point data from a shapefile to accurately place 3D objects (obj) in their correct geographic location, and then outputting the collection to FBX.I based my approach on the response by @takashi to the following forum question: Adding a 3D model and Geo-referencing it with multiple XY pointsIt seemed to work really well. However, when comparing the final FBX model to other 3D layers the markers seem to be in the wrong location.Input from QGIS matches FME 2D Inspector output pictured below.FBX Output in Unity (visualised below against other map layers exported from FME as 3D objects).The 3D objects in the FBX output appear to be spread to the north and the south and stretched to the east. This looks like a projection issue but the 2D output is fine so its unclear why the 3D output wouldn't be. Alternatively the problem may be the offsetter, but if that's the case I'm not sure exactly what the problem is.The input shapefile coordinates (clipper boundar
Hello Team, Present I am working on the following version of FME:-FME(R) 2015.1.1.0 (20150715 - Build 15515 - WIN64). Is there any possibility to do ZIP Archiving with existing version? When i tried Zip Archiving transformer it is asking for upgrade. So which version of FME supports Zip Archiving?Thanks...
Morning All, I have 4 equal polygons next to each other and i need to label them A,B C,B. Im struggling with my lists. They currently have no attributes My approach is to create a center point for all of them, to get the x and y. Then A should be the one with the smallest X and smallest Y, then B should be the Largest X and smallest Y etc etc. i get the inside x,y for all then build a list from them then sort the list by inside x but struggle from here. im unsure how to a list by two values ,ie x and y. i have tried list indexer, list exploder. Thanks Steve point for each polygon then look for the [polygon with the smallest X and Y, this = A, The smallest X and
Hi, we are trying to use a hullreplacer (FME2017.1) to get a concave hull. When we feed it with polygons, it crashes the engine, even the polygons pass the GeometryValidator. The alpha parameter does not seem to have any effect on this behavior. However, when we chop the polygons into points, it comes with nice polygons. Any similar experiences on this?
hello guys i am finding a solution to join excel files related to stations on highwayseach excel file had the specific data for stations ( 1- shops 2- car services 3- motel,toilets etc) including coordinates for each related service.there is no unique id for station on which i can join them except the coordinates.each station has 3 to 4 points having attributes for services.and the distance between points varies as per accuracy on the device some time it comes within 50 meters and some time more than 100 meters according to the area of stations.i tried the buffer in arcgis but it not covers all and some time if the distance between two stations less joins the two stations as one is there any way i can join points related to each station with out having overlap and not joining stations from one side of road to the other side as some time there is station on both sides of the road infront of each other..also i want to create station id for each station
Hi together The initial situation is as follow: The relation between column TR and column LTG is 1:n. Every value in the column LTG need to get a unique code independent from TR. The CODE also has to be unique per TR.TRLTGCODEA1?A2?B3?B1?C1?C3? I would like to get follow result (the code has to be unique per LTG and order is not importent): TRLTGCODEA12A21B31B12C12C31
HiI have a workbench (), where I am reprojecting to WGS84, adding grids and text and clipping to a grid index. After the clip I was getting black borders, but I set this data to nodata and this fixed the problem when looking at the rasters in GIS software. However, in windows explorer the black borders can still be seen. I understand this doesn't effect the data, but it doesn't look good when sending the data to others. Is there any way I can remove these black borders in windows explorer. ThanksB
Hi all, I have a road network and I would like to combine them if the road is same, as in the following image . It works perfectly fine with LineCombinerHowever lines like in the images are getting combined but I do not want to combine those as there is an intersection. I can fix it with TopolgyBuilder but I want to keep the corresponding id. So therefore i was wondering if there is a way that LineCombiner does not combines if there is intersection like this?
I've got a few questions around the use of Python within an FME2017+ process and the possible scenarios.There seems to be a few ways in which I might need configure some Python to run in FME and I'm trying to understand all of the options. There are quite a few articles on the Knowledge Center but a few are getting a little long in the tooth now and several seem to suggest that things have changed in recent versions of FME and I think that's because there were some fairly significant underlying changes around 2012 or so.FME installs a build of Python that allows you to run some scripts. It seems to install 2.7 and 3.4 and 3.5 libraries (as per the Help>Options) but I can only find \\fmepython27 and \\fmepython35. Is 3.4 part of 3.5? Presumably if I use the option 'FME Python 2.7' it's using the FME installed Python interpreter?If I wanted to create a Python script that FME and another application like ArcGIS needed to use, presumably I'd need to change th
Hello there! I have spent, no joke, over 5 entire work days trying to achieve this result, and....... I still haven't. Considering it's not actually a priority in the slightest and that I clearly can't leave well enough alone, I'm finally giving in and joined this community to see if one of y'all can do it for me (in much less time)...I am trying to create... a network of neighboring points. The input is a shapefile of buildings' center points (with a starting point designated via parameter); the desired output is these same points, with an attribute putting them in an order that is essentially:A) Point AB) The nearest point to point AC) The nearest point to point B, excluding AD) The nearest point to point C, excluding A and BE) The nearest point to point D, excluding A, B, and C...and so on. Find the nearest neighbors, with exclusion -- the nearest point that is not already the nearest point to one earlier up the chain.I actually made a looping custom transfor
Hello, I have a workspace to export fme configuration from fme 2016. I tried backup but for some reasons it didn't work and that's why I wont to read fme configuration and export it to ffs file just to have a backup. Everything works fine for all feature types except for: This one is quite big and I get an exception after 10 min of running: 2019-07-15 09:38:03| 2.6| 0.1|ERROR |FME Server Configuration : Unable to connect to FME Server, please verify the provided URL and ensure that the target server and its REST service are running. The error was `Connection reset'2019-07-15 09:38:03| 2.6| 0.0|FATAL |The below feature caused the translation to be terminated2019-07-15 09:38:03| 2.6| 0.0|INFORM|FME Session Duration: 10 minutes 51.4 seconds. (CPU: 1.2s user, 0.2s system)2019-07-15 09:38:03| 2.6| 0.0|INFORM|END - ProcessID: 12028, peak process memory usage: 3251268 kB, current process memory usage: 3250208 kB I'm sure that URL is correct and credentials as well because I ha
Paid_Services11.xlsx( my problem is i have an excel which is about the survey of stations, in some stations there are 3 restaurents and some had 4 restaurents and some only 1, but in survey form we gave questions for maximum 10 restaurents in mdc giscloud.when we export the data in excel it shows all 10 restaurents fields even if they filled for less . i want to remove the fields with no attributes.. sample file is attached .. thanks
Is there a way to determine the number of pages in a pdf other than reading them all as prf_page_metadata and sampling the last feature? Some of my pdfs are over 5000 pages, and this seems inefficient, especially as this information appears in the Document Properties in Acrobat. Setting the Parameter Pages to Read to -1 produces an error.
Hello,For a project we are looking into building several workspaces/token-based apps that can be run on FME Server. Due to strict security requirements we have to make sure that either compressed files are rejected or are handled in a safe manner.As I understood FME 2018 and older decompress the zip file first to a temp folder, then using the extracted files to read the data (into ffs), this potentially exposes the file system to malicious files from the zip.Upon being read, the data is extracted and used just as if it were a normal dataset. FME is able to read data stored directly in an archive file, or within sub-folders. archive_files_reading.htmNotable New Features 2019.0Automatic DecompressionRead your compressed data files directly in FME without having to decompress them first. Another barrier has been taken down!FME 2019 New FeaturesDoes this expose the content of the zip to the file system? Somehow the files of the zip have to be stored somewhere. EDIT: Yes it still extracts e
I'm using a SpatialRelator with default settings (Generate List = checked, Merge Attributes = un-checked).A polygon class serves as both (Requester and Supplier) to identify polygons containing others within the class. This works perfectly well.The issue is on the attribute level: Each requestor attribute that has a <null> value is filled with a not <null> value from one of the suppliers. All not <null> attributes of the requestor remain unchanged as expected.It seems the SpatialRelator performs an attribute merge even if 'Merge attribute' is unchecked.I tried 'Merge attribute' with conflict resolution 'use requestor' as mitigation. But even then requestor <null> values are filled with non <null> from the supplierIs this a bug or intended? If intended is it documented anywhere? regardsKlaus FME Desktop 2017.1.1 and FME 2018.1.1.1 build 18578 WIN 64
I have a dataset, where one of my columns is a 'pack date', unfortunately some of the values within this column are null.I am trying to use Conditional Value within the attribute manager to give a dummy date wherever a null value appears in my table.So far I have:If Pack Date ATTRIBUTE_VALUE_NULL as my test condition.How would I assign an attribute value of, say 01/01/1990? Thanks,Tom
I am trying to transpose data. I already read some posts about how to transpose a table using FME. But I am not able to get what I want.I have the following table within FME:I want to transpose the data so I get the following format:So I don't need my column names. This is just an indication for myself.Does anybody know which transformer(s) I need to use?
Hello,I have two columns in a Excel sheet "Year" and "Range" with more than 2000 rows. I would like to compare those 2 columns and see if the Year is truly in the Range or not. For example:Year Range 1650 < 1920 1964 1961 - 1970 1970 1961 - 1970 2001 2001 - 2005 1963 1971 - 1980 2015 > 2014 1923 1920 - 1940 1978 1981 - 1990 Thank you in advance for your returnBest Regards