Transformers

Hi, I pull down a file from s3, zip it then upload it to s3 again. When I use the zip archiver it adds the file to a folder and zips up the folder which has the same name as the file. This is a little of a pain when extracting. Is there anyway to zip just the file without having a folder. Many Thanks Oliver

After quite a lot of troubleshooting python packages, I have whittled the script in the PythonCaller down to simply importing some packages: import fmeimport fmeobjectsimport pcl class FeatureProcessor(object): def __init__(self): pass def input(self,feature): pass def close(self): pass However, I still receive a Python Exception:Python Exception <ValueError>: numpy.ufunc has the wrong size, try recompiling. Expected 192, got 216which is being caused by importing pcl (python-pcl). I AM, however, able to utilize this package directly in python using the same interpreter. I only encounter this error from within FME. I have found references to Cython throwing warnings (but not errors) due to a reference to an older numpy version (https://github.com/numpy/numpy/issues/12785#issuecomment-455336738), but it seems that issue has been addressed and I do not encounter any warnings when I run scripts directly. At this point, I have to assume that the PythonCaller is at fault. Does anyone out the

Within more than 2500 Features in one Polygon shapefile I used a SpatialRelator Transformer to find out intersected polygons followed by ListExplode Transformer. The result as following example: My target is to select intersected features of highest related_candidates number (3 for above example). In some cases the highest related_candidates is 4 or more. Does anyone have any ideas or potential solutions? @mark2atsafe @egomm @david_r @jlutherthomas @jdh @takashi @redgeographics @danilo_fme

Hello everyone, I am a bit puzzled with what I thought would be simple, but is giving me a difficult time. I have aggregated polyline (Gas Main) and need to generate a point at any ends ( to buffer and capture streets within that buffer to show potential growth). In review what I need: A point to be created at any end of an aggregated polyline. Exported in ArcMap Esri GDB Thanks

Hi Nick, looks like I'm on the Avineon space OK but perhaps just you and me? The only thing I see here is questions, wondering how we can share things, have threads, etc. Perhaps a Skype or something to run this down. Talk to you soon. Jim

Dear FME community, I have a aggregated line with a list that looks like this: _agg_{0}.begin = 0 _agg_{1}.begin = 100 _agg_{0}.end = 100 _agg_{1}.end = 200 The above one is the ideal, correct one. Unfortunately, not all data looks like this. Here two examples. 1) I want to find gaps with no data, for example:_agg_{0}.begin = 0 _agg_{1}.begin = 102 _agg_{0}.end = 98 _agg_{1}.end = 200 2) If possible also overlapping data, for example:_agg_{0}.begin = 0 _agg_{1}.begin = 100 _agg_{0}.end = 102 _agg_{1}.end = 200 The values from begin(+1) should be exactly the same value as end(0) and so on. Any ideas how to solve this? Many thanks and kind regards Thomas

Hi, I'm trying to calculate the 1st the of the month using the end of the month date. Now I know the interval days for the months but I'm not sure how I can write this in FME. I've written out in plain text of an example if statement-of what I need. If end date month is equal to April,June,September,November then subtract P29D else if end date month is equal to January,March,May,July,August,October,December then subtract P30D else if end date month is equal to February then subtract P27D else if Feburary is in a leap year subtract P28D Is there an elegant way of using the Date/Time functions to calculate the 1st of the month? or would I need to use an if statement? I use an attribute called _endDate which is the end of the month. Josh

Hi, I have troubles using UpdateDetector (FME 2018) and/or ChangeDetector (FME 2019). First, I join an xml file containing projects with a ESRI Feature Class containing land parcels using FeatureJoiner (joined on parcels ID). Result is an Esri SDE Feature Class showing only the parcels with projects from in the xml-files, including project information from the xml-files for each parcel. Xml-files will be regularly updated, and the FC must be updated consequently. Parcels geometry is not changing and doesn’t need to be compared. First, I tried UpdateDetector in FME 2018 to compare the output of FeatureJoiner with the sde fc (I use it both a reader and writer). It kind of work but the parcels with unchanged project attributes go through ‘updated’ and are rewritten/updated on the fc instead of stopping in ‘unchanged’. But either UpdateDetector ‘inserted’ and ‘deleted’ works and the end results is correct but I do not want that unchanged parcels/data are being replaced. I tried the new Cha

I clip a PointCloud with some rectangle (after I used a PointCloudThinner) and send the clipped result into a TINGenerator. What I get for some features is an Error which breaks my translation. Reason seems clear to me, because in one example I have a row of 9 points on a straight line and there is no way to calculate a TIN from this input. My problem: TINGenerator doesn't have a Rejected port and how should I know in advance which features will break the translation ? GeometryValidator doesn't seem to have a useful option for this kind of check ?

Hi, I have an issue whereby the datetime formats are coming out incorrectly. I have a number of scripts that read json formats directly from a couchbase database, and spits them out in human readable excel format, using the FileNamePartExtrator transformer. It all works great except for the inspection and submission times. They seem to be getting mangled. I am 6 hours behind UTC, but the FME reader is already altering the timestamps before doing anything to it (I checked this in the reader preview). For example, I have a correct inspection timestamp in the database that reads 15:58:13 but it is getting populated in the output spreadsheet as 09:58:13 It is being read in as timestamp format and being outputted as datetime format. I would just like to have them outputted in the same time that they are getting read and stop FME from changing them without my permission. I have tried various date & time formats in the output writer to convert them back but nothing seems to work, for example:

Hello Team, Present i am working on the FME Version: FME(R) 2015.1.1.0 (20150715 - Build 15515 - WIN64). I could able to zip a downloaded file through HTTPcaller by using feature reader and single writer(text file) in independent workspace. Selected output as compressed Zipoutput in the writer parameters. But when i did the same thing with my master workspace which is having a custom transformers and ArcSDE writer at that time i am getting output as text file with the .zip extension which is not compressed. I assume that output just updated with .zip extension and it got corrupted. Can somebody help me to resolve the issue?? Thanks.. Nagendra

Hello Team, I have archived a .jxl using ZipArchiver, After zipping the required file can we delete input file from source location. Thanks, Nagendra

Hi FME Community! My goal is to construct CityGML Terrain model (dem:TINRelief) from really accurate TIN data created with 3D modeling software. I have found certain ways to construct CityGML Terrain with FME but it always starts with generating TIN surface with the TINGenerator. I don't want to construct TIN again in FME environment. Because if I do so, the TIN is not anymore as accurate as it was in the beginning. Is there any other way to get CityGML Terrain model than generating TIN again with FME?

I have to associate a simple progressive number (from 1 to the number of rows of my data). The Counter Transformer gives me back strange results: one time only even numbers, another only odd numbers and other times one every four (0,4,8,12,...). I tried using the Arithmetic Editor in the AttributeManager but it produces the same error. How can I solve the problem? Thank you!

Hi Experts, I am working on FME 2019.0. I have to find the dead ends from a huge road network (without geometry). I have to take only associations into consideration. There are two columns jun_id_to and jun_id_from for each road. The value that comes just once in jun_id_to or jun_to_from both would be the dead-ending road. A small illustration about how the road network would look like and the association table is below: Road geometry: Attributes: I tried using StatisticalCalculator, but, I am not sure if it can tell the count of each character in both the columns. Also, FeatureMerger with jun_id_to and jun_id_from merge doesn't give the required output. I think Lists might work in this case but not sure how. Any ideas? Thanks.

I have a process inside a PythonCaller that converts a long pandas dataframe into a wide dataframe that when output, has around 200 columns. The dataframes are transformed back into an fme feature for output. Now I need to expose all 200 column names but need to avoid doing this manually. Is there any way to do this from within the PythonCaller?

Hi, I need help with transponsing the data in the attached "Input" tab to the data in the "Output" tab. Each row transposed to columns grouped by "f.WorkOrderEquipmentRef.0"-"f.WorkOrderMstNo.0" - e.g. CHM67-1003 + have the group by column data next to it... I gave it a shot but couldn't get the desired output. Thanks.

Hello, I am trying to find the distance between a point feature class and polygon feature class with the NeighborFinder. The points are the base, and polygons the candidates. I have a max distance of 5000m. The actual scenario is finding the distance between houses and well sites. I need to find out which well sites are within 5km of each house, and record the distance to and ID of the well. The result that I am getting is only one candidate/base. I would like to have multiple records for each base, showing the distance to each candidate. My parameters are attached. Thank you.

Workbench contains 7 individual sql queries that produce shapefiles. When run all together six work, but one of the processes fails with a no schema error. However, the process that fails works when run on its own. What could be the problem? Thanks.

Hey FME'ers. I just wanted to draw your attention to this useful piece of information I found. See my tweet here: https://twitter.com/FMEEvangelist/status/1151516193263640577 Basically, when doing a Dataset Fanout you can set the folder to be a zip file when you write to it, or you can set the Fanout Expression to have a zip file extension, or you can use both! I'm not sure when this got implemented. I think the first method has been around for a long time, but the other two might only be in 2019 or newer. Hope you find this useful!

I have tested some attributes of a Shapefile which are empty, with a StringLenghtCalculator and those empty fields returned a value of 254 characters. That's weird. I have tried to replace those empty values with '0' or with 'EMPTY' using the NullAtributeMapper with all options and with the StringReplacer using this regular expression: [^a-zA-Z\\d\\w,.\\-/\\s/+_\\\\] All with no success.... still the attribute value seems to have 254 characters A familiar problem to someone? And maybe there is a solution?

Hello I have two tables below This was done in excel, in essence, I want to assign the Pos_ID from the first table to the PosKey in the second table depending on the values on the date/time column on both tables. Is there a way to do this in FME? Thank you

Hi All, I'm wondering if there is an efficient way to flatten part of a mesh. I have a large mesh and in part of the mesh I simply want to set the z value to say 0. I don't want to recalculate the triangles, just offset the effected vertices. The only way I can see to do this is to break the mesh down into it's vertices which seems super inefficient. open to any ideas

Hi all, I am new to FME and I am trying to solve the following problem: I have a set of 24 .shp. Each shp comes from the buffer line, and each has more than 50,000 characteristics. Each one contains polygons and donuts. When I read it together, I have a lot of polygons and holes overlapped. I have to dissolve the shp set because I need the fused surface of the buffers clearly, without overlays. Although I have tried to dissolve it by different methods such as extracting holes, dissolving and adding holes afterwards, or dividing the data set with a tiler and dissolving it based on groups (row, column), the output is never what you expect, having filled holes or partially undissolved areas. I think the dissolver does not work properly because there are too many overlaps, holes in a single feature and holes between features -from reading the entire set .shp in a single reader- I have attached an image of a shp containing the 24 shp merged, but with no dissolver and a image of unexpected o

Hello folks, I am wondering whether there are any tools that can help me clip one 3D city model with another? This might be unusual thing to do, but its for analysis purposes (thesis). I want to substract one from another and vice versa to see differences between the two. Both files are in Shape format. Any way I can do that in FME?