Using transformers to modify data.
Recently active
In reader we have below cvs with one field.=================================Translation was SUCCESSFUL9.4 seconds. (CPU: 4.2s user, 2.7s system)================================== How I can get this in text like this: "Translation was SUCCESSFUL - 9.4 seconds."May be regex or something else
I have a need to check for data changes between two datasets (oracle tables). I initially configured the ChangeDetector comparing all of the attributes. The results were, all of the data from the “revised” port were identified as records to be added (some 300K plus records) and the data from the “original” port are identified as records to be deleted (som 300K plus records).There’s no unique key in this data. If I limit the number of attributes to check to 7 specific attributes, the “added” and “deleted” ports reflect more reasonable results. In other words, from a basic math perspective, the difference between the number of revised and original records calculate correctly (in the sense of finding “changes”).Essentially, all of the attribute values can change so I need to check for all of the attributes. I don’t understand why in configuring the ChangeDetector to check for all attributes, why the transformer behaves as if all of the records “changed”. I’m fairly new to using this parti
Hi, I've got a polygon feature as clipper, which has several polygons with no gaps and overlaps. After 500 meter buffering operation, there're some overlaps, and I'd like to use each buffered polygon to clip source data. But it seems that Clipper transformer couldn't perform such operation, in the help document it said "A feature can be clipped multiple times, but not iteratively (for example, if a line passes through two overlapping polygons, you don’t get a separate clipped line for the overlap - just one per polygon)."So I'm asking is there any way to perform a iterative clip?BTW, I use dynamic writer to output data, can I change output feature type name? I tried @jdh 's method, it worked but somehow, all fields of all features are same, but the original feature schema isn't that way. Is there a alterative method?Please help me out, much thanks!@takashi @mark2atsafe @markatsafe @jdh @david_r @erik_jan
I have a curb line represented as one object. However, I would like to split it at its "corners" (marked with the black circles). Apart from the curb line, I also have the street centerline.. Any idea, how I could get a satisfying result? Thanks!
Hi there!I'm using Workbench 2018. After a few weeks, out of the sudden the font of the 'Parameter Editor' and the menu of each transformer (the one you get by double click in the transformer box itself) got so tiny that I am barely able to read those texts.I would appreciate any help to get those fields back to their usual font size. I've tried with the 'FME options' in the 'Tools' menu, but it makes no difference at all.
Dear FME community, I have a question regarding trees along a road (alley trees). In the following example, the green points represent trees at the roadside, i.e. left or right side of the road. The red points are felled trees and can be ignored. We want the length of the road where there are trees in one row at only one side (example 1) and trees in an alley (examples 2 and 3). An alley is where there are trees on both sides of the road, but only if it is more than 50 metres long and if there are more than 8 trees per row. Perhaps there is an attribute way: we also have the measures on the road in addition to the coordinates, for example:Tree 1 at road segment XYZ has the station 50 and is located left. That means it is 50 metres away from the beginning of the road. Tree 2 at the same road segment XYZ with station 52 is located right side. If there are more than 50 metres of these "couples", then it is an alley which we want to identify. The total length is also stored in
I have set of polygons representing streets like in the image below. I want to merge small polygons like the selected orange polygon to their bigger container polygon.I do not know how to do this with FME. What would be a good approach?Thanks for any help!
I am reading the source file from an SFTP folder and storing it into an attribute for the purposes of later downloading the right file (as the folder read may contain various files).I use a StringSearcher transformer twice, once to identify that the files that are an xlslx and again to try and identify the date that is contained in the filename. I'll later discard the older files and only read in and store data from the newest file.The filenames are formatted like Test_Test_240519.xlslx but the logger/inspector suggests that only the first number is being returned in the destination attribute.The regex is a simple /d. I have also tried [0-9].We're currently on FME 2017.0.1.1 but will be upgrading shortly - maybe this is an old bug but it seems odd that I can't find anything about it online?
I need help creating two workbenches that convert DGN to a GDB, and separately a DWG to GDB?I have a huge workbench someone previous to my role has created, but it doesn't seem to work for all of the data. It is set to create a spreadsheet to show those that didn't work. Can anyone shed any light? I feel starting back to basics is better than tackling the giant workbench I already have, it's too confusing for me to crack, and it is sensitive information so I'm unable to share it.
Hello Team,I could able to zip a text file when i created separate workbench to zip the text file,But same thing when i did with my master workspace which contains different readers and arcSDE write at that time it is not giving output as .ZIP.What could be the reason for this unexpected results? and is there any other way around to fix the issue?I cannot use WorkspaceRunner as my master workspace run through server job.Following are the screenshots of my workspaces, Below workspace Zipping the downloaded file through HTTPCaller, Same incorporated with master workspace, Which was not giving expected results,
I have tried using the BREpSolidBoundaryCreator Custom Transformer that has been very kindly created by Takashi.I'm using FME 2019 (Build 19238)Log suggests some issues with Python libraries (see attached image).Has anyone else come across this ???Is this Transformer Compatible with FME 2019 ???.................Any help much appreciatedRegardsHoward L'@takashi
When creating a table in AutoCAD, I'm presented the dialog box below:I want that table to come directly into FME with the headers and associated data. I don't care about the title, if that matters. AutoCAD appears to be aware that the data in the table is organized according to the headers - is it possible for FME to read that table structure? The best I've been able to do so far is a list of individual entities (title, each header, each data) with the x,y coordinates exposed, which I'll then have to manipulate back into the original table. I'm hoping there is an easier way...
I am using FME Desktop 2018.0 to convert a kmz to shp. This is part of the workspace: I shorten field names longer than 10 characters to less than 10 in AttributeManager. The NetworkLink layer does not normally appear in the kmz files I work with, so I am curious if there are features there that FME is somehow missing. But NetworkLink does not appear as a layer in Data Inspector. The pink lines are from the FME converted shapefiles and the underlying darker, thicker lines are from the Arc converted layer: The layer converted in Arc has 4358 more line features than its FME counterpart. Any ideas how FME is missing the features?
Is it possible to stop further upstream processing once the number of features sampled matches the sampling rate when using First N Features?
Hi I have two tables, one with sites (2000+) and one with various Planning Allocations each with a Field specifying which it shows. The sites and allocation areas do overlap each other I need to find the percentage of each site covered by each allocation, 0 is unnecessary as an output It is expected that the percentage will exceed 100% in some cases (where a site is allocated twice) Any help with this would be great Thanks in advance Adrian
hello,i have a excel document that i want to change with fme. What i want is that colum A, B, C, D and E are copieed to another file if there is a value in a certain date (of colum F........till...AC) Here is the result that a want: U will see that a want that a row will be copieed if there are more values of a diffrent month, see row 20 and 21. i hope that u understand it, the document of excel is attached
Hello all,I am trying to join lines that have the same bearing (angle) but I am finding that the orientation of some are reversed.I have created two attributes bearing and back-bearing and have been successful joining based on one or the other when they are oriented the same way, but am stumped how to join when the orientation is different. In the example below the two pink lines are the same (but reversed) angle)The above shows the bearing in the first is equal to the backbearing in the second Any assistance would be very much appreciated.RegardsDean
We need to batch convert map zmap grid files (ascii) to ESRI Grid (ascii). FME has zmap grid reader which successfully read my zmap grid file. But just directly connecting ESRI Grid writer to the reader does not work. Does anybody have an example workspace to do this conversion?
Hi, I pull down a file from s3, zip it then upload it to s3 again.When I use the zip archiver it adds the file to a folder and zips up the folder which has the same name as the file. This is a little of a pain when extracting. Is there anyway to zip just the file without having a folder.Many ThanksOliver
After quite a lot of troubleshooting python packages, I have whittled the script in the PythonCaller down to simply importing some packages:import fmeimport fmeobjectsimport pclclass FeatureProcessor(object): def __init__(self): pass def input(self,feature): pass def close(self): passHowever, I still receive a Python Exception:Python Exception <ValueError>: numpy.ufunc has the wrong size, try recompiling. Expected 192, got 216which is being caused by importing pcl (python-pcl).I AM, however, able to utilize this package directly in python using the same interpreter. I only encounter this error from within FME.I have found references to Cython throwing warnings (but not errors) due to a reference to an older numpy version (https://github.com/numpy/numpy/issues/12785#issuecomment-455336738), but it seems that issue has been addressed and I do not encounter any warnings when I run scripts directly.At this point, I have to assume that th
Within more than 2500 Features in one Polygon shapefile I used a SpatialRelator Transformer to find out intersected polygons followed by ListExplode Transformer. The result as following example: My target is to select intersected features of highest related_candidates number (3 for above example). In some cases the highest related_candidates is 4 or more.Does anyone have any ideas or potential solutions? @mark2atsafe @egomm @david_r @jlutherthomas @jdh @takashi @redgeographics @danilo_fme
Hello everyone, I am a bit puzzled with what I thought would be simple, but is giving me a difficult time. I have aggregated polyline (Gas Main) and need to generate a point at any ends ( to buffer and capture streets within that buffer to show potential growth). In review what I need: A point to be created at any end of an aggregated polyline. Exported in ArcMap Esri GDB Thanks
Hi Nick, looks like I'm on the Avineon space OK but perhaps just you and me? The only thing I see here is questions, wondering how we can share things, have threads, etc. Perhaps a Skype or something to run this down. Talk to you soon. Jim
Dear FME community,I have a aggregated line with a list that looks like this: _agg_{0}.begin = 0 _agg_{1}.begin = 100 _agg_{0}.end = 100 _agg_{1}.end = 200 The above one is the ideal, correct one. Unfortunately, not all data looks like this. Here two examples. 1) I want to find gaps with no data, for example:_agg_{0}.begin = 0 _agg_{1}.begin = 102 _agg_{0}.end = 98 _agg_{1}.end = 200 2) If possible also overlapping data, for example:_agg_{0}.begin = 0 _agg_{1}.begin = 100 _agg_{0}.end = 102 _agg_{1}.end = 200 The values from begin(+1) should be exactly the same value as end(0) and so on.Any ideas how to solve this? Many thanks and kind regardsThomas
Hi,I'm trying to calculate the 1st the of the month using the end of the month date. Now I know the interval days for the months but I'm not sure how I can write this in FME.I've written out in plain text of an example if statement-of what I need.If end date month is equal to April,June,September,November then subtract P29D else if end date month is equal to January,March,May,July,August,October,December then subtract P30D else if end date month is equal to February then subtract P27D else if Feburary is in a leap year subtract P28DIs there an elegant way of using the Date/Time functions to calculate the 1st of the month? or would I need to use an if statement?I use an attribute called _endDate which is the end of the month.Josh