Using transformers to modify data.
Recently active
Im simply trying to get fme to use FileCopy (so that I can copy csv files inside a large zip file (about 4 gigs)) to a network folder. I only used a reader with format set to CSV, dataset set to the path of the zip file, and workflow options set to Individual (connected to filecopy writer). Are there any issues with fme and large zip files? Is there a better method to extracting a specific file type from the zip than what I used? Thanks for any help--latest error states: "failed to open file. failed to get any schema from reader". i am able to manually use filezila or 7 zip and perform this
Hi All, I'm working with 3D solids (buildings) and sometimes they are made up of surfaces from which the orientation (order of the vertices) is not the way I would expect them to be. This causes that for some of the surface I'm looking at the 'inner' side in stead of the 'outern' side when visualising them. Is there a good approach to 1) detect these "wrongly oriented" surfaces 2) correct these "wrongly oriented" surfaces ? (The SurfaceReverser can turn all orders of all the vertices for solids, (making inside outside and vice versa) but that is not what I'm looking for) Thanks
Hello all,I have two questions. 1- Is it possible to replace regex with a regex? For example, I want to add a dot after every numeric value before any letter. StringBeforeAfter 1 7 St7. Street21 Av1. Avenue@ReplaceRegEx(@Value(POI_NEW_NAME),^\d\s\w,^\d\.s\w,))Search: ^\d\s\wReplace: ^\d\.\s\w2- I have different variations which I need to manipulate. Is there any possibility to use different expressions in a text editor of an AttributeManager? I tried to use "|" symbol for this purpose but it didn't work.@ReplaceRegEx(@Value(POI_NEW_NAME),^\d\s\w,^\d\.s\w,))|@ReplaceRegEx(@Value(POI_NEW_NAME),\d$,$\d\.))Sorry, if it's a duplicate question but I couldn't find a similar case.Thank you
I want to aggregate or dissolve a set of input polygons based on 3 fields - Authority, Category, Site_Name. So where these values are the same, there should be one output feature. If the polygons are not adjacent, a muti-part feature should be output (File Geodatabase). If they are adjacent, then I expect them to be merged. However this is not happening. I've tried both Aggregator and Dissolver, individually and together. The boundaries may not be shared, but I believe the polygons overlap, so why aren't they being merged?In the attached image, the blue fill is the input, and the hatching is the aggregated/dissolved polygons.Also, there are 2 blue polygons on top of each other in the middle, but in the output there's no polygon visible.
I would like to ask how can I filter data by using Tester consider condition:ATTRIBUTE_ABC - contains - "max. 1" or ATTRIBUTE_ABC - contains - "max. 2" or "max. 3" etc.how can I generalize Tester by substituting number 1, 2 or 3... to don't build x number of testers.
Hi, In the attached workspace I am having issues with the spatial filter and attribute pivoter transformers.With the spatial filter, I am trying to output from the buildings Mapinfo table reader, the buildings that intersect the filter layer, comprised of buffers for different simulations. In the attributepivoter transformer, I am trying to show a count of flood vol, separated into columns for sim (there should be six simulation columns), for each propref (row).There should be numerous proprefs where there are flood vol values for more than one sim, I am struggling to recreate this. Also struggling to bring through all six sims as columns. Any ideas how to restructure this?Thanks
As per Bentley, XML attributes are stored in Xattributes. Does FME support these attributes ? I am using FME 2018.
Firstly, yes I know that there are already answers regarding measuring points along lines, but trust me I've read them on here, and I'm still not getting an answer. So I'm clearly doing something wrong.Ok, so I have a series of 3d points (recording x,y,z) as a shapefile. These all occur along a single line of section. I also have that line of section as a polyline shapefile. All I need to do is measure each point from the start of the line.It "should" be easy, I'm sure of that. But I've tried all the ideas posted by people like @takashi and I still have no joy.My setup so far is -A reader for each shapefile (one point, one polyline), PointOnLineOverlayer, into a MeasuresGenerator then a MeasuresExtractor. But I get no measurements output. You're help would be much appreciated.Steve T
Does anybody know if it's possible to use a dwg template with a block and then set parameters in FME so the block is 3D-rotated in the resulting dwg-file?
Is it possible to do a substring(0,10) with the BulkAttributeRenamer? I want to simulate truncating the columns as writing to shape does. I know I can do this with a SchemaMapper, this is my current workaround.
Hi, I can't find an explanation in the doc about what this error means so that I can avoid it. I'm using a Clipper with Clipper Type 'clippers first' for performance. I'm grouping by row and column tiler output columns which are unique although I do have multipart polygons.
Hi all,I have a check-in text data file with long/lat information, ,example as below:[user] [check-in time] [latitude] [longitude] [location id] 196514 2010-07-24T13:45:06Z 53.3648119 -2.2723465833 145064How can I convert it into point features? I tried several times but unsuccessfulThe data file looks like this:0 2010-10-19T23:55:27Z 30.2359091167 -97.7951395833 22847 0 2010-10-18T22:17:43Z 30.2691029532 -97.7493953705 420315 0 2010-10-17T23:42:03Z 30.2557309927 -97.7633857727 316637 0 2010-10-17T19:26:05Z 30.2634181234 -97.7575966669 16516 0 2010-10-16T18:50:42Z 30.2742918584 -97.7405226231 5535878 0 2010-10-12T23:58:03Z 30.261599404 -97.7585805953 15372 0 2010-10-12T22:02:11Z 30.2679095833 -97.7493124167 21714 0 2010-10-12T19:44:40Z 30.2691029532 -97.7493953705 420315 0 2010-10-12T15:57:20Z 30.2811204101 -97.7452111244 153505 0 2010-10-12T15:19:03Z 30.2691029532 -97.7493953705 420315 0 2010-10-12T00:21:28Z 40.6438845363 -
Is it automatic classification methods in FME transformer?
I am comparing two feature classes in separate GIS sdes. I made a copy of one and put it in the other sde. So they were exactly the same to start. I changed the SYNGERGEN_ID value in one field in one record to test the update detector using . I expected that the one record would be passed through the update port. However, it is going out of the inserted and deleted port instead. Thank you in advance for your responses.
As a proof of concept, I want to use FME to find lines not connected to, touching or near any other lines. The nearness would be user defined e.g. keep lines within 10 metres of another line. I can't find an existing answer so I'm posting my solutions. I was inspired by @redgeographics answer to:https://knowledge.safe.com/questions/42455/lines-connected.htmlThe first solutions has 2 options for pre-processing. Either buffer the input lines by the amount required to take care of undershoots. This will obviously create polygons. Or use the LineExtender to do a similar job. The difference with the LineExtender is the direction of the extensions at each end (see documentation).Then send the pre-processing result to both the Requestor AND Supplier ports of the SpatialRelator. Choose the Intersects and Touches tests (regardless of whether you're using buffered or extended lines). Select ObjectID (or other primary key) as the attribute that must differ. Results with _rel
Hi, I have created some JSON in FME but would like to remove the first couple of levels.At the moment I have:[ { "output" : { "status" : "200", "body" : [ { "well_id" : 25325, "well_name" : "MYALL_CREEK_3", "latitude" : -27.046011, "longitude" : 149.236806 }, {etcideally I would like to remove the "output" level[ { "status" : "200", "body" : [ { "well_id" : 25325, "well_name" : "MYALL_CREEK_3", "latitude" : -27.046011, "longitude" : 149.236806 }, {Could you please tell me how to achieve this.For reference my workbench looks like: Many Thanks,Oliver
Hi, Im using an XML templates with a geometry template.I have a for loop and I have my positions in a list attribute.Whenever I use the variable for the indices fme:get-attribute("_Positions{$i}.y") I get no results but if I use the same value that is in $i it works, I don't understand why I'm getting no results.Here's the GEOM template with some extra rows added for testing that value 0 exists.for $i in (0 to (xs:integer({fme:get-attribute("_element_count")})-1)) return { <LineCoordinate> <Seq_No>{$i+1}</Seq_No> <latitude_position>{fme:get-attribute("_Positions{$i}.y")}</latitude_position> <longitude_position>{fme:get-attribute("_Positions{$i}.x")}</longitude_position> <latitude_position>{fme:get-attribute("_Positions{0}.x")}</latitude_position> <longitude_position>{fme:get-attribute("_Positions{0}.x")}</longitude_position> </LineC
I need to Dynamically change the Port Number in Workbench from Command Line before starting the FME workbench based on the Smallworld session
Hello, I am trying to run a simple FTP Upload operation by calling coreFTP using SystemCaller. This is the command I am using: "C:\\Program Files\\CoreFTP\\Coreftp.exe" -s ftp://TESTUSER:TEST_PASS44@pvftp.ftpsite.ca -u 'C:\\Users\\User1\\Desktop\\testupload.txt' -log C:\\Users\\User1\\Desktop\\temp.logThis works fine in command prompt but I can't run the same code using systemCaller. I keep getting an error that says that the file is not found. What am I doing wrong here? Any help will be appreciated. Thanks!Edit: I did a few tests and found out that if I take the single or double quotes off the name of the upload file, it works in SystemCaller. But that fails for file paths that have spaces in them. Trying to put % instead of spaces (I found that as a suggestion) does not resolve the issue. Any thoughts? Thanks
I am trying to extract the KML tags for the KML below (structure) using the XQueryxtractor transformer declare default element namespace "http://www.w3.org/1999/xhtml"; for $x in /html/body/table/tr/tdreturn fme:set-attribute($x/td[1]/text(),$x/td[2]/text()) the result is coming out empty. Any suggestions ?kml_description (encoded: UTF-16LE): <html xmlns:fo="http://www.w3.org/1999/XSL/Format"> <body> <table border="0" width="370" cellpadding="0" cellspacing="0"> <tr bgcolor="ffffff"> <th width="370" align="left"></th> <th width="370" align="left"></th> </tr> <tr> <td bgcolor="#ffffff">Manhole ID</td> <td>50283792</td> </tr> <tr> <td bgcolor="#ffffff">Life Cycle</td> <td>In-Service</td> </tr> <tr> <td bgcolor=
I'm using FME Workbench 2017.1.I have a reader connection with multiple features (tables) being read from it. One of the features (let's call it Users for example) uses a SELECT STATEMENT option to get additional information (I can run and test the select, it's valid and it works). Right before FME uses that select statement to "obtain features for feature type", I'll get a bunch of warning messages in the log output like this:WARN | Oracle Reader: Column 'ID' specified on Feature Type but does not exist in table 'SCHEMA_NAME.USERS' and will be ignoredThis will happen for all columns of Users. I can verify that the columns exist in my source table.Even with these warnings, the records of Users will be read and written to their new destination. However, every other feature type that needs to be read/written after Users (say Logins, Favourites, Friends, whatever) will give me the same warning message for each of their columns and will not write a
This is error message on the FME server.Microsoft SQL Server Spatial Reader: Connection failed. Connection string `Provider=SQLNCLI11;DataTypeCompatibility=80;Data Source=gis02;Initial Catalog=nlpglive;Integrated Security=SSPI'. Provider error `(-2147467259) Cannot open database "nlpglive" requested by the login. The login failed.However, on the desktop I almost the same error when I try to list the tables in the above databaseServer 2012 Native Client...Microsoft SQL Server Non-Spatial Reader: Connection failed. Connection string `Provider=SQLNCLI11;DataTypeCompatibility=80;Data Source=gis02\\sqlexpress;User ID=;Password=********'. Provider error `(-2147217843) Invalid authorization specification'However, when I test the connection it is OK and successfulIf I use a reader or writer I can see all the tables !Any ideas? I have tried SQL Authentication for various local and domain accounts still the same issue.
Since I installed the new version of fme (build 18284 WIN64), I can not get results anymore. missing value
Hi all,I have used Matcher to find duplicates. It works very well. I create "_match_id" attribute to create "small groups".The problem is there, I need now to sort into these "small groups" using an other attribute called "Hierarchy" (numeric attribute). The feature with bigger Hierarchy's attribute value into this small group (based on _match_id value) will have a red color, the other will have a blue color.So, I have to compare each value into this small group, keep the highest value and assign to this feature red color.I have to do this for every small groups.Any ideas ?Thanks
I have a network of sidewalk lines and multiple points of community centers. I want to select all those sidewalk lines that are within a certain distance along the network from all of the points. Select both entire lines and clip the lines at the specified distance.