Using transformers to modify data.
Recently active
Hi Community, I have an issue using RegEx in the TestFilter. This is what I do: It never returns any result. However, when I use the StringSearcher to do the same, The RegEx works well: Any idea what I'm doing wrong in the TestFilter? According to this article: https://knowledge.safe.com/articles/Error_Unexpected_Behavior/Regular-expressions-that-work-in-one-parameter-fail-in-another, the implementation is indeed different. However, the two websites for testing RegEx mentioned in the article resolve the RegEx well. How should the 'Right Value' be defined in the TestFilter? best regards, Jelle
Hello everyone,I have a problem with coordinate transformation with data in citygml format with LoD2 and to write to another citygml file. I use CsmapReprojector, define transformation parameters XFORM_DEF and nothing. My input data is in EPSG:31277 and that is Gauss-Kruger projection and it is deprecated. I want to transform data to EPSG:4326 or 3857 or 32634 on WGS ellipsoid because i want to use 3DcityDB import/export toll. Data in input projection:and after transformation i get this:
Hi everyone,I'm trying to compare 2 PostGIS spatial table (points representing airports) to detect changes. When there's a change in geometry, the change detector works great. But when there's a change only on an attribute in a raw, I can't find it!In fact I can find it if I select the right field name in the parameters (because I know wich field has been changed in my test). But it doesn't work when I select all attributes, which is the real situation. I need to detect changes on tables with unknown atrributes updates. Match geometry is always set to "none" in this case beacuse I want to check changes only on attributes. I've also tried to combine CRCcalculator, feature merger, update detector, tester, etc. but even for a very simple test - only one non-geometric attribute in a raw changed between the 2 tables - I can't find a way to make this change appear in a transformer output...Any help would be very appreciatedThanks!
I am running FME 2017.1 build 17725 on macOS High Sierra 10.13.3.I cannot add "DateTimeConverter" transformer to a workspace -> the application bails out.Tried multiple things: I re-installed FME (the latest build), etc - the issue still exists. I was wondering if anyone observed similar behavior. Kind regards,Alexander
Hello FME-Community,I am working with FME desktop 2017 and LiDAR point clouds. I have selected a certain number of LiDAR points that intersect with a polygon (shape). All these points belong to class 5 (tall vegetation), but I would like to reclassify them as class 6 (buildings). I have not been able to find any tool that makes this reclassification. Could you help me or give me an idea?Thank you very much.
I have been trying to label contour lines as a learning exercise into FME. I am starting to get my workspace more or less dialled, and am now trying to straighten out the last quirks. Have a look at the "600", "200" and "500" in the middle of the image. The Labeller has placed them at unfortunate spots, and they are rotated away from the general direction of their contour lines. It would look much neater if they where placed along a straighter stretch of their respective lines. How could I achieve this? I imagine that this would be quite resource intensive for a larger area? So method efficiency should probably be a consideration?
I have written an FME workbench hosted on FME Server that will be called by the Informatica application.The Informatica team want a logging mechanism via an Oracle non spatial table. The columns in the table areworkbench_id (published parameter filled by Informatica job call)workbench_name (fixed value - e.g Clipper_Perf_POC)run status (1 = run started, 2 = run success, 3 = run failed) They want to insert a log message at the start and a second log message at the end of a workbench.. What is the most elegant way to do this - start up and shutdown scripts, fmeserverjobsubmitter (aka workspace runner)? Is it worth adding the fme server job id to the table...the workbench_id parameter filled by Informatica is not very informative for further investigation within FME Server.Any tips would be appreciated.
We are rebuilding our entire GIS analysis platform and are trying to map our exisiting processes to something better.We receive ArcGIS model builder scripts from our Asset team that have no FME experience. Currently they are scheduled using Windows Task Scheduler. One suggestion in the team was to load these model builders as ArcGIS Server geoprocessing services and then use FME Server to call/schedule the geoprocessing service.Can FME Server start an ArcGIS Server geoprocessing service? Would it be better to export the model builder scripts to python and use the PythonCaller transformer within FME itself?Is anyone using either of these methods?
Hello FME-Community,I am working with FME desktop 2017 and with a raster layer of altitudes. I would like to obtain a new raster layer from the previous one, which shows a range of altitudes between 100 and 200 meters. I am new working with FME and I still have not been able to find a tool to perform this operation. Could you help me or give me an idea?Thank you very much.
Hi there,I'm using the Coordinate Extractor tool to extract the elevation values at the beginning and end of a line so that I can calculate the slope of the line. To identify the starting coordinate of the line, I'm using coordinate index == 0 and to find the ending coordinate on the line, coordinate index == -1. However, I'm confused as to whether the first coordinate on the line refers to the left- or right-most coordinate on the line. Since I'm looking at the slope of lines, it's important to know whether the elevation associated with the first coordinate references the right or left hand vertex of the line because it would indicate the direction of the slope; for example, if the first coordinate is defined as the left-most vertex of a line and is higher than the right-most vertex of the line, I would be able to say that the slope of the line moves downward left to right.For context, I'm creating a map where I'm trying to identify the slope along vario
Dear experts, I have a dwg-file wich is told to be in RT90 5 gon W. I have not been able to position it right though, but now I think I have localized the issue. It seems like the two first digits of all the coordinates are missing. Therefore, I would like to add 6200000 and 1400000 to the coordinates. How is this done? I have tried to set up a new coordinate system with the right parameters but I just cant get it to show up in the coordinate system gallery? Is there maybe a better way?Thanks.
Please look at the image for better understanding and help me to solve this problem. Thanks in advance.
Hi,I am doing an update task where I need to update dataset A with the new lines from dataset B. Dataset B includes all of the lines that are already in dataset A plus a number of new lines. I am using a spatial filter to filter out just those lines in dataset B that are not in dataset A. In the spatial filter I am using "Filter Equals Candidate" as the test. My expected result is that the new lines would fail that test and appear at the Failed port, however all lines fail.When I do a select by location in ArcGIS with the selection method set to "identical to the source layer feature" and reverse the selection I get the correct new lines.I can get the spatial filter to output the data in the correct way (based on my test in ArcMap) but only if I add a coordinate rounder to both input features with the precisions set to 3. This however changes the output data making it inaccurate.Is there anyway I can achieve what I need to do using the spatial filter without introdu
I have trail data from two different sources and am trying to figure out where they overlap, and where they don't. There is any combination of A, B or A+B. Where the trails do overlap they misalign ever so slightly. I have tried two different methods but have not yet got satisfactory results out of any of them. Most promising so far seems to be Buffer plus the LineOnAreaOverlayer. My gripe here is that it creates small gaps, see arrows, where a small piece of a segment that does not actually overlap gets registered as an offender. The red is the outline of my buffer, the greens are coupled lines and the blues are singles. How can I keep the blue segments intact? All incoming segments have ID's, so maybe there is a way to rebuild them from that? It does feel like a slightly cluttered method that would also problems elsewhere. Some places the trail goes from A to B to A+B and back to B - and so on. Any ideas on how I could get this to work?Just as a side note: I began with a Anc
Applies to FME Workbench 2017.1If you apply a select statement on a DataReader (in this example MS SQL Non Spatial), it misreads the SQL if there are embedded comments, treating everything after the first comment as a comment, hence producing wrong result.My Sample WorkspaceHere is my workspace (a simplified version to illustrate the problem). I used a DataReader and a SQLExecutor to show the inconsistency in number of records read, resulting from incorrect parsing of SQL statement on the DataReader. Both the DataReader and SQLExecutor have the exact same select SQL. The correct number of records should be 98,792.DataReader select statement configuration:After I press OK and go back into it, looks like this:And now the SQLExecutor configuration:The SQLExecutor has the same SQL as above, yet produces the correct result. The Editor dialog automatically detects that it is SQL and gives the appropriate syntax highlighting (whereas the DataReader dialog doesn't).Conclusions:The Data
I am using a string concatenator towrite batch files for me.I am entering a windows path in the string concatenator (seebelow).%SendKeys% "E:\FME\Development Work\TimesheetAnalysis\Output\@Value(HomeTeamFP)\@Value(Name) @Value(DateFrom) to @Value(DateTo){ENTER}"But the string it writes out is %SendKeys% "E:\FME\Development Work\TimesheetAnalysis/Output\RUR370\Amy Hutsby 2018-01-01 to 2018-01-31{ENTER}"I.e. it changes to ...Analysis\Output... to...Analysis/Output... This then leads the batchfile to fail to work. It has happened several times and I dont know what iscausing it or how to fix it. Any ideas from anyone? Thanks
Hi,I was wondering, did anybody come across the invalid characters being shown for the domain values in the output while reading from an esri featureclass when the parameter is set to resolve domains.In my case, the domain description are having Arabic characters, for which my output is showing '????????'. Are there any settings or parameters in the workbench to set the character encoding settings or anyone come across such an issue and had a solution or work around.RegardsNandakumar
Hi, I'm trying to update the Z coordinate of some features by using the Surface Draper transformer. The height information comes from some GeoTIFF files, but after reading them I get the following error:Surface Model TIN is full. No room for vertices to be addedSurfaceDraper_5(SurfaceModelFactory): Fail to add a vertex to the Surface ModelI have tried using ascii files instead of the GeoTIFF, but the result is the same. I cannot figure out where the problem is, can anybody help?
Hello, I am trying to achieve an apparently simple task: using the Tester, I want to Pass only the feature names that are in a list of names. I have extracted the unique values from an attribute and concatenated that list into a field named "_concatenated". Both the ListConcatenator and the reader are entering the "Tester" transformer. I then try to use the Tester by using "NAME in _concatenated" where "NAME" is the LeftValue and "_concatenated" is the RightValue. For some reason, nothing passes. If I enter in the RightField the value of the "_concatenated" box, it works. Not Working:Working:
Hello everyone,I have line feature which I have to buffer and dissolve. When I use the bufferer and dissolver, it takes very long time because I have a large amount of feature. If I Buffer the lines with group by fme_feature_type than the output buffer polygon is completely dissolved. I do not need to use dissolver. But it takes also much time. I tried this way with small set of features, it is faster than using Dissolver. But it shows this massage and running with a long time. Should I have to use any additional transformer to improve the work-space? I attached my workflow below. Constructing donuts from 11750 features...PolygonDissolveFactory: Completed 100% of processing on pass 5.Completed 379339 segments of intersection processingPerforming low-level intersection at phase #1... 3.44% donePerforming low-level intersection at phase #1... 100% doneCompleted intersection processing, phase #2. 2 new nodes were generated among 11599 intermediate linesFinish splitting 11600 lines i
Good afternoon,I've been working on this process for quite awhile with no luck. The objective is to convert a CAD drawing of interior spaces. I took the original CAD exterior walls (BLUE), and created polygons. I then used a centerline replacer to create the middle line (RED). However I cannot extend the line. I've tried intersector and snapper\\anchor snapper, no luck. I've also tried line extender, intersector, snapper and again the lines will not budge. I'm at a lost. Any help would be greatly appreciated! The large gaps in the front of rooms are for doors, which I have worked around. These wall lines are my biggest problem. I'm thinking Python might be a better position.Thanks, David
sample.pngI have generated output using schema (any format) reader to read from ESRI geodatabase and supplied both database name and layer name as parameters. I used ListBuilder and ListSearcher to search for the layer in a database. FeatureReader is used to read the data and DynamicWriter to write it to postgis. I got the output with some unnecessary fields listed in the attributes image and actual workspace can be seen as a sample image. How can I get rid of this attributes automatically. I tried attributes to remove option in the Writer but it is a manual process. I tried attribute remover with no luck. Any help is appreciated.
More information for my question. We are not using SQL AG in our system, ideally we will move to this. For now, I have 75 tables in one database that has roughly 300 tables. I only want 75 table in this data copy. We are building this new database as a 'datamart' for reporting and other tools to pull data from this source, as to not effect our Production system. I am testing this today and I am finding the data takes longer than I expect to copy from one server to another. I am testing this using Workbench for now but once I have good results, I'll push the workbench to FME server to schedule this work. For my first test, I am pulling all data and I see the 2500 features are pulled at a time. I am using a static reader not a dynamic reader. For my second test, I will refine the data from the larger tables (over 1 million records) to add in a where condition to limit the number of records we pull. I am attempting to get this to build within 5 minutes. I am looking
Hey I am curious to know if fme can export to landxml with points, Lines and attributes to the objects ? I am new in the use of FME. And it could be nice to get some guidelines on how to do it.I have looked at https://knowledge.safe.com/articles/1203/creating-landxml-files.html but I think it is hard to understand what is going on in the template. Thanks