Using transformers to modify data.
Recently active
Hello,I want to know if 90 columns have NULL values.How can I use Tester Transformer without testing each attribute one by one.Can I use the Text Editor and write it directly and how ?Thank you !
Hi, I have two shapefiles that represent two boundaries that are suppose to align in a perfect world but due to updates, they are now misaligned. The datasets are for the whole province and I need to find the area/ the specific part of the boundary that does not align with the other boundary. The boundaries are polygons but then are transformed into lines, and I need to find a way that the line that is misaligned with a 10 meter tolerance will get highlighted. I have tried neighborfinder and spatial relator (+using buffer for 10m tolerance) but the softwares outputs keeps highlighting the entire polygon or an entire section of lines (even though one line might be misaligned). Does anyone have any suggestions or ways to go around this? Any help will be greatly appreciated! Thank you.
I have 4 custom transformers saved to C:\\Users\\{username}\\Documents\\FME\\Transformers. I double-clicked them to install and they all installed successfully, but they don't show up in Workbench Transformer Gallery. I have clicked "refresh" and restarted Workbench, the refresh appears to run but doesn't generate any success or error messages. Any ideas how I could get these to display? I am running Workbench 2021.2. Thanks.
I have a few datasets of polygons and need outlines of the extents of each. Each polygon dataset has on average around 10,000 features and I need an outline of the extent of these to use in further processing stages e.g use as a clipper. Using the raw polygon data as the clipper instead is not an option due to how slow this makes the processing. I have tried dissolving the polygons however this does not make a single polygon for the dataset as some of the features are not adjacent to each other. I then tried aggregating, which does achieve what I wanted however is useless for further processing as the aggregate is deaggregated by most processes - effectively slower than just using the raw polygons.Hull building looked promising but does not accurately replicate the intricate boundary of each dataset. In ArcGIS it is possible to dissolve based on a common attribute rather than requiring a shared boundary. Surely there is a way to replicate this process in FME?
error log:QUEUED:trigger success:
I'm using a point on line over layer to split a long line into sections, I then need to create start and end points of each section. Simple process i've done a million times. This particular output needs to have the coordinates identical at the start/end of each section, theoretically they should be as they are split by the point at that location. The measure values are coming out identical, but some lat/longs are coming out wrong to the 9th decimal place - the issue is that its only a handful and so i'm not sure whats causing it. Any ideas?
Hello, I have a series of points that I would like to convert to a polyline feature. I have used the below workbench to accomplish the majority of it, but I'm stumped trying to fill in the gaps (in the line). Can anyone point me in the right direction?
I´m right now trying to learn the basics of FME and have been busy doing calls to open data in Sweden, primary published as json files. I have managed to read the, and explode a list and write back to an excel file. I now try a larger dataset of about 1 million rows. I can not figure out how to extract more than the limit 500 records. I have tried searching in the forum an Google without understanding how to proceed. I attach the links to the dataset below. I would realy appreciate if someone could show a setup that loops and writes all data to a csv for example. Dataset:https://www.vgregion.se/ov/dataportal-vast/#esc_org=https%3A%2F%2Fcatalog.goteborg.se%2Fstore%2F6%2Fresource%2F1I try using this download URL: https://catalog.goteborg.se/rowstore/dataset/ce5b8afd-6721-49c7-9ebc-f1ad33fba266
OK, here goes. I have some data in a SQL Server database but it is stored in an object-oriented fashion which means a normal SQL query doesn't work, I have to pivot data in order to create a traditional tabular view. Now that in itself wouldn't be a problem, but all data is stored in the same location with each asset class (e.g. door, window etc.) having a different number of attributes, so depending on how I pivot I get the relevant attributes as fields. All good so far? OK, so I want to push this data from the source database into the target database (Oracle in this case) and the method for doing this is currently using SQLCreator to create the fields by which I want to pivot (based on the asset class as a parameter) and then SQLExecutor to retrieve the pivoted table, which works, up to a point. What doesn't work is that the attributes of the output from the SQLExecutor are not exposed, and I can't get them to be exposed without Populate from SQL Query option, which fails as it
I am using FME 2019.2 to read multiple Autocad drawings (r.2018) and then write them out into a single combined DWG. I've referenced a template file with all of the block definitions in it for the writer, but cannot seem to get any of my CAD blocks to write. The log tells me that "AutoCAD Writer: 3189 feature(s) were rejected and not written to the destination dataset", but doesn't give any hint as to why they were rejected. I've tried this using both the RealDWG and Map OD readers & writers, and I've tried it both with and without a DWG Styler transformer. Why are my blocks getting lost in translation?
Hello FME community, I have a long number (see the picture). I want only up to 3 decimal places to be displayed. Thanks in advance for your help
Hi folks, When working with XML files, often I find it really usefull to be able to use the XSD reader to directly structurize the XML in FME feature types, AND to be able to use the known XML schema to generate the correct schema (attribute names, list elements, data types etc). However, when working with the XSD reader, I noticed something peculiar, which I think might be a bit of a bug. The thing is, when you select a feature path, FME will generate a feature type with all attributes/lists that are contained at that path.What I think is quite nice and usefull, is that when you select both a feature path and a subpath of that feature path, the attributes/lists that belong to the subpath, are not included in the feature type of the parent path. So in my case, when I select only 'msg:GMW_PPO' for the feature path, the feature type contains all contents of that feature path, including a list attribute for the subpath 'msg:GMW_PPO/msg:monitoringTube'.If however I select
I have a layer with 75 parks. I need to buffer all of them with 300 meters. But after this I need to clip the buffers with roads and railways(barriers). When I done this I only want to keep the polygon that are on the right side of the road. Sometimes these areas intersect an other park. So if I go for spatialfilter areas are kept even though they should not be. On the pictures below I only want to keep the selected polygon(yellow) because that polygon are intersected of the orgianal park. I've tried group by i spatialfilter but get no success. Is it possiable to solve this? Have attached my workbench with orginal data. best regardsJesper
I have a SQLExecutor that runs fine on Desktop but does not output any results on FME Server. The Server log file indicates that the SQLExecutor created results but that they are not being output to the downstream workspace. Any idea why Server might be behaving like this? Here's some log output from Desktop:2021-11-02 12:06:53| 492.3| 0.2|STATS |SQLExecutor_4_RESULT Feature Counter -1 361 (TeeFactory): Cloned 132885 input feature(s) into 132885 output feature(s)2021-11-02 12:06:53| 492.3| 0.0|STATS |SQLExecutor_4_INITIATOR Feature Counter -1 2147680433 (TeeFactory): Cloned 1 input feature(s) into 0 output feature(s)2021-11-02 12:06:53| 492.3| 0.0|STATS |SQLExecutor_4_<REJECTED> Feature Counter -1 2147745969 (TeeFactory): Cloned 0 input feature(s) into 0 output feature(s)Note that it says "Cloned 132885 input feature(s) into 132885 output feature(s)" And here's the equivalent section from the Server log:806 2021-11-2 04:10:34 | SQLExecutor_4 RESULT Transformer Output Nuker (Te
How to calculate lat long of this lines corner vertex points in FME with help of any transformer or any other useful method with any projection of the shapfile.Anybody can help in getting this Lat long or XY co-ordinated for this four corner positions of any randomn area with any projection.Just need to extract XY Co-ordinates. how can we generate or extract it. Please find below snapshot for reference to understand it better.
Hi, I have a postgresql database I am writing to it has the following fields: changedetect_date timestamp without time zone NOT NULL DEFAULT now(), changedetect_uuid character varying(36) COLLATE pg_catalog."default" NOT NULL DEFAULT uuid_generate_v4(), pk_index integer NOT NULL GENERATED BY DEFAULT AS IDENTITY ( INCREMENT 1 START 1 MINVALUE 1 MAXVALUE 2147483647 CACHE 1 ), All these fields do not need to be inserted into by FME but FME is trying to insert NULL's into them even through the fields are not explicitly set in my feature writer (set to automatic and does not have these fields). When it inserts postgres gives an error 'ERROR: null value in column "pk_index" violates not-null constraint DETAIL: Failing row contains (...'POSTGIS writer: A fatal error has occurred. Check the logfile above for detailsSuccessfully closed POSTGIS database writer=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- What can I do to get around this? I tried using ma
Is it possible to resample a raster so the values left are one of the existing band values? If I use the raster re-sampler with the average 16 interpolation type, I get an average of the 16 cells but what I need is the value that occurs the most in these 16 cells.
Hi folks, I started using the Tygron API, which I used to extract building information for a specific location/site. However, when I request the building information, the response body is a JSON Array with JSON Objects of which only approximately 1/3 of the JSON Objects are actually about buildings. To determine if a JSON Object is about a building, I'm checking if it contains a "BAG_ID" attribute. Below is some a sample_json Array that illustrates the data structure I'm working with:[ { "id": 1, "name": null, "attributes": { "type": "Bridge" } }, { "id": 2, "name": "just a shed", "attributes": { "type": "Shed" } }, { "id": 3, "name": "just a house", "attributes": { "type": "Building", "BAG_ID": 1.5010000000035E14 } }]In the real world data, the JSON Array contains a lot more features and data. Initially I queried out the JSON Objects on buildings using the following steps;JSONFragmenter (create features for individual JSON Objects),JSONExtractor (Extract BAG_ID at
When dealing with JSON data, I sometimes like to use the JSONiq XQuery extension to manipulate JSON data a bit more directly. For example to be able to directly query for only relevant data (see e.g. this question), or directly setting list attributes for portions JSON without the overhead of fragmenting/flattening the entire JSON structure (see e.g. this question). I've been quite happy with the flexibility that the JSONiq XQuery extension seems to bring me, but as I'm using an XMLXQueryExtractor for this, this seems like a bit of a hack, and thus it might be that JSNOiq is not officially/fully supported. For example, I also came across the situation where I wanted to check if a JSON value was equal to null or not. At first I had a look at the JSONiq specification page. There in the Revision History (at the end), I found this line below Revision 1-1;Removed the function jn:is-null() because it is redundant with the "eq" and "instance of" operators which sup
Hello,I am using Aggregator with FME 2018.I restricted my data to only one feature. So literally there no aggregation but the transformer is taking 10 min to proceed.Is this normal? Is there a way to optimise it?
I have created one text attribute using the AttributeCreator transformer and by default, its length is 50, there is no option to change this length in FME. This attribute is created for the feature class to save filename which is over 50 characters.
While converting Ecw the following error will appear ECW writer: The ECWJP2 SDK only has 200.0 MB of memory allocated to it and this is not enough to compress this dataset. Please set the SDK's memory limit above 304.7 MB
My input has a lot of Ring looking objects in it, when viewed from Autodesk everything is smooth but the FeatureReader doesn't see them as rings, but some dumbed down rectangular shape. Reader: How it should look:How it looks: What I've tried was extracting coordinates and rebuilding with Python and Scipy and it seems that for some reason it has ~380 coordinates in it but 12 duplicates of each exactly at the points where the ring seems to 'break'(coordinates only appear there, nowhere else), could this be source of the issue? Or where should I look? I'm trying to write these to a Cesium Tileset but I don't think that should be relevant since the rings show up like that the moment they get read and not just in the output. Thanks in advance!
I want to read all features in the mxd or gdb and write to gdb. How can I do this with only one reader and one writer
Hi guys,just wondering when using AreaOnAreaOverlay on single input, can it add attribute to show which records's overlap which? Currently i only get the overlap count option but ideally I'd like each record to be added as an attribute field and with a return value so i can see. Thanks in advance 🙂