Using transformers to modify data.
Recently active
I want to categorize all properties across BC based on the federal electoral districts. I have the Esri Geodatabase file format for the federal electoral districts and have all the properties with their latitude and longitude information stored in a table. what will be the best approach to resolve this ?
Hi everyone,For each record in the CSV file, I want to find the closest point to it from a SpatiaLite database using SQLExecutor. What's the most efficient query that I can use to tackle this task because my SpatialLite DB contains over 35 mil points? Thanks in advance!
Hi, I am trying to pull some content from XML and making a mess of it.I use the XMLFragmenter extract from this:<?xml version="1.0" encoding="UTF-8"?><wfs:FeatureCollection xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:wfs="http://www.opengis.net/wfs" xmlns:gml="http://www.opengis.net/gml" xmlns:workspace_wfs="workspace_wfs" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" numberOfFeatures="5" timeStamp="2019-10-11T13:52:44.446Z" xsi:schemaLocation="http://www.opengis.net/wfs https://geoserver.xxx.com/geoserver-cluster/schemas/wfs/1.1.0/wfs.xsd workspace_wfs https://geoserver.xxx.com/geoserver-cluster/wfs?service=WFS&amp;version=1.1.0&amp;request=DescribeFeatureType&amp;typeName=workspace_wfs%3Abasin_models"><gml:featureMembers><workspace_wfs:basin_models gml:id="basin_models.48"><workspace_wfs:changedetect_date>2019-09-11T09:33:46Z</workspace_wfs:changedetect_date><workspace_wfs:changedetect_uuid>46af9f38-5edd-4b33-8f15-6c
I need to join fields from one table to the another. Because of the nature of the join, I only want one match per record. If there is more than one match, that is redundant data. It looks as though the FJ is adding records when there is more than one match.Can I tell it to take the first match, so that my output has no more records than the input - "Left" table? Thank you, Randy McGregor
Using FME2019.1 I get some unexpected behaviour of SpatialRelator3.Instead of 'merging' values from SpatialRelator & SpatialRelator_2, FME seems to copy attribute values from one attribute to another. (see screenshot).'grafnummer' & 'bloknummer' should have different attribute values but FME seems to 'copy' values for both attributes. This behaviour does not occur when running the workspace in 2018.
I had a BulkAttributeRenamer with the following parameters: To remove all attributes that have names with invalid characters. But this setting holds the entire process without error. No features going in. If there is a blocking transformer before the BulkAttributeRenamer you will see log Messages going out of the last transformer before the blocking transformer. But nothing after that. First i thought that the blocking transformer would be the bug. But changing the settings of the BulkAttributeRenamer to Text to Find: [ \\\\] fixes the process.The bug is in:2019 beta2019.0.0.1 The bug is not in:2018.1.1.2
How can I write the selected attributes to CSV from AttributePivoter?I don't know the names in advance it's a dynamic list of attributes.
I'm migrating a project from FME Server 2018 to FME Server 2019.0.0.1 (build 19246) and am seeing this error when running a workspace on server 2019 that used to work on server 2018.50InlineQuerier (InlineQueryFactory): An error occurred while creating the table 'features'51InlineQuerier (InlineQueryFactory): Database was unable to define table 'features'.52A fatal error has occurred. Check the logfile above for details When I run the workspace locally in FME Desktop 2019.0.0.1, I don't get the error. Here's a mini workspace that has the same issue: What can I do to get my workspace running on server 2019?
Hi all, I am trying to calculate the surface area of different LULC classes. I have to do this for very many different polygon areas, using the Rastertopolygoncoercer takes too much time, so I do this by counting the pixels of specific values, and then calculating the surface area based on the pixel size of my raster. Ordinarily I would do this with the ArcGIS Zonal Statistics function for rasters with the "count" functionality and be done with it. This does not seem to exist in FME, the RasterStatisticsCalculator misses this feature (and only that feature, strangely). So what I do instead is per class, replacing the cell values with 1 (and all others 0), and then calculating the "SUM" with FME's RasterStatisticsCalculator. It gives me the result I want (in a cumbersome roundabout way) but then, I want to save the attribute table separately from the raster. Because when I do a rasterstatistics of the individual rasters (which are clipped with the polygons, and t
Hello everybody,I just have one tricky issue - how can FME detect attribute value, which is composed strictly by white spaces, e.g. ? Its not empty value in DB view, but it is hardly detected. Any idea please?It doesnt matter on count of white spaces.Thank You so much!Lubo
As question title mention it, I would like to split an Access table's fields to be able to connect transformers on several fields in order to achieve date formating.I've been able to connect one field (DConseil) but I wonder how to connect specific transformers on the others date fields and let them work simultaneously, if it's possible.I've tried several times to redirect features through spliting, filtering, testing, and so on but I'm certainly thinking the wrong way.To keep it simple : how can I achieve a "routing" before adding transformers on each ports.Sorry for any duplicate but I didn't find any valuable answer to my problem for now.Thanks in advance for any help.Pierre.
Hi everyone, I have a geometry question.As you can you in the following image, I have three different circles that overlap. How do I extract the red lines?
Hi All,Thanks to all the experts for providing solution to my transposed doubt sometime back.Here is an another challenge that i faced with now. I now have multiple columns instead of two.where [A-R] are the required column names and the data from column 2 to last column should be the rows. Now i want two solutions:1) Transpose only the given data in pic (must need)2) The set of required columns (A-R) will repeat for the next file(when reading batch files) and needs to be given a common id and the entire data transposed. (optional) Kindly help. Thanks
Hi All,It seemed a bit easy but i am stuck with it now. Can someone please help?My input is somewhat like this: and my desired output is like this:The 6 values (Acquisition date, Analysis Date, System, Method, Sample ID and Data filename) are repeating three times in first column and have different values. I have attached the excel file for your reference.
Need a outputOutput from JoinerMy linked xcel file
Hi, I have observed that the pixel values of sentinelhub data and S3 bucket data are different. I have tested by downloading same date tiles from sentinel hub and FME S3 Bucket. Do anyone know why the values are different? or which data to use is preferable like is the error is in sentinel hub or S3 bucket or FME extraction.
Hello,I'm trying to figure out a way how to do a data profile, similiar to skim in R.Something like this:But idealy without having to use the Python, or R caller...The statistics calculator does count, min, max, etc, that helps. But I need unique, missing and nulls as well.Is there a simple way how to do this in FME?
Hi, We have a workspace that runs fine on our FME Server testing environment yet crashes on our user acceptance environment. It crashes on version incompatibility, like described in the article at https://knowledge.safe.com/articles/363/workspace-fails-on-fme-server-fme-version-incompat.html. Granted, we use FME Server build 17650/win64/2017.1.1.0 and FME Desktop build 17652/win64/2017.1.1.1. that would be a cause for not running a workspace due to compatibility issues.However, this baffles me: FME Server version is the same, workspace is the same, what else could cause this behaviour? I narrowed it down to the workspace below, which is basically a SpatialRelator comparing two box-like area's. Our testing environment runs it just fine, and concludes in the log:2019-10-09 12:23:30| 0.3| 0.0|INFORM|Loaded module 'SpatialRelationshipFactory' from file 'D:\Prog\FME\FMEServer\Server\fme\plugins/SpatialRelationshipFactory.dll'2019-10-09 12:23:30| 0.3| 0.0|INFORM|FME API version of modu
I have downloaded a date range images of sentinel 2, performed clipping (polygon) and calculated NDVI. Then I have converted raster to point and extracted each pixel values parallely extracted coordinates from coordinate extracter. So in attribute table I have date for each pixel, NDVI value of each pixel , latitude and longitude of each pixel. But I need attribute table structure as Latitude, Longitude and each day Ndvi values. So each date of image generated should create a column and writes NDVI values for same lat longs.
Hello,I want to find a regex with python caller. The text_line is like Híd neve: Líra utca - gyalogos híd. And I want to get only: Líra utca - gyalogos hídI was able to do it with StringSearcher, where the expression for the regex was like : (?<=Híd neve: )\w.* Now I am tring it within python, but it doesn't give back value (it should be like: Líra utca - Ördög-árok feletti gyalogos híd)Could you help me, where is the mistake?class FeatureProcessor(object): def __init__(self): self.comp_re = re.compile("(?<=Híd neve: )\w.*") #pass def input(self,feature): text_line = feature.getAttribute('text_line_data') matches = self.comp_re.findall(text_line) if matches: feature.setAttribute('PyTrackExtents', matches[0]) self.pyoutput(feature)
This is very country-specific as Interlis is only used in Switzerland, and FME relies on a plugin (Eisenhut) to read/write Interlis-Data.I have done a lot in Interlis1 (ASCII), which always worked like a charm. No I am on my first Interlis2 (XML) project, which also worked fine just to this problem.FeatureTypes and their attributes in Interlis are set by an Interlis Model (*.ili). In this model there is also set which "attribute" is used to store the geometry per featuretype. So, e.g. a line in interlis stores its geometry in the attribute "Lage" (which stands for "position" translated in English)For the Labels, I now have two Classes "InfrastrukturHaltung_Text" and "InfrastrukturKnoten_Text". For this Label-Classes the defined attribute for geometry is "Textpos" (stands for "textposition"). My problem now is, that after importing these two featuretypes, FME always writes them without the geometry attribute. There i
Hello!I am learning to use PythonCaller. I want to write an attribute into a new attribute. My code is running without fail, but it doesn't write the value (data) into the new attribute (item_no).Where is my mistake? class FeatureProcessor(object): def __init__(self): pass def input(self,feature): #for n in range(10): new_feature = feature.clone() data = feature.getAttribute('Data') new_feature.setAttribute('item_no', data) self.pyoutput(new_feature) def close(self): pass
Hi everyone,This is what I have currently: And this is what I want: Thanks for helping in advance!
My agency flew high resolution drone aerial imagery and need to blur certain areas of the image, for example certain members of the public have asked that their backyards be blurred for privacy reasons. My rasters are very large GeoTiffs.If it were only a few locations I would simply use GIMP/photoshop, however its looking to be a significant number of locations that need to be blurred. I have created polygon features around the regions that are to be blurred, I am assuming that FME can blur the raster areas contained within the polygons without me having to clip those areas out, blur them, and then mosaic them back over the original image? Clipping & re-mosaicing would take a long time since the images I'm working with are >100GB.Searching the documentation references to the RasterConvolver however I don't see how I can apply that only to the areas within the polygons.Is there a good method to achieve my goals with FME or should I stick to GIMP/Photoshop??
Hi. I'm working on a workbench for migration of some data from one datamodel (MS Access) to another (MS SQL Server). One of the original tables contains information about contracts and contains the following fields:contractid - companyid - signedDate - expirationDate - revisedid - revisedDateWhen one of the contracts (A) has expired and has been revised, a new contract (B) has been added to the table and the field revisedid in the former row (A) is updated to contain the contractid to the latter one (B).My problem is how to add this in the new datamodel. The corresponding table in the new datamodel has a identity field as primary key (ConsessionID), and the table does not contain any reference to the old contractid. I've added a featurewriter-transformer to write the new row, and I need to update the rows with the new contractid for revised contracts. What's the best way to accomplish this? My first (and best?) guess is to use a featurereader after the featurewriter, to get