Using transformers to modify data.
Recently active
Hi,I have hourly rainfall data (observed and forecast) and i'd like to calculate a 7 day preceding rainfall total for EACH HOUR. My first thought is to use AttributeManager and adjacent features to sum the preceding 166 features (hourly rainfall totals), but it only allows up to 100 adjacent features. Any help would be greatly appreciated!Thanks.
Surface Model could not find 3 non NAN seed points I am trying to convert a .Tiff DEM to Minecraft format. Once it reaches the Surface Draper transformers the translation fails and I get the above error message.
Hello. Does anyone know how to use a transformer to change the time? I originally solved it by parsing the data via a string searcher, creating attributes and then compiling. This solution worked. It does not work for this date 20221201000000 (year, month, day, time 2022/12/01/000000 ), where I set the desired -1 second. I get 20221200999999 (2022/12/00/999999) in the output, but it should be 20221130235959 (2022/11/30/235959 ). I need a transformer that doesn't stupidly subtract -1 unit, but works with data like time. Thank you
Hi All,I need to identify exact attribute values changes when comparing two sets of data. The datasets have the same attributes but some attribute values are updated overtime and I need to identify which ones. I have been trying workflows with feature joiner and ChangeDetector, but I have to compare the datasets several times, discard attributes that remain the same until I identify which attribute value changed. I would like to find a more efficient way to identify the updates, any suggestion? Thank you
Hi everyone, I am using FME 2013 for comparing geometry and attribute changes between two Shape files, one being more recent than the other. The two Shape files have exactly the same type of geometry and schema (same attributes names and definitions). They also have a lot of attributes (more than 50 I think). I have set up a logic for reporting significant differences in geometry as well as records having at least one attribute value not matching with the corresponding one in the other set. The attribute matching part can be achieved rather easily with a ChangeDetector, Matcher or CRCCalculator. These transformers will report features containing at least one attribute change among those that have been selected in the transformer properties. Given the great number of attributes I would like to to identify which specific attribute(s) has(have) indeed been modified between the two sets. I don't see an option using the standard transformers mentioned above. I did manage to get somethi
I have an attribute that contains location information (text-based) but it will say something like “Lake View, Chicago, USA”. I want to create a column that just tells me “USA”. Note, the data isn’t regular, sometimes there are many locality details, sometimes just a country, and sometimes no country. How do I just pull out the countries?
If I reproject geographic information from geographic coordinates to projected coordinates, and before I convert to geographic coordinates again, the final information has a little displacement regard the original information. I don´t have any other process in between. The displacement is very tiny, but I need to know why is it produced. I´ve make the same process in Arcgis and it doesn´t appear this displacement. I can see the displacement in QGIS because this application allows to make a very big zoom to the information. I think that ArcGis doesn´t allow to make such a very big zoom.
If I remove the template file and write straight to Excel it is successful; with the template, FME crashes at exactly 32,715 records entering the Excel writer. I've tried a different template and a brand new template, but it fails at the same point. To confirm, the workbenches ran perfectly fine on v2018 and indeed it still does. (I have 2018 for the next couple of weeks crossover before it is being removed in favour of the 2021.2 version). I have looked on the 'known issues with 2021' online, but don't see this issue there (though it notes not all known issues are listed)
I want convert a pure table GDB file(without geometry infomation) to DBase format.It show me success and the result can be read by FME reader.But It can't be read by any open source dbf reader included "dbf view of Microsoft" and "qgis".I studied the document of .dbf from wiki and found that the schema definition of your dbase file is difference from document.You use "I" for integer, But document is "N"Is any way can I solve this problem?Please check the definition of data type in documentThis is hex view of your .dbf file
I have a workbench that transforms feature classes within the same sde to topojson files for each feature class. Currently I have the same feature in two feature classes that I am writing to topojson. However, the output topojson files are different for this feature. The topojson files are used in Power BI custom maps. One file does exactly what it should while the other doesn't. The issue is with that particular feature that is located in both readers and writers. I checked the number of vertices for this feature in both feature classes and they are the same (3045 - it is a large coastal feature). The output topojson contains different vertices count than the feature classes that is likely expected. But both output topojson files have different vertices count for the same feature: 3431 (topojson file that is not performing as it should within Power BI) and 3421 (topojson file that performs as it should in Power BI). I processed the feature class that produces the wrong output topo
Hello,I want write these in an OGC GML : <fme:AffleurantPCRS gml:id="id0ed4a56f-dd55-473e-a7f2-9ae5bcbf3af2"><fme:producteur>Producteur</fme:producteur><fme:symbolisation><fme:AffleurantSymbolePCRS><fme:angleRotation>142.70918</fme:angleRotation><fme:idSym>ID16da9e5d-ef01-4922-8cf3-a4058f4a888a</fme:idSym><gml:pointProperty> <gml:Point srsName="EPSG:2154" srsDimension="2"> <gml:pos>619127.353 6753771.724</gml:pos> </gml:Point></gml:pointProperty></fme:AffleurantSymbolePCRS></fme:symbolisation></fme:AffleurantPCRS> My geometry is in AffleurantSymbolePCRS/symbolisation/AffleurantSymbolePCRS I have read the documentation : https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/gml/user_attributes_w.htmThat said : "Geometry attributesThese attributes are used to control the name and the posit
What would be the best solution for triggering a FME workflow or FME transfomation file instantaneous, when a xlsx file is uploaded/created in an Amazon S3 bucket?
Hello, I have a table with some attributes and I created a new column which is called "Description" with the following string, by using the text editor in attribute manager : "New values, Dat: @Value(Dat), Nat: @Value(Nat), OBJNAM: @Value(OBJNAM)" However in some cases there are no values in all those attributes and the output looks like this: "New values, Dat: , Nat: Underground heigh., OBJNAM: , " I would like to exclude the attributes that don't have a value (in my example the Dat and ONJNAM), for each row.I guess I should use somewhere a conditional formatting but I am not sure how and where to do that.
We prepare kml files from Tab files as a regular practice to show our maps on our websites. However for multigeometries the popups don't work on our websites. These popups work in Google earth for the kmls but always fail in the web API. Any idea?
Dear FME community, we are working on developing a 3D Web application to visualize 3D Buildings (CityGML LoD2) and other 3D assets in CesiumIon/ CesiumJS. We have been able to create LoD1 and LoD2 3D Tiles that we can use in the application but the 3D Tiles output is very data intensive and really slows down the rendering in our application tremendously. That leads us to think that there might be something other optimizations we can undertake to improve our workspaces for better 3D Tiles creation that can be streamed better in Cesium (e.g. cascading structure of 3D Tiles or splitting of large tiles into smaller chunks for optimized web rendering). Furthermore, we are having problems with successfully creating 3D Tiles in LoD2. We would like to create building solids that are selectable and have all the desired attributes attached to it instead of having the surfaces being individually selectable. I have attached 3 workspaces that we are currently working with. I would greatly appreci
I am trying to use the HorizontalAngleCalculator to calculate the angle of some lines but it seems that even lines that are quite obviously 45 degrees are getting strangley small angle values. I have checked it it is set to be in Degrees, I'm wondering if anybody can point out what is wrong.
ho un dato poligonale di tipo multipolygon. Ad uno stesso identificativo, corrispondono più poligoni. Per ciascun poligono, nel campo Area, è presente il valore della superficie. Devo calcolare la somma delle aree dei poligoni con uguale identificativo
I am working with Copernicus WorldCover data and I wonder how FME is reading pixel values. I read the data with a FeatureReader, to intersec t the input with my AOI, and looking at the cached results of the FeatureReader I get 'NoData' in the Data Inspector, when selecting an area where the color map is interpreted correctly and according to the product description from ESA the color indicates a map code of 90.The subsequent applied RasterMosaicker shows the following result, at the same location.Now the value changed from '0 NoData' to '10'.As described, the color indicates a value of 90! The problem is basically present in any of the mapped classes, and values are altered from 10 -> 220 -> 330 -> 4etc.90 -> 10 I am adding a link to the coding of the map layer and definition of the classes and two Copernicus images so you can try to read a single GeoTIFF and reading all GeoTIFF files in a folder -> https://drive.google.com/drive/folders/1jusyArd5
I used the ArcGIS Online Feature reader to read a hosted arcgis feature layer that has attachments. I can use the AttributeFileWriter to write the attachments to files. But when connecting the reader to a file geodatabase, the feature layer writes to a feature class, but the attachments are not included. Is this the expected behavior? I am at FME 2020.1.3.
Hi all. First post for me here. I have a workbench where I want to overlay a point dataset on a single band geotiff elevation raster dataset. This workbench will be published to FME server where ppl will uploaded their point dataset and terrain Info will be calculated. The GeoTiff dataset is large >10 gb. To speed up the process I have tiled the dataset into smaller tiles and created a shape file index. I only want to load the tiles which overlap the point dataset. I find out which tiles overlap the point dataset and then, using a feature reader transformer, I’m selecting the tile to load. My question is, what would be the best way to load multiple tiles if the point dataset overlaps more than one tile. Is it best to use multiple feature readers with each tile being passed to one feature reader. But I’ll never know how many feature readers I need. Any thoughts. TIATK
I have a feature service link from which I extract data, but I cannot see the latitude and longitude in the tables. When I inspect the data, I can see the details. Can anyone tell me how I can extract the location details?
I hope this message finds you well. I am reaching out to the FME community to ask for suggestions on how to map transmission lines data using sub1 and sub2 columns. Our goal is to find the node mapping between transmission lines and substations, and we have the necessary data in these two columns.I have been working with FME for a while now, but I am not sure about the best way to approach this mapping task. Any advice, tips, or best practices you could share would be greatly appreciated.Attached the piece of data for understanding.Thank you in advance for your time and expertise. I look forward to hearing from you soon!
Hi, I am using the census bureau's API to gather population data for a county, and the data returns in the response as two separate arrays. One array contains the headers, and the other contains the data: [["NAME","B01001_001E","state","county"],["Spokane County, Washington","546040","53","063"]] I am mainly having issues with transforming the data in this format as it isn't what outputs normally look like when using other REST APIs. Using a JSONfragmenter will correctly assign these as two distinct arrays, but I can't seem to figure out how to associate the corresponding values to build a table from these arrays.
What transformer can I use to snap the red line to the black line keeping the intersection point (blue circles) in place? Anchored Snapper would snap the edges but shortens the red line while Affine Warper works only for short lines. Thanks!