Using transformers to modify data.
Recently active
I am using Httpcaller to read the catalog. Getting the response body.then using a HTMLExtractor but the links are not coming as a http they are like this: <a href='catalog.html?dataset=xxxx/xxxxx/Archive/name1.nc'><tt>name1.nc</tt></a></td>then using a ListExploder to get just the links like: catalog.html?dataset=xxxx/xxxxx/Archive/name1.ncthen I was creating a URL attribute to concatenate the URL( http:////xxxx.yyyyyy.xx:8083/thredds/catalog/xxxxx/xxxxx/Archive/catalog.html? )and the list ( catalog.html?dataset=xxxx/xxxxx/Archive/name1.nc) to have an URL to downlaod the data as: http://xxxx.yyyyyy.xx:8083/thredds/catalog/xxxxx/xxxxx/Archive/catalog.html?dataset=xxxxx/folder/Archive/name1.ncBut I donæt manage to download it.I get the following error:HTTP/FTP Transfer: Failed to create file 'R:\\xxxx\\Downloaded\\yyyy\\' for resource download 'http://xxxxxdocker02.dddddd.no:8083/thredds/catalog/xxxxe/xxxxxx/xxxx/catalog.html?dataset=dd
I'm tring to convert some CityGML to b3dm tiles. Source data in EPSG:3857 - center is x=4183074.86, y=7496562.311 but tilles in output get some strange values: x=2855853.53, y=2197566.80. How to save the 3857 coordinates?
Hi, I have a question about how to perform a Multiple LEFT JOIN, because I need to categorize certain ROWs of my TABLE A (all the fields always have information), based on the combination of criteria that I have in TABLE B, the categories are defined in the column RESPONSIBLE TEAM of TABLE B, many of the fields in TABLE B are empty and when this is the case, it is possible to select any value (wildcard), if I do a simple LEFT JOIN it works correctly, but I can't do more than two LEFT JOIN to be able to do the categorization I need.I am using InlineQuerier.this is what I am using: select * from "TABLE A" LEFT JOIN "TABLE B" on "Country" like "_Country"and "State" like "_State" is not null or '%'and "City" like "_City" is not null or '%'and "CODE" like "_CODE" is not null or '%'and "Description" like "_Description" is not null or '%'
I am using a CsmapAttributeReprojector to convert between a source coordinate system and my own local destination coordinate system. I expect that the Y value should only change, however, this change does not take into account a negative value So if the source Y value is -50Instead of adding 200 to - 50, it adds 200 and 50 which results in 250 instead of 150. I have a python script that reads the header of my CSV file and finds the Y column in the header and this value is given to the reprojector, this does find the right column but as said above, my transformations aren't subtracting
Hi Guys, no so sure if this questions belongs here: 1st> what's the best way to have an internal (to the workbench) datasheet (4 columns x 20 raws of values). Is it in the workspace resources? 2nd: I am reading +storing a sequence of characters from a file (a file that I am uploading and processing). I want to compare this sequence (a name) with the aforementioned database in question 1 (actually with one column of the database), So when getting a coincidence name=cell A1 , I will store or been able to retrieve the values of the other cells within the same raw (cell A2, cell A3, and cell A4) . Thank you very much! Jorge
I am trying to use CurveFitter on a set of contour lines but am not getting useful results. As you can see some of the lines overlap, even after a very light processing. How can this be avoided? I tried both settings of Preserve boundries, but that did not make much difference.
Is it possible to containerize a dataflow ? Something like this:Where we split our dataflow, we apply some specific transformation on one of the containers and then the rest of the dataflow is similar for both container. During the end of the workflow, both container will be isolated. Is that possible ? For simple workbench this is useless, but if, for example, I have a lot of "group by" transformer in the "End of the workflow" part, then it will be useful.
I have 2 large Mapinfo tables - Hedges (lines) and Gardens (polygons). I want to retain all hedges outside gardens, including those which have ends touching the gardens. I want to remove all hedges running along (coincident with) garden boundaries. I attach an image showing with red crosses these lines. All others should be kept including those touching the boundary at an angle.Is this possible using the SpatialFilter or SpatialRelator? I've tried various ways with both these but I am not able to achieve this. In Mapinfo I achieved it by the SQL query "Not Obj Within Any (Select Obj from Gardens)". Is there an equivalent in an FME transformer? The only other way I can think of is by buffering the gardens slightly and then using the Clipper to remove all hedges within the gardens (and the buffer would remove those running round the garden boundaries).Many thanks if you can help!Jane
Hi,We are implementing Informatica in our gas/electric utility. We will use this information to test calling the FME Server job from Informatica: https://knowledge.safe.com/articles/636/integrating-fme-server-and-informatica-powercenter.htmlWhat is the best way to let the Informatica job know that the FME Server job is finished?Also does anyone know of other organisations that use an Informatica/FME Server integration?Thanks,Annette
Hello Thereis it possible to get access to the GDB Schema of the utility network of Esri, without having An ArcGIS productThanks
I am using a SQLExecutor transformer to execute a large number of SQL queries (writing to a Sybase IQ DB via JDBC connection as a work around for the Sybase Writer that didn't work for my specific translation). I've found that not all of the features that are routed through the translation and should be written via the SQLExecutor are actually getting written. There is an error "java.sql.SQLException: JZ006: Caught IOException: com.sybase.jdbc4.jdbc.SybConnectionDeadException: JZ0C0: Connection is already closed.". I'm thinking that this is related to the "Query Timeout" default of 30 seconds. However I'd like to confirm this so when does the commit part of the SQLExecutor query actually happens. For instance if 30 features get routed to the SQLExecutor do each of those get written one by one or all in a batch at the end? Thanks in advance to anyone who has any info on this!
Hi. I have trouble using the csgbuilder to form a unified solid(IFMECSG). In my database, every building has so many small parts and I need to union them. Every building should be a unique(one) building. I want to write them later to Citygml as building. The writer does not accept a multiSolid, so I need to do the union through csgbuilder. But the problem ist that this transformer do the union just for one small part and reject all the remaining parts. I also used the group by parameter but the result is the same. Can you please help me?
I have a workspace that is run on a daily basis. Its duration is about 6 minutes. Sometimes it gets stuck on the line: Processing base feature(s)... If I compare the logs of a succesfull and failed execution there aren't any different numbers that are about to be processed. There's also no warning of resources, memory etc.. The failed workspace just gets stuck (and stops logging) and after 20 minutes it's timeout (as scheduled). Execution time for both succesfull and failed processes up to the 'Processing base feature(s)...' line is about the same: 5 to 6 minutes. Does anybody have advice on how and where to look for clues to prevent the workspace getting stuck
Hey,I have multiple xyz-Files that I would like to Clip with a shapefile. And then save it as xyz-Files again.I used the reader POINTCLOUDXYZ as well as the writer POINTCLOUDXYZ. I tried the transformer Clipper as well as PointOnArea. Somehow it won't work.Is there a transformer/ or multiple transformer connected that I could use to clip xyz-Files, that you can recommend to try?Thank you,
HiI am trying to extract the EXIF GPS coordinates from a .TIF file. I have managed to extract EXIF from a JPEG, but it seems .TIF readers doesn't expose the right additional attributes: The .TIF file I am trying to extract:Anyone know of an alternative way to do this?
Y((@YValue()/0.999604)-5447183.654)-(((@XValue()/0.999604)-482902.876)*0.000039706) X((@XValue()/0.999604)-482902.876)+(((@YValue()/0.999604)-5447183.654)*0.000039706) Thanks
We have created a dataset in a WebViewer with Google Charts in the maptips. Now we got the request to print a weekly snapshot to pdf. I wonder if anyone had this same challenge and found a solution. We can always reproduce the charts in the ChartGenerator but we really prefer the Google Charts layout.
Hi,For a client we are developing a system to preview survey data (bathymetry) in a browser. Additionally, we also need to indicate differences between surveys over time. These survey data are supplied as rasters. I have some troubles when reprojecting rasters with different extents to Web Mercator, please find attached a document with more information and screenschots. Raster 1CRS EPSG:32643 - WGS 84 / UTM zone 43N - ProjectedExtent 272800,2092300 : 276600,2097600Unit metersWidth 3800Height 5300Origin 272800,2097600Pixel Size 1, -1 Raster 2CRS EPSG:32643 - WGS 84 / UTM zone 43N - ProjectedExtent 261500,2088600 : 281600,2100300Unit metersWidth 20100Height 11700Origin 261500,2100300Pixel Size 1, -1 I'm looking for a way to prevent small displacements using a correct combination of FME transformers, using FME 2020.1 Thanks, Richard.
I am using an Area on Area Overlayer and Expression Evaluator to calculate the percentage of overlap of one polygon dataset with another -the scenario is percentage ownership. I have noticed that those polygons that should have 100% overlap / ownership because they are completely within the other, do not show as a nice round 100%, always 99.something up to 101.something. I'm guessing this is something to do with geometry and /or tolerance, but how to solve it? 101% ownership will raise questions when the data is presented!
I was looking at ways to create Elevation profiles but did not find any transformers or other easy ways to do this in FME. Should I be searching for some other word?I don't need anything fancy, the sources are some polylines and a DEM file. I would be happy with something as simple as a csv file as output.
Hi, I make an attempt at removing the effects of building heights on a DSM (Digital Surface Model) in order to obtain a result looking more like a DTM (Digital Terrain Model), in other words something closer to the bare soil elevation. My thought was to use a RasterResampler transformer and define a cell size a bit larger than the buildings, and also assigning the minimum elevation value to the new pixel. However I don't see a minimum value method for RasterResampler. I looked at the RasterConvolver but there is no way to define the kernel size in terms of distance instead of pixels. Correct me if I'm wrong. In other words I need to find the minimum over a great number of neighboring pixels (much more than the traditional kernel sizes).How would you achieve such a raster operation using FME Desktop? Thanks in advance! Best regards,Olivier
What is the fme_where syntax for specifying multiple fields to update by?I've tried this syntax, but it doesn't seem to work in my scenario. New Attribute: fme_whereAttribute Value: YEAR = @Value(YEAR) AND MONTH = @Value(MONTH) AND PLANT = @Value(PLANT) AND UNIT = @Value(UNIT) I'm using a DB2 writer and I have to handle inserts and updates coming through. It seems that the single DB2 writer can only handle INSERTS or UPDATES, not both. When I enter values in the "Update Key Columns" property on the DB2 Writer, all incoming rows are treated as Updates even though the fme_db_operation value says INSERT. And vice versa. When I remove the value in the "Update Key Columns", all rows are treated as Inserts, even when the fme_db_operation values says UPDATE. I thought I could delete the values from the "Update Key Columns" property on the DB2 writer, and then create the fme_where attribute and specify the key columns to use for the UPDATE. But it didn
I have 2 versions of data in autocad format: 1 old and 1 newer The difference between these 2 versions and that the insertion point (blue square) of the blocks has been changed. For the oldest version it is located at the bottom right image 1 and in the most recent and in the middle of the block see image 2 I need to move this insertion point inside the block, it is good to move the coordinates of the insert point and not the polyline coordinates of the block. I have established the formulas for the displacement of the insert point with the unit of angles in grades and wish to be able to apply it to evolve my files from the oldest version to the most recent image 3.I am new to FME and admit not knowing how to go about it. Can you guide me to solve my problem
According to https://community.safe.com/s/article/working-with-geodatabase-field-aliases , when reading aliases from a GDB, an additional attribute with fieldname_alias is created, containing the alias. When writing to a GDB, this field is used to write the corresponding field's alias. So I figured formatting an Excel table like below would work, but the fields are written to the GDB normally, and there don't seem to be any options to flag the fields as alias fields.
I am working with a 3D city model (composed of meshes), where the vertex normal pool is simply a copy of the vertex pool. Obviously, this is incorrect and I do not know why that is the case, as I was simply handed the model ready-made. I am wondering therefore if there is a possibility to do a reset for these measurements? To calculate the vertex normals in some automatic way anew? I appreciate any input on this matter! Many thanks.