Using transformers to modify data.
Recently active
Hi I have a list of urls and want to download files from each of them. I am using the http caller and extractor to find links to pdf files on a webpage and then another http caller to download the file. The fist part works fine and when I inspect it I can see the urls to the pdf files. However, the second part does not work. FME rejects the features saying the url doesnt exist. I have tried it directly in a browser and it is entirely correct, the url doesnt exist. It only appears to exist whilst the original page is open. Is there a way to keep that page 'open' until the files have been downloaded and the it moves on to the next record? Many thanks
I am using the NullAttributeMapper to set my null values as missing (reading from MSSQL spatial table). This is working, however only for a certain number of rows. The first time run, it changed the first 100 rows. Second time 200 rows, after a few more attempts top 2000 rows. It seems to be processing in 100 row chunks and stopping at random points? The parameters are very simple;Map: All AttributesIf attribute value is: Null EmptyMap to: Missing That's it. I have had no other issues of partial completion for any other transformers. Thanks!
Hi. I have a featureJoiner with 2 tables, from FGDB Esri files. I have to make a query on 1 table. I Can't make the query directly in table because i have other featurejoiner from this table. I hope it's clear. Than for your help. I
Hi, I have a “Reader” file in DWG format and in EPSG coordinates: 25830 ((ETRS89-TM30)This file is located in coordinates UTM Zone 30 I need to change these points from Spindle 30 to SPINDLE 29 I apply the transformers1. CoordinateExtractor2. AttributeReprojector3. AttributeManager (with custom parameters) So far everything is correct, I see it in FME Preview and it is correct. My question is this: How can I transform this data to the Google Earth KM format? What transformers do I have to add? Thank you.
How can I write to the master database without adding unwanted duplicates? thanks
Dear FME community,I want to create 3D-tiles from city-gml-data. These tiles should be sved as OBJ-files. I like to create simple models of trees of coordinates. Since there are over 200000 coordinates, there will be over 200000 trees. Each tree will have a certain amount of polygons. So at the end there would be several million polygons in one file, if I were to save one OBJ-file. I decided to create over 200 tiles in order to have many smaller files. In order to create those files, I would like to use the "Workspace Runner"-Transformer. So I have one workspace, that created the tiles. In this workspace I basically created tiles made out of point-clouds. Now I want to transform every pointcloud-file into meshes which sit on one tile. Each point in the point-cloud will be used to create the tree geometry. Since I have over 200 point-cloud files I want FME to send every singe point-cloud file into the workspace that creates the geometry out of the points. At the end I wish to
I'm reading a CSV file from the web. The file is served encoded, so I first decode it, ending up with an attribute "_decoded", containing the csv data. I want to use this data to create a table (like the csv reader does), without writing the output to a file first. Sample format:objid;xcoord;ycoord;name21;123;456;house22;125;458;treeThe solution suggested in the thread linked below doesn't work, throwing the error "Python Exception <Error>: new-line character seen in unquoted field - do you need to open the file in universal-newline mode?", but I can't figure out where to stick the read mode (rU).https://knowledge.safe.com/questions/78520/parse-csv-data-stored-in-database-table.html
Hey community!How can I extract a bound from a polygon without the empty polygons that are inside de main polygon?Image attached
Hey community! How can I create a network of points spaced 250 meters apart within my polygons? (Attachment image)
I am in the process of aggregating some polygons, then joining these simplified polygons (geometry) with sensor data (no geometry) on a common field. It doesn't matter whether I am using the FeatureJoiner, or the FeatureMerger my process is taking way longer than what I know FME is capable of doing. I purged the temp data, as well as turned off feature caching to no avail. Any ideas or suggestions would be appreciated.
I'm getting "Provider error `(-2147467259) Could not use ''; file already in use.'" in the log when trying to read an MS Access mdb. This raises 2 questions: 1) it's a reader not writer, so why does it care if the file is in use? I have other applications that read mdb fine if it's already open. 2) The final status for the entire script is successful. I would expect the failure be noted at the end. I don't know how long we've been missing this error buried in the middle, and more importantly if we have corrupt data at the end as a result. 2021-2-5 14:21:29 | Creating reader for format: Microsoft Access2021-2-5 14:21:29 | Trying to find a DYNAMIC plugin for reader named `MDB_ADO'2021-2-5 14:21:29 | FME API version of module 'MDB_ADO' matches current internal version (3.8 20200115)2021-2-5 14:21:29 | Performing query against MDB_ADO dataset `\\\\server\\infosys\\xxx\\WR\\DB\\xxxResources.mdb'2021-2-5 14:21:29 | Microsoft Access R
Hello!I am new in FME and I have some errors when I try to use a reader (IMSpoor Reader PGT 123.0.1 - previously installed with FME). The error message says "XML Parser error: 'Error in input dataset:'XML-Document-Stream' line:1 column:1 message:invalid document structure". Do you have any suggestions to solve this? Thank you!
I have vector data for my town and i want to create rasters of 1x1 kilometer. I use the mapnikrasterizer. How can i create many rasters from the vector data?
Hi guys, I am having some issues with my TINGenerator. with some pointclouds, it's entering in an infinite loop . My questions are>Do you know how to implement an exit in this case, that will include the loop detetion, and a channel to post info about the loopDo you have any suggestion on how to avoid this topology issue. For it work the regular spacing in XY, specially when working in the 2.5D domain. But I have no clue when targeting 3D elements. Thank you very much! J
I'm trying to to filter a point cloud based on a user selected colour. The PointCloudFilter can have expressions like@Component(color_red)==230 && @Component(color_green)==0 && @Component(color_blue)==0 The fme colour parameter stores the colour as `0.901961,0,0' Is there a better way to use the colour parameter thanParameterFetcher, AttributeSplitter, AttributeCreator (_list{i}*255 3 times)
See attached screenshot. I have a shapefile with Photo_Name attribute (175 features), I apply a tester on the shapefile to filter the features I need (109 features). How can I then select only the 109 required images from the 175 source images - the fme_basename of my images = the Photo_Name.
Hi all - I've got a model where the nulls are mapped as zeroes, however when I write it out to an SDE, the nulls are still nulls. I did try this with a Geodatabase, and it wrote the nulls out as zeroes, and I imported that into the SDE - all looked good until I re-ran it and the newly-made zeroes turned into nulls, despite the AttributeManager saying to write out zeroes. I realise in writing this, the amount of times I put "nulls" and "zeroes" has probably caused you to space out.
I have 3D building model (in *.ffs and cityGML format) and I would like to clip of them by 2D polygon. I tried Clipper transformer, Extruder 2D polygon and SpatialRelator ("Requestor is Within Supplier"), and I tried also a CSGBuilder. But all of them don't give me appropriate result. When I use a spatial relator, my result is in Rejected port, and Total Features Written is 0. When I use a Clipper Transformer, I receive an error: "Clipping is not supported for IFMEBRepSolid geometry"Someone has any idea to solution of my problem?Thanks in advance.
I am trying to use the FeatureJoiner to join Parcels(LEFT) to centroids(RIGHT). If I choose a LEFT as the join mode. I should the same number of parcels as the orinial input. This would include the successfully joined parcels and the parcels that had no match. My initial parcel input is 830K. My output is over 1M. Where did the extra parcels come from? It looks to me that dupliate parcels were created. But I dont know why.
Hi, so I have a point cloud like this: I would like to generate contour lines but have a smooth edge at rivers and lakes. Currently I get results like this(where lines are made across the water and weird things) using ContourGenerator with pointcloud as input. using I then clip these lines away but it don't look too great,I end up with stumps like this sticking out into the river for example. How could I go about fixing this, like stopping lines to form across such large distances? Afterwards I also run Generalizer to smooth the lines out. Tips on this?edit: owait where did the pictures go let me readd.
I am reading a feature class from sde and using schema mapper mapping the names of input and output attributes. Finally using a dynamic writer I'm writing it to a shapefile. I have a workspace resource which reads a file and defines the schema. In the dynamic writer schema definition, I have given schema sources as the workspace resource . The attribute names are as expected in the output shapefile. But there are no values for any of the columns. They are just empty. Not sure what the mistake is. Any help appreciated
My goal is to batch deploy the process to many CSV. The transposer is only keeping the attributesof the table. FME_basename and all other attributes are dropped. With one file at a time i'm able to link to the source data set. but its not working when i batch deploy. It's keeping the same name and my files are overwriting each other. Thank you for your help
Hi list.This may have a simple answer, but I'll try and ask anyway.I have some 200+ features, that I want to add a geometry to. Simple, right?My table with geometry has 2.5 million rows, and I have to match on two string values.I initially tried to use DatabaseJoiner, but apparently it doesn't handle geometries ?I then got stuck with reading all 2.5 million records and use a FeatureJoiner. It works, but it's not optimal.What is the better way when fetching geometries from a database table/view for very few features ?Cheers.
For example:Parameter 1: Calculate area: yes/no Parameter 2: Units: m2/ km2,.... I would like to disable parameter 2 if the value of the parameter 1 is set to "no". At the same time I would like to have Parameter 2 as an mandatory parameter if the value of the Parameter 1 is "yes" Thank you!
All of the results appear to be anchored to the beginning of the text but the box is not aligned.