Using readers and writers to extract and load data.
Recently active
Hi, I am trying to apply a rotation/translation to an e57 pointcloud, and writing it back to e57. But I am facing this reading error: E57 reader: An error occurred while reading. The error was 'element value out of min/max bounds (E57_ERROR_VALUE_OUT_OF_BOUNDS)' with context 'this->pathName=/ value=0 minimum=244675 maximum=244706' (error code = 35) Those are min max-values of X-coordinate. I guess the coordinates (EPSG 31370) are too big. Is there a way to work around this? J.
I am writing features to a GIS feature class. The FME workbench says it writes 5170 records but when I open the feature class to review it I have 5182 records. I have 12 features with "0" area and "0" length. These 12 records are duplicate records of other features in the feature class. It appears that this is happening outside of FME. I just want to know if anyone knows of a fix in FME. I have tried the area calculator and tester combination testing for 0 area but get nothing. Any help is much appreciated.
We are still having issues with having to re-add all readers that are hitting SDE or SQL every time we close an FME job then re-open the job. It will read nothing from the Reader. Then as I said, we have to re-add it, delete the existing one, and everything is fine. This is not acceptable and we've been doing it for a few months. Has anyone else had this issue?
I need to update a set of records on a weekly basis. Before updating the data in the writer I need to delete the old data from the writer. I would like to use a simple selection that meets a query such as Area = Utica. Ideally all the data where Area = Utica is deleted from the writer, the data that does not satisfy my query would remain. After deleting the records I would then load my new data. thanks Dan
tab file output with missing attributes
Greetings people, I need to fill three tables in SQL Server Non-Spatial. Tables are point, line and polygon. I read data from GML. Now, I need to insert all points, points from lines and from polygons, lines and lines from polygons and polygons, but they must fill some condition. All of them have attribute LAYER and GEOMETRY (WKB format). I need to write just these who has minimal value of LAYER (integer) and with distinct GEOMETRY. This minimal value of LAYER is minimal for each group of features with same GEOMETRY. This rule is same for all feature types. E.g. I have WKB1, 1 WKB1, 2 WKB2, 2 and only need to write the last two. Can someone give me an idea? I hope you know what I asked. :D
Hi for all! I have xls table with huge datas about inspection for different zones as shown in attached picture (this is the small example). How can I write text values from "Area n." column to "Area"? F.e. for rows with "Area n" 1, 12, 3 I want write East gate in "Area" column and etc. Thx
I have assembled table in SpatiaLite holding 30 million points of depth sounding observations originating from a number of vessels, each with a large number of files. To keep some metadata about where each point originates from, I've kept the file path and name in an attribute called "filepath". From the attribute "filepath", I need to extract a specific part which holds the name of the vessel. I guess it would be some regex in use here? Example of the attribute's content: \\folder\\VESSEL_Lola\\folder2\\file1.shp \\folder\\VESSEL_Maria\\folder1\\file2.shp \\folder\\VESSEL_Lily\\folder4\\file3.shp \\folder\\VESSEL_Christine\\folder1\\file4.shp \\folder\\VESSEL_ClaudiaMaria\\folder2\\file5.shp \\folder\\VESSEL_Maria\\folder3\\file6.shp and so on.. I need to extract the "VESSEL_Maria" etc. from the attribute and map to a more explanatory value in e.g. AttributeValueMapper. There is only 12 different "VESSEL_YY" categories, but a lot of di
Hi All, I couldn’t figure out the best practice to calculating the percentage of each land use in urban master plans In the ArcGIS, for example, this sort of work is done as shown in the following model. Which equivalent tools in FME that can be used to calculate this values? The data and the model are store in the link below: http://www.mediafire.com/download/kc95ic5e83nus6y/UMP_Percentage.zip Thanks in advance Lubna
Hi All, One of our client had upgraded FME desktop 2010 to 2014 version and using for extract smallworld data to different formats. After upgrade, they are experiencing performance issue whilst extracting pole objects from smallworld EO4.2 . We have noticed that FME reader is taking huge time (more than 1 week) to read 400 K records from smallworld. In older version there is feasibility to read a particular geometry type feature in reader, but in 2014 version, all geometry feature type records are reading in reader. Due to this, it affect to the performance of FME reader. Can anyone please suggest that to increase performance in FME reader. Also please suggest that to avoid the reading of all physical and join fields information in reader. Thanks in Advance, Regards, Seshu
I am migrating data from ESRI shape files to Smallworld by using FME. But in my ESRI shape files attributes contains special characters and symbols. Sometimes I don’t want to migrate those symbols and specials characters into Smallworld.
Hi All, I have 2 table and I want to find the gap between them and join them in one table to better comparison and presentation of gaps Can I do this comparision using FME? Thank you, Lubna
Hello All, I am using a simple workbench that reads ESRI ArcSDE and writs to a dynamic API file geodatabase, the workbench should work as if I am copying the data stored in SDE file (SQL server ) to a fil Geodatabase, but the issue here is that the FME writes the features with wrong names Not as expected. The FME workbench adds “DBO” prefix and the type of the feature class as suffix Manual copy/past works fine and names the features as intended Is there any method to truncate the prefix and suffix which is added by the FME to have the names as if I am using copy/past ? Best regards, Ahmad Saleh
I am working with ESRI shape files and the data in on of the attribute field in my existing dataset is a mix of information that needs to qualified and segregated into atleast 4 new attribute fields. I hope using regular expressions would be the best way to accomplish this task. I donot have too much experience wotking with FME and I was hoping to see if anyone here has a workspace that you used for somethjng similar that I could refer to . Any help in this is appreciated as all I have now is the regular expressions that will help me qualify the data.
I have data with lines and polylines.. I’d like to have segment with 30m from the starting point and from the ending point (end minus 30). For the polyline I’d like to have only the first and the last segments. I’m using chopper (2 vertexes) to get lines from 2 vertexes but then I need to choose only the first and the last segments. The resultings segments should have the same angle of starting or ending segments of polyline. Any idea .. thanks
Hi! I want to perform a post and reconcile operation on a whole SDE geodb using FME workbench. I'm following the guidelines here : http://docs.safe.com/fme/html/FME_ReadersWriters/FME_Readers_Writers.htm#geodatabase/Writer_Directives_EntGeodbFeatClass.htm It states that : This optional directive reconciles all the changes between the version specified by the writer directive VERSION and its parent version, even those edits made outside of the current translation, and then posts the version to its parent. [...] Since reconciling is done for all features including those inserted/updated/deleted outside the current translation, then this directive can be used in an empty workspace to simply reconcile and post a child version to its parent. So if I understand that correctly, I can have a completely empty workbench except for a writer with the advanced attribute Post and reconcile set to yes and run the translation and it will sync the version and it's parent? Anyway, it's not working
All, I am using the ESRI file geodatabase writer to write data to both a feature class and table class and establish a foreign key relationship between the data in the two classes. The only relationship documentation I've found is under the ESRI geodatabase (Access database) writer and that is what I have been trying. I have three FME feature types for my writer; one for the feature class, one for the table class, and one for the relationship. I am setting a geodb_oid on the data for the feature class and table class. I am setting the set the geodb_type to geodb_relationship, and I've also tried geodb_attributed_relationship, on the relationship FME feature type. The geodb_feature_has_relationship is set to Yes for all three FME feature types and the geodb_rel_origin_oid and geodb_rel_destination_oid are being set for just the relationship feature type. When I run the workspace, I'm receiving the error: Attempting to write a non-relationship feature to relationship
A 1 STARTED A 2 IN PROGRESS A 3 IN PROGRESS A 4 PAUSED A 5 IN PROGRESS A 6 IN PROGRESS A 7 COMPLETE A 1 STARTED B 2 IN PROGRESS B 3 IN PROGRESS B 4 IN PROGRESS B 5 COMPLETE I have a list of actions which are listed in the order they performed. Sometimes the actions do not result in a change in the attribute I am interested in, so there are 'duplicate' entries. However I want to keep those duplicates where they appear either side of a status change. So in the above examples I'd end up with A 1 STARTED A 2 IN PROGRESS A 4 PAUSED A 5 IN PROGRESS A 7 COMPLETE A 1 STARTED B 2 IN PROGRESS B 5 COMPLETE I know how to do this in excel but I'm struggling to find a way to repeat it within FME
Hello, I would like to load and transform my ArcGIS datasets into our GeoNetwork v3. The metadata is created through ArcGIS Metadata editor and needs to get transformed from ArcGIS format to ISO19139. For this i currently use ArcGIS methods: translator= ARCGIS2ISO19139.xml arcpy.ESRITranslator_conversion(inputFile,translator,exportFile,logFile) The workflow should look like the following: inputFile gets zipped, xml gets transformed, xml is published, zipfile is published as geonetwork download service for the xml metadata record I´ve taken a look at the meta workspace demo but do not understand how to get it working with geonetwork and allready created metadata.
I have managed to create a workspace that will generate PDF files based on maptiles that are run through a clipper transformer and output one PDF per maptile for my entire dataset. Now I want to add non-map elements to the PDF files, but i can find very little info about how to easily do thissimply. How can I add text (title, map scale, etc) and jpeg images (north arrow, scale bar?) to the output pdf? Thanks, Christopher
How do I set the MPolygon line color seperate from the fill pattern color in FME 2015? Changing the Color value changes both, and setting the attribute autoccad_color (as recommended in a related post) does nothing. If I go into AutoCAD, I can set the line color seperate from the fill - but I'm not sure how to tell FME to output this combo. I am using the REALDWG writer. Thanks, Bryan
Hello everyone, i think i got a simple task but i seem stuck on it i have an excel workbook with 100 sheets, with every sheet i would like to create a table in MYSQL every table has different headers and amount of headers, i can read every sheet as an "indivudual feature type" and connect/dis-connect the wires from the MariaDB writer and this works, but when i use a merged feature type i only get one element, i am fanning out by fme_feature_type to get the correct naming of the table any help on working with this would be great, thanks!
Hello, I want to log errors and warnings, therefor I use the MessageLogger Transformer. But in the end when the translation finished the output is "Translation was SUCCESSFULL" even if there were errors. It also prints "|INFORM|Translation was SUCCESSFUL with 4 warning(s) (9 feature(s) output)" with the right amount of warnings created from the MessageLogger transformer. Is there a setting I need to make, so it prints that translation has failed? Also what I don't get is how the Log Filter is working, disabling Information and Statistics doesn't change anything. best regards, Mel
Hi All, I've two shpae files with only geometries and like to delete feature from the first one that contains into the second one. The condition for deleting is there two feautures (feature 1 from file1 and feauture 2 from file 2) are equals. Thanks an advance. FarFar
Hello All, FME 2015.1 fails to produce the expected results, I have developed a workbench that mainly convert hatches form AutoCAD to polygons (Esri Geodatabase (File Geodb API)) writer. But the FME fails to write the polygons correctly, In the attached AutoCAD file I have one single hatch that should be transformed to a polygon and stored in a feature class, after running the workbench I found that the FME fills an empty gap with an extra polygon. Link to download the workbench and the autocad file http://www.mediafire.com/download/3axz2lccdnn0d3d/CADToGIS.zip Best regards, Ahmad Saleh