Using readers and writers to extract and load data.
Recently active
Hello! I was wondering if it's possible to create a standard text above the different attributes in excel or csv files? Here's an example of how it should look like. Two rows is standard and the attribute names will start at row four. Thank you!
Good morning, I have lease shapefiles we receive from a company (numerous leases for each county). So for example if I have 3 counties already in an existing geodatabase, those counties for this example are named Harris County, Thomas County, and Johnson County. If the shapefile the company has provided has Johnson and Thomas counties (No Harris County data), I will want to delete all records with Johnson County and Thomas County from the existing geodatabase ... and replace them with the Johnson and Thomas County data from the shapefile. But here's the kicker, I want to keep all existing Harris County leases in the geodatabase. A truncate will not work because I want those existing Harris County leases. Here's what would happen in a perfect world. Again this is just me dreaming and I'm asking all of you if this dream can be a reality. Step 1: Get a list of what counties are in the incoming shapefile (Johnson and Thomas) Step 2: Delete all records in the geodatabase tha
Hi, I am reading a Oracle SQL file and writting it to EXCEL. My SQL file give me a value of 100.893657 and When I write that to EXCEL file it just writes 100 Or even writing to inspector it gives 100. Is there a way I can tell FME to write the way it appears 100.893657.
Hi The Swedish Geological Survey (SGU) has been starting to share some of it's data as open data. Unfortunately some of the data is presented in JSON format, which I'm not fimiliar with. As I have understood it really is just a text format with georeferences. I would like to convert the files from JSON to SHP. The JSON-files can be found here http://resource.sgu.se/oppnadata/grundvatten/api/grundvattenforekomster/forekomster/2?vattenmyndighet=VH If you could point me in the right direction to start convering them with FME I would be very happy. BR Rob
I have FME Desktop Professional Edition 2015.0 (64-bit) installed and am trying to read an ESRI Personal Geodatabase (.mdb), but it is not available as one of my Reader formats. Am I understanding correctly from this page that I cannot, whilst the 32-bit version can: https://knowledge.safe.com/articles/Samples_and_Demos/Notes-on-FME-and-ESRI-Versions-and-Compatibility#toc5 ? Is there some other way I can read an ESRI Personal Geodatabase (.mdb) using my version of FME, e.g. by downloadable plugin?
Hi everyone! I have a simple workspace that I published to FME Server Jobsubmitter: it reads a textfile from a shared UNC path and logs each line. I have configured a specific user FME_Server_User that starts my serverjobs. If I log in as FME_Server to the server, I can access the specified folder and file and modify it or whatever. I can also run the workbench in FME Desktop without a problem. As soon as I start the job from FME Server Repository GUI, it fails. I get following error: Text File Reader: Source dataset '\\\\shared\\test.txt' does not exist A fatal error has occurred. Check the logfile above for details. The problem occures in a newly created folder on the share. The old folders still work just fine with the same setup (FME_Server_User etc.). Thank you very much for your help!
Hi! I have perused the questions pertaining to ArcGIS licensing here on these premises. However, I am unable to find a way to point FME to use a certain ArcGIS license server. The licensing solutions only talk about setting the ArcGIS license level, not the server. It seems as if FME Desktop can only use the ArcGIS license currently available for an ArcGIS installation on the local machine. Is it not possible to run FME standalone, and point it to a valid ArcGIS license server for ESRI-specific formats?
Hi all, I am trying to produce a WMS output from a shapefile input. I have the writer writing the data to PNG output, however it loses its projection information so if you go to view the WMS in ArcMap (for example) it won't show on the mapas it has no projection. Any suggestions would be much appreciated. Thanks
Hi, I am trying to apply a rotation/translation to an e57 pointcloud, and writing it back to e57. But I am facing this reading error: E57 reader: An error occurred while reading. The error was 'element value out of min/max bounds (E57_ERROR_VALUE_OUT_OF_BOUNDS)' with context 'this->pathName=/ value=0 minimum=244675 maximum=244706' (error code = 35) Those are min max-values of X-coordinate. I guess the coordinates (EPSG 31370) are too big. Is there a way to work around this? J.
I am writing features to a GIS feature class. The FME workbench says it writes 5170 records but when I open the feature class to review it I have 5182 records. I have 12 features with "0" area and "0" length. These 12 records are duplicate records of other features in the feature class. It appears that this is happening outside of FME. I just want to know if anyone knows of a fix in FME. I have tried the area calculator and tester combination testing for 0 area but get nothing. Any help is much appreciated.
We are still having issues with having to re-add all readers that are hitting SDE or SQL every time we close an FME job then re-open the job. It will read nothing from the Reader. Then as I said, we have to re-add it, delete the existing one, and everything is fine. This is not acceptable and we've been doing it for a few months. Has anyone else had this issue?
I need to update a set of records on a weekly basis. Before updating the data in the writer I need to delete the old data from the writer. I would like to use a simple selection that meets a query such as Area = Utica. Ideally all the data where Area = Utica is deleted from the writer, the data that does not satisfy my query would remain. After deleting the records I would then load my new data. thanks Dan
tab file output with missing attributes
Greetings people, I need to fill three tables in SQL Server Non-Spatial. Tables are point, line and polygon. I read data from GML. Now, I need to insert all points, points from lines and from polygons, lines and lines from polygons and polygons, but they must fill some condition. All of them have attribute LAYER and GEOMETRY (WKB format). I need to write just these who has minimal value of LAYER (integer) and with distinct GEOMETRY. This minimal value of LAYER is minimal for each group of features with same GEOMETRY. This rule is same for all feature types. E.g. I have WKB1, 1 WKB1, 2 WKB2, 2 and only need to write the last two. Can someone give me an idea? I hope you know what I asked. :D
Hi for all! I have xls table with huge datas about inspection for different zones as shown in attached picture (this is the small example). How can I write text values from "Area n." column to "Area"? F.e. for rows with "Area n" 1, 12, 3 I want write East gate in "Area" column and etc. Thx
I have assembled table in SpatiaLite holding 30 million points of depth sounding observations originating from a number of vessels, each with a large number of files. To keep some metadata about where each point originates from, I've kept the file path and name in an attribute called "filepath". From the attribute "filepath", I need to extract a specific part which holds the name of the vessel. I guess it would be some regex in use here? Example of the attribute's content: \\folder\\VESSEL_Lola\\folder2\\file1.shp \\folder\\VESSEL_Maria\\folder1\\file2.shp \\folder\\VESSEL_Lily\\folder4\\file3.shp \\folder\\VESSEL_Christine\\folder1\\file4.shp \\folder\\VESSEL_ClaudiaMaria\\folder2\\file5.shp \\folder\\VESSEL_Maria\\folder3\\file6.shp and so on.. I need to extract the "VESSEL_Maria" etc. from the attribute and map to a more explanatory value in e.g. AttributeValueMapper. There is only 12 different "VESSEL_YY" categories, but a lot of di
Hi All, I couldn’t figure out the best practice to calculating the percentage of each land use in urban master plans In the ArcGIS, for example, this sort of work is done as shown in the following model. Which equivalent tools in FME that can be used to calculate this values? The data and the model are store in the link below: http://www.mediafire.com/download/kc95ic5e83nus6y/UMP_Percentage.zip Thanks in advance Lubna
Hi All, One of our client had upgraded FME desktop 2010 to 2014 version and using for extract smallworld data to different formats. After upgrade, they are experiencing performance issue whilst extracting pole objects from smallworld EO4.2 . We have noticed that FME reader is taking huge time (more than 1 week) to read 400 K records from smallworld. In older version there is feasibility to read a particular geometry type feature in reader, but in 2014 version, all geometry feature type records are reading in reader. Due to this, it affect to the performance of FME reader. Can anyone please suggest that to increase performance in FME reader. Also please suggest that to avoid the reading of all physical and join fields information in reader. Thanks in Advance, Regards, Seshu
I am migrating data from ESRI shape files to Smallworld by using FME. But in my ESRI shape files attributes contains special characters and symbols. Sometimes I don’t want to migrate those symbols and specials characters into Smallworld.
Hi All, I have 2 table and I want to find the gap between them and join them in one table to better comparison and presentation of gaps Can I do this comparision using FME? Thank you, Lubna
Hello All, I am using a simple workbench that reads ESRI ArcSDE and writs to a dynamic API file geodatabase, the workbench should work as if I am copying the data stored in SDE file (SQL server ) to a fil Geodatabase, but the issue here is that the FME writes the features with wrong names Not as expected. The FME workbench adds “DBO” prefix and the type of the feature class as suffix Manual copy/past works fine and names the features as intended Is there any method to truncate the prefix and suffix which is added by the FME to have the names as if I am using copy/past ? Best regards, Ahmad Saleh
I am working with ESRI shape files and the data in on of the attribute field in my existing dataset is a mix of information that needs to qualified and segregated into atleast 4 new attribute fields. I hope using regular expressions would be the best way to accomplish this task. I donot have too much experience wotking with FME and I was hoping to see if anyone here has a workspace that you used for somethjng similar that I could refer to . Any help in this is appreciated as all I have now is the regular expressions that will help me qualify the data.
I have data with lines and polylines.. I’d like to have segment with 30m from the starting point and from the ending point (end minus 30). For the polyline I’d like to have only the first and the last segments. I’m using chopper (2 vertexes) to get lines from 2 vertexes but then I need to choose only the first and the last segments. The resultings segments should have the same angle of starting or ending segments of polyline. Any idea .. thanks
Hi! I want to perform a post and reconcile operation on a whole SDE geodb using FME workbench. I'm following the guidelines here : http://docs.safe.com/fme/html/FME_ReadersWriters/FME_Readers_Writers.htm#geodatabase/Writer_Directives_EntGeodbFeatClass.htm It states that : This optional directive reconciles all the changes between the version specified by the writer directive VERSION and its parent version, even those edits made outside of the current translation, and then posts the version to its parent. [...] Since reconciling is done for all features including those inserted/updated/deleted outside the current translation, then this directive can be used in an empty workspace to simply reconcile and post a child version to its parent. So if I understand that correctly, I can have a completely empty workbench except for a writer with the advanced attribute Post and reconcile set to yes and run the translation and it will sync the version and it's parent? Anyway, it's not working
All, I am using the ESRI file geodatabase writer to write data to both a feature class and table class and establish a foreign key relationship between the data in the two classes. The only relationship documentation I've found is under the ESRI geodatabase (Access database) writer and that is what I have been trying. I have three FME feature types for my writer; one for the feature class, one for the table class, and one for the relationship. I am setting a geodb_oid on the data for the feature class and table class. I am setting the set the geodb_type to geodb_relationship, and I've also tried geodb_attributed_relationship, on the relationship FME feature type. The geodb_feature_has_relationship is set to Yes for all three FME feature types and the geodb_rel_origin_oid and geodb_rel_destination_oid are being set for just the relationship feature type. When I run the workspace, I'm receiving the error: Attempting to write a non-relationship feature to relationship