Using readers and writers to extract and load data.
Recently active
This should be simple. I have 30 shapefiles of the same points (300) with one column which is the elevation taken from a DEM (ie 30 different DEMs queried with the same point theme). For analysis, I would like all 30 columns to be in one file (e.g. csv, dbf). tried my luck with featuremerger but with no success. Thanks, Uwe
Hi Folks, It is very simple question but still I need some suggestions; I created a workbench that downloads WFS, reproject it and save it in File Geodatabase in the local Geodatabase folder. We would like to use same workbench multiple time (lets say may be once a month), but the problem I am having is, it works perfect for the first time but when I try to use same workbench for same WFS file (a month later date data), I change the parameter (destination folder for another copy) the massage I get is "Translation was SUCCESSFUL with 1 warning(s) (0 feature(s) output)" Can anybody point me out what am I doing wrong? Since I am downloading same data from same WFS link, I don't do anything on Reader parameter :)
I would like to read and reproject Tiff-File. It is not a Geo-Tiff, the Geo-Informations are in a tfw-File. FME seems to ignore the tfw-File. How do I tell FME to read the coordinates etc from the tfw-file? Thanks very much.
Hello, I am trying to connect to a WFS url (which works fine in various GIS software). Looking at the log, I see that the FME WFS reader uses GML 3.1.1. Can I change that so it uses 2.1.2?
Hi All, I hope I can explain my issue properly. 1) We upgraded our PCs to Windows 7 (64bit) and upgraded FME 2013 SP4 64bit and using ArcGIS 10.05, (natively 32bit) (Desktop, Engine etc) 2) We have large number of workbenches with writers using FILE_GEODATABASE (ArcObjects). 3) When I run my existing workbenches I get the following error messages; “Unable to perform any licensing related tasks. This is a 64-bit version of FME which requires a 64-bit version of ArcGIS Server A fatal error has occurred. Check the logfile above for details” 4) I changed my writers to use the file geodatabase (API) and all seem to run fine. Questions; a) Are there any issues with switiching my writers to use the file geodatabase (API)? b) Any ideas on how to batch change my writers from GEODATABASE_FILE (ArcObjects) to use the FILEGDB (API)? Thx in advance, Ken
All i have a 70gb national dataset. I want to extract a clip of this data based on a predefined polygon. This is fine, but it takes 7 hours to read the dataset in before carrying out the extraction, and as i only need a small area of this data, is there a way to only read in the area of data i need to extract? Thanks in advance.
Hello! I need convert many xyz files to raster. I use ImageRasterizer, but i can´t to get z value. Allways the transformer get fme_color and return an error: "No valid input feature.". Other information message says:"16 input features where discarded because they were not compatible with any band in the raster. Bands with a numeric interpretation requiere vector input features that have Z coordinates." I don´t know how configure this transformer for it do this numeric interpretation or which another transformer i can use for this job. Thank you very much to all the community.
I have floating license servers for both ArcGIS and FME. To keep administration simple, I want to run both of these services on one server. The problem is that they both try to use port 27000 and only one can run at a time. I've tried changing my safe.lic file to port 27009 and it does open that port but the FLEXnet Licensing Service for FME still opens port 27000. Has anyone gotten this to work?
I have built a simple workspace with source and destination SHAPE-dataset. Then I used the fmedataupload-service to upload a zip file with SHAPE-Sourcedata. Now I want to use fmedatadownload-service to run the workspace and download result dataset. But now I get following StatusMessage: Shape Reader: No Shape Files found to process in directory `test_upload.zip'. Check directory and ids statement in mapping file My questions are: Are this steps to run the worckspace correct? How I must specify source dataset so that fme server can find them?
I am trying to learn how to manipulate xml files with fme. I thought it would help me to set a small project, but I´m already lost. Project outline: Retrieve GetCabilities.xml from a URL. Manipulate the xml file to extract layer names, contact person, Boundingboxes, and KeyWords and write these into a Shapefile. I´m basically lost at the first hurdle because I can´t really understand which methods/transformers I should be using. 1. Create xml Writer and tell fme to create fme-feature types for Layer, Contact, BBOX,KEyword. 2. This splits the elements up into 4 fme-feature types. Next I thought I should somehow extract the coordinates and make a point feature which can be grouped according to layer-name and converted to a polygon. Obviously this is not easy. Could someone offer me a step for step way to do this? or is it too difficult for a beginner? Yours, Rob
Hello In order to get a GML formatted string, which I need for later XML/GML writing, I use the GeometryExtractor transformer with variant GML v3.2.1. So far so good. My problem is that it in many cases it creates Geometry of type <gml:LineString ...> and for reasons I cannot influence (German NAS Standard ;-() in many cases I need to get geometry of type <gml:CompositeCurve ...> otherwise it will NOT validate .... In GeometryExtractor I don't see an option which allows me to control this. Any ideas out there how to solve this problem ? Thanks Michael
There must be an easy way to read a JSON file like the one I have below, and create a stream of feature objects, each with the attributes (idx, type, path, date) but I am missing how to do this (FME2014). If I use the JSON reader, I get a flattened list with lots of attributeX values. (yes, that is what the doc says it does). I see some examples of people using the FileTextReader and then JSONFlatten it out and exposing attributes. Is that the way to go? I think this should be easy, and yes, the path is a windows UNC, so I want to be able to use the in the RasterReader transform, I hope it understands UNCs. { "Zoom" : 9, "CenterLat" : 50.055084228515625, "CenterLon" : 19.938812255859375, "FrameList" : [ { "idx" : "22504704", "type" : "CIB10", "path" : "\\\\\\\\TEST-EGPL\\\\F\\\\SIS\\\\NGA\\\\CIB\\\\CB10S0009601\\\\RPF\\\\N51E020\\\\000MJ046.I13",
I am trying to convert a Bentley dgn file to ESRI shp. Lines and text are no problem. But there are a lot of "layers" in the dgn file as cells (e.g. Cell : Inferred Feature: MANHOLE : MANHOLE \\ Line) It seems that no matter what I do, i can only get the graphic out as lines. I tried to use the CoordinateExtractor and the 2DPOINTREPLACER in various setups. Without luck. Is there someone out there that knows how to get the point data out? It doesn’t matter much to me if I convert the cells in Bentley or through the FME
Hello community! I'm trying to write all contents of one oracle db-user (Map 3D 2014) to another one with the same schema. when "inserting", translation fails because of : 2013-11-22 09:55:09| 3.2| 0.0|ERROR |Execution of statement `INSERT INTO SELBSTRECHT_L ( "LENGTH", "FID_PARENT", "LINIENART", "IMPORT_ID", "GEOM" ) VALUES ( :"LENGTH", :"FID_PARENT", :"LINIENART", :"IMPORT_ID", :"GEOM")' did not succeed; error was `ORA-29532: Java-Aufruf durch nicht abgefangene Java-Exception beendet: java.lang.ClassCastException ORA-06512: in "MAPSYS.TBCOMPOUND", Zeile 3 ORA-06512: in "AV_TEST.SELBSTRECHT_L_AIS", Zeile 18 ORA-04088: Fehler bei der Ausführung von Trigger 'AV_TEST.SELBSTRECHT_L_AIS''. (serverType=`ORACLE8I', serverName=`mapsrv25', userName=`AV_TEST', password=`***', dbname=`') Before i had problems with duplicate FI
I would like to get some stats from Shapefiles to an existing Excel file. For example, update the km of aqueduct in a specific cell and the number of manhole in another. I'm able to get the stats in the Excel file using Name parameter (Sheet1) and in the writer parameters. I use Update_Cell_Contents with xlsx_row_id for getting the specific cell and I use Start Column. But the question is how can I write a value in a new Column in the same Sheet1? I can get all the information I want in different row but only in the same column. Thank!
Hi everyone, I'm fairly novice at using enterprise style databases and could do with a few tips. I have an SDE database called Roads (with geometry), which has the following fields: Road Name: Road Ref: I have a SQL database called Survey (no geometry) that has: Road Ref: Type: Condition: Year: I have FeatureMerged the two datasets on the Road Ref field so the Survey data has been added to the Roads database. I now want to write this out the same Roads SDE database. This where I'm tripping up! I'm assuming FME can create a new featue class/type with the relevant felds (i.e. all of the ones from Road and Survey_, but can't see where to do this in the settings, and I'm getting errors. I've tried a few different combinations settings, but could do with some pointers! Also, is it possible to create the feature class in a feature dataset in the SDE? Thanks everyone. Amit
Hi all, I have this error with executing spatial query with FeatureReader : 2013-11-20 17:11:55| 1.0| 0.0|ERROR |Execution of statement `SELECT "PDL_SIG_GAZ".* FROM ( SELECT * FROM "AMR"."PDL_SIG_GAZ" A WHERE (MDSYS.SDO_RELATE( A.PDL_GEO, :bindingQueryGeom,'mask=ANYINTERACT ') = 'TRUE') ) "PDL_SIG_GAZ" WHERE 1 = 1' did not succeed; error was `ORA-29903: erreur d'exécution de la routine ODCIIndexFetch() ORA-13236: erreur interne dans le traitement R-tree : [] ORA-13236: erreur interne dans le traitement R-tree : [Snapshot too old or Recursive fetch error] ORA-13234: échec de l'accès à la table d'index R-tree [MDRT Table] ORA-29400: erreur de cartouche de données ORA-00942: Table ou vue inexistante'. (serverType=`ORACLE8i', serverName=`CEDRE', userName=`AMR', password=`***', dbname=`') 2013-11-20 17:11:55| 1.0| 0.0|ERROR |Execution of statement `%5' did not succeed; error wa
Has anyone managed to successfully connect to a MySQL database using the MariaDB reader? The first time I tried I successfully got the table list and was able to choose a table but when it came to add the reader it just said "Running indefinitely" until I cancelled it. Now if I try to add it again I get a fatal error and FME shuts down (FME 2013 SP3 Build 13528)
I have the following readers.... Mapinfo line (Roads) Mapinfo Shape which consists of multible boundaries (Suburbs) I want to populate the Roads file with an attribute 'suburb boundary' from the Suburbs Mapinfo file and have a 'writer' that is the new roads file with a column called suburbs. Thanks,
I'm trying to read from a csv file a list of 3ds models to convert to sketch-up. Each model also need to be offset to correct insertion point. csv file contains for example header included: 3dsfile,xoffset,xoffset,zoffset m:\\sourcedata\\models\\test123.3ds,33001.98,58123.76,12.54 ... 54 models in the list the list is generated from a spatial filter I've tried the featurereader but it only works with single column cannot get the x,y,z details. also tried scripted parameter, but it only work only a single column Any ideas? Need to read each line, and offset each model to sketch-up (offset with the values in the csv file Rudy.
Hi, Has anyone come across the older SIGRID format or know of any tools or off the shelf file readers? http://nsidc.org/data/docs/daac/nsidc0050_aari_seaice/sigrid.html Thanks, Annette
Hi there, I am new to FME and I have been assigned a project where I would like to download a changeset data from the WFS server (eg. land parcel data), extract the data, evaluate the change in data and update everyweek and save in the local geodatabase using FME. I am kind of lost, I would appreciate if anyone would direct me in the right direction or is there any samples or any related documents that would help me understand for heads up? Regards, Subodh
Hello, I have a problem when I want to migrate Smallworld records to Postgis, I can not migrate the geometries. When I do the opposite, to migrate PostGis records to Smallworld: 1- I add, the format attribute "sworld_geometry{0}.sworld_name", in the Smallworld Reader. 2- I put an "AttributeCreator" transform in the workbench and create the attribute "sworld_geometry{0}.sworld_name" with value: location, route o boundary,(they are the names of the geometric attributes in Smallworld,That depends on whether the geometry is a point, line or area) But i don´t know how can i do the same for PostGis. Thank You
Hi Does anyone know how I can set a specific DWG layer visibility to be "off" by default? I have 100's of layers and would like to set some to be "on" and some to be "off". I can "freeze", "hide" or "lock" the layer via the format parameters section for the feature type properties - is their a way to switch visibility off? Thanks, Mike
Hello, I want to insert a value in a table with an XML Type (oracle non spatial) but I haven't find a type in user attribute corresponding. I have tried to insert by an sqlExecutor but for transaction meaning it is not valuable. Anyone can help me ? Best Regards, Julien