Using readers and writers to extract and load data.
Recently active
I am trying to learn how to manipulate xml files with fme. I thought it would help me to set a small project, but I´m already lost. Project outline: Retrieve GetCabilities.xml from a URL. Manipulate the xml file to extract layer names, contact person, Boundingboxes, and KeyWords and write these into a Shapefile. I´m basically lost at the first hurdle because I can´t really understand which methods/transformers I should be using. 1. Create xml Writer and tell fme to create fme-feature types for Layer, Contact, BBOX,KEyword. 2. This splits the elements up into 4 fme-feature types. Next I thought I should somehow extract the coordinates and make a point feature which can be grouped according to layer-name and converted to a polygon. Obviously this is not easy. Could someone offer me a step for step way to do this? or is it too difficult for a beginner? Yours, Rob
Hello In order to get a GML formatted string, which I need for later XML/GML writing, I use the GeometryExtractor transformer with variant GML v3.2.1. So far so good. My problem is that it in many cases it creates Geometry of type <gml:LineString ...> and for reasons I cannot influence (German NAS Standard ;-() in many cases I need to get geometry of type <gml:CompositeCurve ...> otherwise it will NOT validate .... In GeometryExtractor I don't see an option which allows me to control this. Any ideas out there how to solve this problem ? Thanks Michael
There must be an easy way to read a JSON file like the one I have below, and create a stream of feature objects, each with the attributes (idx, type, path, date) but I am missing how to do this (FME2014). If I use the JSON reader, I get a flattened list with lots of attributeX values. (yes, that is what the doc says it does). I see some examples of people using the FileTextReader and then JSONFlatten it out and exposing attributes. Is that the way to go? I think this should be easy, and yes, the path is a windows UNC, so I want to be able to use the in the RasterReader transform, I hope it understands UNCs. { "Zoom" : 9, "CenterLat" : 50.055084228515625, "CenterLon" : 19.938812255859375, "FrameList" : [ { "idx" : "22504704", "type" : "CIB10", "path" : "\\\\\\\\TEST-EGPL\\\\F\\\\SIS\\\\NGA\\\\CIB\\\\CB10S0009601\\\\RPF\\\\N51E020\\\\000MJ046.I13",
I am trying to convert a Bentley dgn file to ESRI shp. Lines and text are no problem. But there are a lot of "layers" in the dgn file as cells (e.g. Cell : Inferred Feature: MANHOLE : MANHOLE \\ Line) It seems that no matter what I do, i can only get the graphic out as lines. I tried to use the CoordinateExtractor and the 2DPOINTREPLACER in various setups. Without luck. Is there someone out there that knows how to get the point data out? It doesn’t matter much to me if I convert the cells in Bentley or through the FME
Hello community! I'm trying to write all contents of one oracle db-user (Map 3D 2014) to another one with the same schema. when "inserting", translation fails because of : 2013-11-22 09:55:09| 3.2| 0.0|ERROR |Execution of statement `INSERT INTO SELBSTRECHT_L ( "LENGTH", "FID_PARENT", "LINIENART", "IMPORT_ID", "GEOM" ) VALUES ( :"LENGTH", :"FID_PARENT", :"LINIENART", :"IMPORT_ID", :"GEOM")' did not succeed; error was `ORA-29532: Java-Aufruf durch nicht abgefangene Java-Exception beendet: java.lang.ClassCastException ORA-06512: in "MAPSYS.TBCOMPOUND", Zeile 3 ORA-06512: in "AV_TEST.SELBSTRECHT_L_AIS", Zeile 18 ORA-04088: Fehler bei der Ausführung von Trigger 'AV_TEST.SELBSTRECHT_L_AIS''. (serverType=`ORACLE8I', serverName=`mapsrv25', userName=`AV_TEST', password=`***', dbname=`') Before i had problems with duplicate FI
I would like to get some stats from Shapefiles to an existing Excel file. For example, update the km of aqueduct in a specific cell and the number of manhole in another. I'm able to get the stats in the Excel file using Name parameter (Sheet1) and in the writer parameters. I use Update_Cell_Contents with xlsx_row_id for getting the specific cell and I use Start Column. But the question is how can I write a value in a new Column in the same Sheet1? I can get all the information I want in different row but only in the same column. Thank!
Hi everyone, I'm fairly novice at using enterprise style databases and could do with a few tips. I have an SDE database called Roads (with geometry), which has the following fields: Road Name: Road Ref: I have a SQL database called Survey (no geometry) that has: Road Ref: Type: Condition: Year: I have FeatureMerged the two datasets on the Road Ref field so the Survey data has been added to the Roads database. I now want to write this out the same Roads SDE database. This where I'm tripping up! I'm assuming FME can create a new featue class/type with the relevant felds (i.e. all of the ones from Road and Survey_, but can't see where to do this in the settings, and I'm getting errors. I've tried a few different combinations settings, but could do with some pointers! Also, is it possible to create the feature class in a feature dataset in the SDE? Thanks everyone. Amit
Hi all, I have this error with executing spatial query with FeatureReader : 2013-11-20 17:11:55| 1.0| 0.0|ERROR |Execution of statement `SELECT "PDL_SIG_GAZ".* FROM ( SELECT * FROM "AMR"."PDL_SIG_GAZ" A WHERE (MDSYS.SDO_RELATE( A.PDL_GEO, :bindingQueryGeom,'mask=ANYINTERACT ') = 'TRUE') ) "PDL_SIG_GAZ" WHERE 1 = 1' did not succeed; error was `ORA-29903: erreur d'exécution de la routine ODCIIndexFetch() ORA-13236: erreur interne dans le traitement R-tree : [] ORA-13236: erreur interne dans le traitement R-tree : [Snapshot too old or Recursive fetch error] ORA-13234: échec de l'accès à la table d'index R-tree [MDRT Table] ORA-29400: erreur de cartouche de données ORA-00942: Table ou vue inexistante'. (serverType=`ORACLE8i', serverName=`CEDRE', userName=`AMR', password=`***', dbname=`') 2013-11-20 17:11:55| 1.0| 0.0|ERROR |Execution of statement `%5' did not succeed; error wa
Has anyone managed to successfully connect to a MySQL database using the MariaDB reader? The first time I tried I successfully got the table list and was able to choose a table but when it came to add the reader it just said "Running indefinitely" until I cancelled it. Now if I try to add it again I get a fatal error and FME shuts down (FME 2013 SP3 Build 13528)
I have the following readers.... Mapinfo line (Roads) Mapinfo Shape which consists of multible boundaries (Suburbs) I want to populate the Roads file with an attribute 'suburb boundary' from the Suburbs Mapinfo file and have a 'writer' that is the new roads file with a column called suburbs. Thanks,
I'm trying to read from a csv file a list of 3ds models to convert to sketch-up. Each model also need to be offset to correct insertion point. csv file contains for example header included: 3dsfile,xoffset,xoffset,zoffset m:\\sourcedata\\models\\test123.3ds,33001.98,58123.76,12.54 ... 54 models in the list the list is generated from a spatial filter I've tried the featurereader but it only works with single column cannot get the x,y,z details. also tried scripted parameter, but it only work only a single column Any ideas? Need to read each line, and offset each model to sketch-up (offset with the values in the csv file Rudy.
Hi, Has anyone come across the older SIGRID format or know of any tools or off the shelf file readers? http://nsidc.org/data/docs/daac/nsidc0050_aari_seaice/sigrid.html Thanks, Annette
Hi there, I am new to FME and I have been assigned a project where I would like to download a changeset data from the WFS server (eg. land parcel data), extract the data, evaluate the change in data and update everyweek and save in the local geodatabase using FME. I am kind of lost, I would appreciate if anyone would direct me in the right direction or is there any samples or any related documents that would help me understand for heads up? Regards, Subodh
Hello, I have a problem when I want to migrate Smallworld records to Postgis, I can not migrate the geometries. When I do the opposite, to migrate PostGis records to Smallworld: 1- I add, the format attribute "sworld_geometry{0}.sworld_name", in the Smallworld Reader. 2- I put an "AttributeCreator" transform in the workbench and create the attribute "sworld_geometry{0}.sworld_name" with value: location, route o boundary,(they are the names of the geometric attributes in Smallworld,That depends on whether the geometry is a point, line or area) But i don´t know how can i do the same for PostGis. Thank You
Hi Does anyone know how I can set a specific DWG layer visibility to be "off" by default? I have 100's of layers and would like to set some to be "on" and some to be "off". I can "freeze", "hide" or "lock" the layer via the format parameters section for the feature type properties - is their a way to switch visibility off? Thanks, Mike
Hello, I want to insert a value in a table with an XML Type (oracle non spatial) but I haven't find a type in user attribute corresponding. I have tried to insert by an sqlExecutor but for transaction meaning it is not valuable. Anyone can help me ? Best Regards, Julien
Hi, I’ve got SMW 4 source data that has multiple attributes that contain Date values that I’m importing to an ESRI File Geodatabase. (Not all attributes contain information, some have unset values). Using the DateFormatter on the values that do have information, it works; but when I include all records, I’m getting the following error message: The date 'unset' is not valid. Valid forms for a date type are YYYYMMDD, YYYYMMDDHHMMSS, or HHMMSS Is this error because I’m using the DateFormatter? Is there a way to pass the date with the correct format and not expect there to be a value in every field? Thanks in advance!
My first attempt at shape to KMZ is attached. I'm doing clearly several things wrong. Suggestions welcome. http://fmeserver.ncd.noaa.gov/ge_error.png I'm trying to produce: http://fmeserver.ncd.noaa.gov/ge_charts.png Which was created using Arc2earth which I no longer have acess to.
I have a large number (one for each day the past years) of text files of apparently same field structure. The fields are separated with semi colon ; delimiter, but with no text qualifyer e.g. " ". However, some of the records have data, which include semi colons and consequently mess up and fails when importing into FME Workbench. So far I have added the text files as readers in used the first line as column names, but the import apparently breaks when hitting the false semi colon delimiters. What can I do to manage and clean up such failures?
I have an AutoCAD drawing with hundreds of layers. I want to reproject the whole drawing and write it out as an AutoCAD drawing with all layer formats and attributes, blocks, etc preserved. So basically take the whole drawing and reproject it and create the exact same DWG in a different coordinate system. When I read in the DWG, FME shows my all the layers separately. Surely I don't have to connect each one to a Reprojector transformer?
Hello all, I have the following database: Table_source ID,CATEGORY,TYPE,REMARK 1,TEST,TYPE 1,NO REMARK What I need to do is export this to 2 XML files Table_export_1 ID,CATEGORY 1,TEST Table_export_2 ID,TYPE,REMARK 1,TYPE 1,NO REMARK The problem is that I can't find how to do this, I've tried with a SchemaMapper, but I always get a 1:1 result instead of a 1:n result. Can anyone help me out? Thanks in advance.
Hello, l'm attempting to create a json file using a json existing file structure, with values coming from an excel file. (I didn't find example with json file not in input). My problem is that l want to fill json file only with key:value not null (as you can do in php..?) so that the key is not written in the json file. sorry for my bad english, this an example : if l managed to get from my excel file : title_fr : description in fr --> title templater "fr" : getattribute("title_fr"), title_en : null --> "en" : getattribut("title_en") In my title objet in the json file, l want : title { "fr" : "description in fr" } and not title { "fr" : "description in fr", "en" : "" } in order to have a clean json file especially when l expect to have a lot of null values depending of the case. Hope l was enough clear for you to help me!! thanks,
Hi, I have a shape file with a price for each polygon and I want to convert that to a raster in order to be able to mosaic these values to another raster. How is that possible? Many thanks!
we are trying to import the object data to small world 4.3 from .tab file usnig FME work bench 2010. while running i am getting translation failed error. int the log file message Object unset does not understand message int!world_transform is displayed. so kidly let me know how to fix the issue.
Dear All , The uploaded files by the users get deleted before the process end , how to keep the uploaded file for a longer period . Also how to increase the performance of the datadownload services , it is taking one hour to report check conflict of an uploaded parcel againist all our store layers , is there is a way to speed up this , in arcmap when we found all intersect with this parcel it takes only 2 minuts .