Skip to main content

Data

Using readers and writers to extract and load data.

  • 6,931 Posts
  • 25,504 Replies
6931 Posts
jpvo
jpvo
asked in Data
Error 400 when uploading workspace on the Cloud

Hi, I have the foollowing error message when uploading a workspace on FME CLoud: Uploading as 'test.fmw'... Publish failed - FME Server encountered an error and reported the following message. <error><name>filename</name><message>The 'filename' matrix parameter is required</message></error> Request to http://geopol.inser-team.fmecloud.com/fmerest/v2/repositories/Samples/items returned status code 400. Error 400 means wrong filname extention. What's wrong in uploading a .fmw? I am experiencing this whatever workspace I upload. (FME 2014 Build 14230) I can upload on this FME Cloud instance with FME 2013 without problem. Thanks for your help. JP.

371
fmelizard
Contributor
gpt_geoinfo
Contributor
gpt_geoinfoContributor
asked in Data
bringing 3D-features to ground (kml)

Hi Community, I got 3D-features, which are in their local coordinate system at the right position. But when I translate them to KML to watch in Google Earth they hang several meters above ground. I know there is a difference between Swiss height and WGS84 height. Is it possible to bring the 3D-features to the ground? Thanks in advance, GPT-Executer (Maria)

150
S
francis_m
Contributor
francis_mContributor
asked in Data
SDE and Oracle data

I have a Oracle database that store ArcSDE data. I read mapinfo data with FME (MAPINFO reader) And I write the data with FME (SDE30 writer) I use : FME(R) 2012 SP4 (20120926 - Build 12266 - WIN32) It's the same problem on server or desktop. My problem is about an attribut. It's a unique ID (ID_ORIGINE) that goes like this : Mapinfo value : 7271203048662889 FME (logger) value : Attribute(string) : `ID_ORIGINE' has value `7271203048662889' It's the same. But when I open my ArcSDE table with ArcMap or visualize the data from within Oracle with SQL Developper I have this : 7271203048662890 The end of the number is rounded (2890 instead of 2889). But I didn't ask for this. My data structure : Oracle : Number SDE : Double (precision 38 and scale 10) so it should go well cause If I insert it manually it's OK. But when FME write it down : the value is rounded. Is it FME that round the value while writing it down or Oracle or SDE that do the trick? Any idea? I know I can change the data structu

80
francis_m
Contributor
B
beedge144
asked in Data
Ordnance Survey Vector Datasets and GML Readers

Hi - I'm having some problems with translating the OS VectorMap Dataset - I know there's a reader for each of the OS Vector products - and I've cross posted on another thread (Issues Reading in GML) BUT what I need explaining to me are the different approaches that seem to have been adopted by each of the vector products, and the GML, and their Readers in FME. I've had no problem at all in translating OS MasterMap, I've created quite a nice workspace to translate and style the data into MapInfo; nor have I any problems with the VectorMap Local. But why does VectorMap District require to have an xsd called by a URI, and then store feature types in an SQLLite db (?) and so on... If anyone can enlighten me on the different approaches that seem to have been undertaken, then I would be very grateful !

40
B
R
rhodri
asked in Data
Issues reading in GML

I'm currently trying to read in some GML (as a first step to doing some more complex transformations on it), and I'm having some issues with reading it in, different depending on which method I've attempted to use. The file i'm trying to read in is an OSVectorMap District gml First method: Using the normal GML reader, I'm attempthing to read the file in, and pull the .xsd file from the Ordnance survey's website and I'm the error below. I know that I don't need proxy settings as I've used this method to read in OSVectorMap Local files in the past HTTP transfer error: 'Failure when receiving data from the peer' Please ensure that your network connection is properly set up No proxy settings have been entered. If you require a proxy to access external URLs, please ensure the appropriate information has been entered Second Method: The second method I’ve tried was to download the OSVectorMap District .xsd file, and alter the xml to reference it locally, storing it in the same place as the gm

880
B
jon
Contributor
jonContributor
asked in Data
Delete was not performed on feature for the table/feature class

I'm writing to a FGDB and keep getting a Warning message in the log file that says: WARN |Delete was not performed on feature for the table/feature class 'feature class name goes here' The thing is that there are 11 line features to be deleted, 9 of them delete correctly and the remain 3 stay in the geodatabase for some reason. There isn't really any other information in the log file as to why these 3 features aren't deleteing. I added an inspector to view the data going into the FGDB writer, and all 11 records are set to fme_db_operation = DELETE. I'm at a lose as to why 3 of them don't actually delete. Any ideas or other things I can check?

101
K
R
ragje
asked in Data
1:n with FME, using external Excel file?

Hello all, I've got the following table: Building_ID, Color, Size, Roof 1,Red,1-10m,Flat 1,Blue,30-40m,Tiles 1,Green,20-30m,Flat 1,Red,20-30m,Tiles Now, I also have this related table which I want to populate: SubBuilding_ID,Item_ID,Subitem_Work,Subitem_Amount,Subitem_Units,Subitem_CPU I want to populate this using the following external file: Work_ID,Color,Size,Work,Amount,Units,CPU 001,null,1-10m,Paint,10,Liters,5 002,null,10-20m,Paint,10,Liters,5 003,null,20-30m,Paint,30,Liters,5 004,null,30-40m,Paint,40,Liters,5 011,Red,null,Flat,Flat Roof,100,m2,10 012,Red,null,Tiles,Flat Roof,1000,pieces,2 011,Green,null,Flat,Flat Roof,100,m2,8 012,Green,null,Tiles,Flat Roof,1000,pieces,1.50 011,Blue,null,Flat,Flat Roof,100,m2,6 012,Blue,null,Tiles,Flat Roof,1000,pieces,1 Now, I can get multiple Work types per Building, so I've got a 1:n relationship. The Excel layout is still up for debate, so it can be changed. I just can't find out how I would build rows using the external Excel. FeatureMerger

100
takashi
Contributor
D
dr_ysg
asked in Data
Capture the results of a File Writer

I have a PNGRasterWriter towards the end of my workflow. My project produces about 200 - 5,000 PNG files. In FME desktop I want to send a message (HTTPFetcher would be fine) each time a new file is finished being written. The GET HTTP packet would have to items of info: File Name File Size. The part that I am having trouble with is getting this informaiton AFTER the write is done. How can one do that? if this is really messy then I guess I will have to go earlier in the pipe (I do have a attribute called FileName) and then send that out without the size info. Any suggestions?

80
D
S
sjc1999
asked in Data
Oracle Spatial Index Creation

Is a spatial index required when reading a table/view using the Oracle Spatial Object reader? Are there any transformers that require the existance of a spatial index?

131
fmelizard
Contributor
francis_m
Contributor
francis_mContributor
asked in Data
Oracle query with FME

Hi, I'm using a workbench to launch a SQL query on a Oracle Database with many JOIN. I use SQLExecutor to do it. When I query a specific record, the result is very fast. But when I need to extract all the data from my query (more than 5000000 records) My computor goes slow and FME failed to execut it. I receive this : Insufficient memory available -- error code was 2 I need to extract all the point from my table ROL_UNITE_P and join 5 tables to add data. Should I use more than one SQL Executor? Should I use something else? Thanks! Francis This is my SQL query : SELECT rol.ID_PROVINC, rol.CODE_MUN, rol.RL0102A, rol.MAT18, adr.RL0101A, adr.RL0101B, adr.RL0101C, adr.RL0101D, adr.RL0101E, adr.RL0101F, adr.RL0101G, adr.RL0101H, adr.RL0101I, lot.RL0103A, prp.NOM_PROP, prp.PRN_PROP, prp.NO_COPROP, prp.ADR_POST, prp.MUN, prp.ADR_POST_COMPL_C, prp.ADR_POST_COMPL_P, prp.COD_POST, prp.DAT_INSC_ROLE, cd_gen.DESC_ AS CODE_GEN, cd_lien.DESC_ AS CODE_LIEN FROM rgora1a_res.ROL_UNITE_P rol LEFT JOIN rg

770
parashari
S
shemnel
asked in Data
Reading & writing standard GRID format ESRI rasters

Hi, i might be missing something fairly obvious, but i want to read standard ESRI GRID rasters into FME, work with them and write a single ESRI GRID raster. (Not DEM, GeoTIFF etc etc, just standard GRID). Do i have to convert the GRID to ASCII in Arc before FME can read it? and is this the case for writing too? thanks for any help

544
S
R
robinne
asked in Data
Big CSV to Raster files

Hello guys, I have a big CSV file ( 1.3 Go) as an output of a modeling software. This CSV has 2 fields for Lat/Long and 145 more fields, each for a climate variable. I need to convert each variable in a raster, so 145 rasters, with a 500meters resolution (same as input resolution actually) I tried with the 3D point replacer wich seems to work, but I have problems to set the NumericRasterizer and the ouput is just full of NoDataValues. R is running out of memory while FME seems to do the job...good point ! Thanks !

431
sigtill
Contributor
aguan
Contributor
aguanContributor
asked in Data
Why I can not access OData in my FME desktop 2013?

I published an OData service from Composite Studio (from Composite Software). It is in ATOM format that FME Desktop 2013 supports. I can see the http URL in browser but can not access it in FME reader. It does not give an error message. The log file shows: Trying to find a PYTHON plugin for reader named `ODATA' Trying to find a PYTHON plugin for reader named `ODATA' OData Reader: Directive 'SERVICE_URL' has the value 'http://dalwcompd01.nexenusa.ad:9400/odata/TGS_LOGS' OData Reader: Directive 'USER_NAME' has the value '['admin', 'admin']' OData Reader: Connecting to service 'http://dalwcompd01.nexenusa.ad:9400/odata/TGS_LOGS/' OData Reader: Retrieving feed names from service 'http://dalwcompd01.nexenusa.ad:9400/odata/TGS_LOGS/' OData Reader: Reading schema data ... Merged 0 schema features read from 1 datasets into 0 resulting feature types UniversalReader -- readSchema resulted in 0 schema features being returned Reader Parameter(0) = >http://dalwcompd01.nexenusa.ad:9400/odata/TGS_LOG

151
sigtill
Contributor
bgeorges
Contributor
bgeorgesContributor
asked in Data
FME 2014 - Issues with MapInfo TAB Writers

WIth the release of FME 2014, I notice that the MFAL writer for MapInfo tab has desappeared. We now have the MapInfo TAB (MAPINFO) and the MapInfo TAB (MITAB). I have noticed that both writers are using MITAB. See this log: 2014-02-03 15:24:49| 0.3| 0.0|INFORM|Using MapInfo (MITAB) Native Writer $Revision: 113523 $ We have a problems using polygon data created with MITAB. When opened in MapInfo, the nodes of those polygons cannot be snapped and features are deleted when performing geometric operations such Erase or Split. We were always using MFAL writer because of those issues with MITAB. Why removing MFAL writer in FME 2014? Is Safe Software knowing such issues with MITAB? Thank you for info on this topic.

192
bgeorges
Contributor
Y
yanickname_
asked in Data
DGN(V8) Writer, bug?

is there a way that i can fan out by feature type on the DGN(V8) writer without providing a 'Feature Type Name:'? I have a seed file which has layer 0,1,2,3 - 256 etc, these are stored as attributes called 'CAD_Layer', using desktop 2012

30
Y
sigtill
Contributor
sigtillContributor
asked in Data
EXCEL-reader: Read transposed EXCEL

On several projects they have made the Excel-spreadsheets "non logical". So instead of having the spreadsheet like this: Is is saved as this: I have read the various FME + transpose + EXCEL posts (for instance http://fmepedia.safe.com/articles/How_To/Advanced-manipulation-of-Excel-tables-using-AttributeExploder) - however this will not give me access to the schema withouth running a workspace first - and then loading that file in a new workspace. So it would be very usefull to have a "read transposed" option on the EXCEL-reader. Or is there a workaround I havent found?

191
K
S
sbaktzg2
asked in Data
Read WFS secured with secure token

I would like to read datas from a WFS (Web Feature Service) which is served from a ArcGIS Server which is secured with secure token. How can I configure this?

50
S
J
joanr
asked in Data
Error when reprojecting from NAD 83 to NAD 27

I get the following error in my translation when I try to reproject on ESRI data interoperability from NAD 83 to NAD 27

20
J
K
kktshka
asked in Data
Bulk processing of gdb Raster Datasets

Hello everyone, Would appreciate if anyone could give me a hint if this is possible to process multiple raster datasets within file geodatabase as single merged reader? I need to convert one gdb raster datasets into set of tiles within another gdb raster catalog and struggling with reading all of the input files at once. Is this possible? PS. This is my first post here so I hope I didn't break any posting rules. Cheers, Kim

162
K
jpvo
jpvo
asked in Data
Error closing an Edit session on GDB

I all, I got this error message while running a workspace which writes ESRI relationship classes: An error occurred while attempting to stop an edit session. The error number from ArcObjects is: '-2147220893'. The error message from ArcObjects is: {Workspace or data source is read only.} 1) I read SHP and write GDB both in and out zip files (if both dataset are not zipped it is OK). 2) I set up the FME_TEMP variable to C:\\temp to make sure I have write access 3) Why should I have write access problems to the _auto_zip_dataset on C:\\temp? 4) Is there a trick I don't know about? Thanks for your help. JP

711
G
R
richberry
asked in Data
ArcInfo e00 format creation from MapInfo

Hi, I'm trying to create e00 files from MapInfo (all BNG prjection) and i'm coming across a couple of issues.... 1. warning message "Could not find an E00 mapping for datum of coordinate system `OSGB-7P'". Can anybodyexplain what the importance of this message is? 2. The resulting e00 files all have the file location held within the file (when opened up in Notepad, the first entry is "EXP 0 C:\\data\\...........", which i'd rather not have displayed to clients. Is it possible to exclude this text? 3. Using a clunky old MapInfo tool "ArcLink" i am able to avoid the issues above, but i'd much rather use FME for this translation. May thanks rich.

80
K
M
map_monster
asked in Data
Write google fusion table to a specific folder on Google Drive?

Hi, Is it possible to specify an existing output folder on Google Drive when writing to a Google Fusion table? It always ends up in the root folder (My Drive) for me. I would like to write the table to an existing shared folder to avoid having to share the table when it's written. /mats

110
K
philippeb
Enthusiast
philippebEnthusiast
asked in Data
Export coded domain from Geodatabase

Hi, I am using FME2014 and I am using this documentation : http://fmepedia.safe.com/articles/How_To/Working-with-Geodatabase-Subtypes-and-Domains At the step 3 of reading domain values in the documentation, I click on VIEW of the coded_domain (DIAMETER) and I have my list of coded domain values from my GDB. Exemple : http://fmepedia.safe.com/servlet/rtaImage?eid=ka1a0000000cwS9&feoid=00N30000007dMlC&refid=0EM30000000TpzI What I want to do is to export this list into something else like Excel. I have hundreds of coded domain values into my GDB, each of them connected to Feature Class. I would like to export the coded domain values (code and description for each of them) from all the FC I would choose to read into FME. You think it is possible? Thank you!

331
T
esko
esko
asked in Data
Rounding coordinates when reprojecting from and to Oracle Spatial Object tables

Hello, I'm doing a straigth-forward conversion of Oracle SDO_GEOMETRY from srid 294914 (old national coord.base) to srid 3067 (new national coord.base) using just Oracle reader and writer. Is there any way to reduce the number decimals in the output, at the moment converting from 3385034.91; 6678837.36 (east; north) produces 384911.612948413; 6676033.80278682 Best solution would be to have some parameter in the writer to round or cut to a desired number of decimals . I assume that using some transformer (like CoordinateRounder) between reader and writer would substantially increase the execution time ? Esko

191
fmelizard
Contributor
T
tofia
asked in Data
How to specify the feature type in the FeatureReader

Hi I have a huge set of Las files and I just want to pick out one or more of the files and cut out a pre-defined area. The area will be defined by the user, a published parameter. I do area on area overlay, the customer defined area over a square grid to catch one or more id numbers. Know I drop the geometry and just use the attribute in this part of the workbench. Couse I figured it would take longer time to do a spatial intersection in the next part of the workbench. I use the feature reader transformer and specify the feature type to read to the attribute above (Id number). I have defined the directory and dataset is set to *.las. I’m having problems though when I run the work bench it doesn’t fetch the Las files. The attribute is defined as 70875_7620 so I tried 70875_7620.las and no deferens. THe transformer runs when I use the spatial intersection mode that’s way I figured out it must be the attribute. Any Ideas? Tofia :)

56
T

Most helpful members this week

Badge winners

  • FME Form Advanced Training
    vmerguhas earned the badge FME Form Advanced Training
  • Integrate Data with the FME Platform Training
    rodavcashas earned the badge Integrate Data with the FME Platform Training
  • FME Flow Authoring Training
    bettsgeospatialhas earned the badge FME Flow Authoring Training
  • Welcome Back
    jimmy.chaohas earned the badge Welcome Back
  • FME Flow Authoring Training
    paigehhas earned the badge FME Flow Authoring Training
Show all badges
30,846
Posts

Popular tags

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.