Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 6,696 Posts
  • 24,691 Replies
6696 Posts
T
tlabs
asked in Data
Isolate text from .csv column

Was wondering if anybody has split text from a .csv column into to seperate columns?  I have a column named "Coordinates" with x,y data with the word POINTZ before the coordinate.  Example: POINT Z (-113.807295690 52.269077310 842.30)  I would like to put just the values in seperate columns (X & Y) containing no text.....  Once I have the x,y in seperate columns i'm assuming its easy to convert the .csv to a .shp  Any thoughts

4
T
11 years ago
samisnunu
Participant
samisnunuParticipant
asked in Data
Access a Secured FTP Site and Download the Dataset

Hi,   In a workspace, I will regularly update a source that is available as a zipped shape file from a secured ftp site with a username and password.    So I’m using the shape reader, and using a path like(ftp://<3.ftp/*_*.zip) in the FME shape file reader location, but FME returned the following error when running the workspace   ERROR |Shape Reader: No Shape Files found to process in directory,…   Obviously, I need to pass my logging credentials to download and read the zip file, so how can I pass the username and password in this case?  Sami

2
samisnunu
Participant
11 years ago
J
jim
asked in Data
FME Desktop 2013 sp1 and ArcGIS 10.2

Does FME Desktop 2013 sp1 (20130325 - Build 13450 - Win64) support ArcGIS 10.2?  Thanks Jim Q

2
fmelizard
Contributor
11 years ago
J
j_p
asked in Data
FME Comparing ecw files

Hi, i'm new in the world of FME and trying to learn the working of it. Mostly by using the help function, this website en offcourse Google. But some problems seems to be a bit difficult ;)  What i try to do is comparing 600+ ecw files to 1 ecw file that i can use, by importing, in another program. I have been trying different ways to get the job done but still didnt find a way to make this happen.  I hope to find some help on this site.  Thx J-P  

7
takashi
Contributor
11 years ago
T
tlabs
asked in Data
Read from Source Parameter

Has anybody had the issue where you add a shapefile (with a set projection, including a .prj file) as the reader and when writing this shapefile to an SQL database it does not bring the Coordinate system over with it?   Example:  Load a shapefile into a GeoMedia SQL database. For the Parameter Coord. System: you leave as the default "Read from source"   This runs successful but when you go into GeoMedia --> Warehouse -->Feature Class Definition and review the Coordinate System, it is empty? Indicating that FME did not actually Read the Source Coordinate System and in return your feature class is left with no associated Projection?  Does FME require a specific Projection file for it to "Read from Source" ? because regular .prj files it does not seem to reconginze.     

0
T
11 years ago
F
frazucca
asked in Data
Mass export of fields from xml to db

Hi at all after successufll (tank to Itay and Takashi) managed the spatial conversion of xml to  shape/kml/postgis  I need other suggestions on how manage In essence, I would bring in the db (both ESRI geodatabse or postgis) a large part of the fields in the XML linking to their spatial compontent . How can I manage it in a few steps (I have a thousand of xml with same schema)?   TIA best regards fz

4
fmelizard
Contributor
11 years ago
A
alexvsn
asked in Data
Shape vertex order

I'm traying to export a numbor of polygon shapes into an CytiGML model. The shapes contain the roofs, walls, and ground of the buildings I've noticed that because of the way the polygon vertices are placed arownd the contour,(clockwise or counterclockwise) the faces that are created in cityGML are visible as front faces for counter-clockwise orientetion of the vertices and back faces for clock orientation. I've tried to filter the shape using orientation extractor and attribute filter but i don't get any result. What is the conection between the orientation and the vertex placement, if is there any? Has anybody encountered this problem before? The simplest way is to change the direction of the vertices in arcmap but i don't know if it is posible?Open for suggestion. Please help!

1
takashi
Contributor
11 years ago
A
allex
asked in Data
Smallworld Geometry fields does not appear on the Feature Type (Reader)

Hi Guys,  I'm using FME Desktop 2013 connected to Smallworld databases.  I need to convert geometry fields from my "reader" to geometry fields to my "writer", I'm adding the feature type together with the "reader" creation but the geometry fields aren't appearing, If I create my "writer" and after I import the feature type for the same table as a "writer", the geometry fields appear normally.  Do I need to use any transformer for this? I tried to use GeometryFilter but I can't to see the geometry fields.  Anybody help me?  thanks, Allex

0
A
11 years ago
R
rkay
asked in Data
Generic reader and ESRI file geodatabases

Hi all, I'm trying to set up a validate and load workbenches which will be run through FME Server.  I want to use the Generic Reader so that user can load data of any format onto our system.  I know that file geodatabases will be one of the main formats being loaded but I can't get get the Generic Reader to recognize the database when testing. When I 'Prompt and Run', I forces me to point to a specific file as the input and predicts the format type from that file.  This works in case of a shapefile but not for file geodatabase files.  In the documentation is says it will recognize a File, Directory, URL, or Database name. Any thoughts on how I can fix this?  Thanks  rkay

0
R
11 years ago
sigtill
Contributor
sigtillContributor
asked in Data
Write ArcSDE (difference between SDE30 and ESRI Geodatabase)

I have managed to create new features and put them on a DYNAMIC SDE30 writer that inserts the features, deletes the features and updates features correctly by using fme_db_operation = UPDATE, INSERT, DELETE and on the WRITER Writer mode: UPDATE.  However when I try to do the same with an ESRI GEODATABASE_SDE it logs that the features are written - however there is nothing in the database (also not in any other features or tables on the same server). Doesn`t the ESRI GEODATABASE_SDE writer handle the fme_db_operation parameter the same way as the SDE30 writer?  Any other tricks to be aware of when working with writing to ArcSDE?

6
sigtill
Contributor
11 years ago
F
frazucca
asked in Data
extract spatial info from XML (ISO19115) to build up feature

Hi I've a lot of xml files ISO191115  (like the one at the link below)    with some spatial info as the EX_BoundingPolygon that I need to extract for build up some feature in kml or shape format. Do you have any idea or suggestions?   TIA ciao fz  link to example file: https://api.echo.nasa.gov/catalog-rest/echo_catalog/granules/G26813121-LPDAAC_ECS.iso19115_2?token=3F8812EE-8A4F-EAFF-FE95-E6A036ACC3C1

6
takashi
Contributor
11 years ago
ebygomm
Contributor
ebygommContributor
asked in Data
Setting a format attribute dynamically in file based datasets

When writing to a file based dataset, i.e. each feature type is a layer within a dataset does it matter in which layer you set and expose a format attribute, e.g. map extents / viewport within a geosptial pdf, does it need to be repeated for each layer?

2
srg
11 years ago
A
arnaud
asked in Data
Is it possible to merge several KML in a single one ?

Hi, I would like to merge several kml into one, but in keeping my hierarchical structure, that means Event Type > Countries > Year > Month > Link      Then I would like to handle it in GoogleEarth but it would be too heavy. Is there a way to resolve this issue?    Thanks in advance for your help.  Regards    Arnaud

3
srg
11 years ago
R
raj
asked in Data
Input multiple rasters using geo-database or CSV file

Hello All,  How do I input multiple raster files (in multiple directories) using a file-geodatabase or a CSV table?  I have JP2 files in multiple locations. I have the outline geo-databse file that shows the paths & the file name. Using this table, I would like to convert these images to geoTIFF format in bulk.  Any exapmles would eb fine too.  Thanks

1
fmelizard
Contributor
11 years ago
E
erma
asked in Data
How to replace a few attribute values by attribute values from another feature class?

Hi,  I am looking for a way to replace some (205 values) attribute values from a polygon feature class containing 45000 values. The new attribut values (the 205) are stored in another (point) feature class and the location is the only conformity. With all the other attributes it is not possible to determine the responding point to the polygon.  Kind Regards,  Markus

4
takashi
Contributor
11 years ago
I
imran
asked in Data
Oracle spatial writer in update mode.

Hi,  I am trying to update a geometry of a feature stored in oracle spatial. I've set the writer mode to UPDATE also I've mentioned the key columns (combination of four colums is unque).  The workbench executes without giving any error, the log shows that it has written fatures but the geometry column does not change.  Please suggest if I am missing anything in this.  Regards IMRAN

6
I
11 years ago
B
battlezone77
asked in Data
Sending the file location of Uploaded file to the published parameter of a workspace of a jobsubmitter service

Essentially what i need to do is for the user to upload a file to FME Sever using a custom web form and then send the upload location of the file to the published paramter of the job containing the workspace I need execute. When i try to run the job it just never seems to ever seems to start executing the workflow.    From what i can tell i am following the correct stepsbut it seems as if the parameter is never getting passed. Also i think part of the issue is, i dont actually need to read the contents of the file. I just need to know its name and location so that i can upload it to the web. I have this process working on the work bench in terms of uploading the file correctly using a published parameter...so it must be something going wrong between the web form, FME Server, and the job. Any help would greatly be appreciated.    Here is what i used as my main reference: http://fmepedia.safe.com/articles/How_To/Direct-Upload-and-Run-with-FME-Server

0
B
11 years ago
F
fabienne
asked in Data
Generate SDO_GEOMETRY from x,y (.xls)

Hi,  I have an excel file (.xls) containing the following columns: objectid, adresses, x, y  where x= x coordinate and y= y coordinate.  I would to create a new table in Oracle with the following columns: objectid, adresses, geom  where geom is a SDO_GEOMETRY type. The geometry objects are created from the values in the x and y columns from the excel file.  How is it possible to do that with FME?  Thank you,   Fabienne

12
fmelizard
Contributor
11 years ago
sigtill
Contributor
sigtillContributor
asked in Data
Dynamic write to ArcSDE Geodatabase

I am writing to a ArcSDE Geodatabase with many Features. I want to make sure that only the existing features gets written - for instance:  MyRoadsPoint MyHousePoint MyParkArea  So if I create a feature_type called MyParkPoint and try to write this - it will fail because the MyParkPoint does not exist in this database.  Is there a setting on the writer I have not seen?  One solution might be to add the existing allowed FeatureTypes - however the allowed FeatureTypes and the Output database will chang between every run.

0
sigtill
Contributor
11 years ago
J
jamesstott
asked in Data
Spatialite and encoding

I have some shapefiles which FME reads and then writes the data to PostGIS. I have added a Spatialite writer to the workspace as well as I have some users that need file based access to the data.  The data loads into PostGIS fine and I can see the Norwegian characters æ, ø and å fine.  But the data loads into Spatialite with these characters replaced.  The data is writen to PostGIS and spatialite in the same workspace, so it goes through the same transformers etc.  Can anyone suggest how I can fix this?

2
J
11 years ago
sigtill
Contributor
sigtillContributor
asked in Data
Writer: ESRI Geodatabase

Trying to read: http://docs.safe.com/fme/html/FME_ReadersWriters/Default.htm#geodatabase/Writer_Directives_EntGeodb.htm  To figure out what the parameter setting: Validata Features to Write does. However I can not see any documentation on it. I "assume" it will only write Valid Features to the database (ie - features that have all Attributes) and that it will FAIL and ROLL BACK once it meets a feature which misses an Attribute in the feature (that is not null)   

1
fmelizard
Contributor
11 years ago
P
priyanka
asked in Data
PGDB and topology/attribute validations.

Hi,     I am new to FME. I want to know how I can perform following task using FME  1. Convert PGDB (.mdb file) or shape format (.shp/.dbf/.shx) into FGDB format.  2. Perform topology and attribute validations (eg. Check for required feature classes) on uploaded FGDB format files using geodatabase workspace XML file template.     If you can provide links to related documents/pdf’s/video; it would be great help.        Thanks & regards,  Priyanka Foss.

2
P
11 years ago
M
mixedbredie
asked in Data
PostGIS "Create Generic Spatial Columns" setting

Hello List  I need to be able to change the setting to create default spatial columns from YES to NO in existing workbenches writing to PostGIS.  From this question (https://safe.secure.force.com/apex/AnswersQuestionDetail?id=906a0000000ciBiAAI) and Mark's answer:  Another setting that may help, when you add a new writer look at the properties dialog and there is a setting called "Create Generic Spatial Columns". As long as that is checked the table should be a generic one and not need a geometry type set.  I have been able to get my (new) workbenches to work the way I want them.  However, I have a number of old workbenches with the option checked.  When I connect my QGIS to PostGIS I see duplicate entries in the layer picker - one for the table with correct geometry and one for the table with unknown geometry.  Can I retrospectively edit my workbench to change this setting?  Thanks  Ross

0
M
11 years ago
R
rahul
asked in Data
Compare xml file and geo database(.FGDB)

Hi,  I am new to FME, i want to know how to compare File Geo database(.FGDB) with some xml configuration file for Feature class, or attribute or topology validations.  Short demo will be helpful for this.  Regards Rahul Sumant

1
fmelizard
Contributor
11 years ago
L
lecoqgaulois
asked in Data
FME and Oracle

Hello,  Is it possilble to remove an Oracle table by FME. Transform SQLExecutor and instruction "Name_Table DROP TABLE" does not work. Thank you for your return.

9
M
11 years ago

Badge winners

Show all badges
29,700
Posts
Terms & ConditionsCookie settings