Using readers and writers to extract and load data.
Recently active
I've got a CSV file that came from a flood modellnig package. I want to geocode and map the water levels at each point (calculation cell centroid) at a series of time slots. My problem is this: the file has 1 row for each time slot and 1 column for each calculation cell centroid (about 500,000 columns in all). When I created a CSV reader for this file FME 2013 just sat for hour after hour and never got as far as displaying the reader on my workbench. Presumably it couldn't cope with trying to generate the schema/list of attributes. Any ideas for processing this file? The only thing I can think of is writing a utility to transpose the file first. Thanks, Ian
Hi, I have a problem running an FME task (fmw) as an FME commandline scheduled task on Windows 2008 R2 (64bit). Background: 1. FME 32bit installed 2. Oracle Client 32 bit installed 3. Oracle client BIN folder n PATH 4. TNS_ADMIN environmental variable set to point to folder containing tnsnames.ora The problem: I created a scheduled task that runs fme.exe with my workbench file (fmw) as command line parameter. The task is set to use the SYSTEM account to run the task (this is because we cannot use a local or domain account as out policy doesn't allow password saving). When running the task in this configuration I get the "Oracle client libraries could not be loaded." error. When running exactly the same task using my user account it works. What works: 1. Running FME task via workbench. 2. Running the task via commandline (command prompt). 3. Running the scheduled task under my user account (when logged in). 4. As a sanity check I have
Looks like FMEServer 2013 does a Postgis query by default with the owner "public" before using the login specified in the fmw?? The error raised is causing me problems in my application NOTE: All my data is not in the public schema Log: Error executing SQL command ('select * from "public"."hafa_acoa_02_poly" limit 0'): 'ERROR: relation "public.hafa_acoa_02_poly" does not exist No spatial column was found for 'public.hafa_acoa_02_poly'. This is most likely a PostgreSQL table with no spatial data. No geometry will be read. If spatial data is not present, please try using the PostgreSQL reader instead PostGIS geometry type unknown or empty (). Setting PostGIS geometry to 'postgis_none' Error executing SQL command ('select * from "public"."hafa_acoa_02_poly" where false limit 0'): 'ERROR: relation "public.hafa_acoa_02_poly" does not exist SQL query on table 'public.ha
Hi, I adopted the example of a Catalog and Repository from: http://fmepedia.safe.com/articles/Samples_and_Demos/Integration-example-for-OGC-CSW-Data-Catalog-And-Repository-with-FME-Server to build a workbench that reads in files, guesses the format, gets, the bounds and dataset names and writes this metadata to an XML-Template and copies the original files to a definied directory. Works fine on my Computer and on our (windows-based) test server but fails to run on the Linux based Server of our partners. In order to identify the error, I have created a workbench that just copies the files. This runs well on the Linux server - so it isn't a permission problem. But as soon as I add the XML-templater the workbench will stop with an error on the Linux-based FME Server. Here is what the log says: 2013-03-09 22:48:52| 0.7| 0.0|INFORM|FME API version of module 'XMLTemplaterFactory' matches current internal version (3.7 20121025) 2013-03-09 22:48:52| 0.7| 0.0|WARN |XMLTemplater(XMLTem
Hi, another CityGML question! is there a possibility to write CityGML 2.0.0 already? I'm trying to model the buildings at LoD0, as lod0FootPrint, but this citygml_lod_name is not valid! "The 'lod20FootPrint' citygml_lod_name trait is invalid for 'Building' features, the geometry will be ignored, valid values are {lod1MultiSurface, lod1Solid, lod1TerrainIntersection, lod2MultiCurve, lod2MultiSurface, lod2Solid, lod2TerrainIntersection, lod3MultiCurve, lod3MultiSurface, lod3Solid, lod3TerrainIntersection, lod4MultiCurve, lod4MultiSurface, lod4Solid, lod4TerrainIntersection}." Can I add this possibility manually, or should I wait for a new (updated) cityGMLwriter? (next question I will ask, will be concerning the modelling of tunnels and bridges ;)) with kind regards, Ine De Cubber
Hi, For some reason the formats my workspace arent being recognised by the generic reader on FME Server. They are when I run it in desktop. Do I need to do something else on FME Server? Thanks, Owen
Hi there, I have a line feature class in an SDE database that changes daily. I need to compare this feature class with the newer shapefile and add the changes to the SDE feature class. Currently, I have a reader for the SDE feature class, a reader for the shape file, they go through the change detector transform, and then I have a writer to the same SDE feature class. However, the change detector is not detecting any duplicates, even when I test with the exact same file (so all output should be unchanged). This works correctly if I have two readers that are both shapefiles, or two readers that both read from an SDE feature class. Any ideas why it won't detect duplicates with a combination? Thank you.
I have 2 shapefiles (points). How can i copy the attributevalue from shape 1 to shape 2 if the points have the same geometry. Example if point A from shape 1 and point B from shape 2 have the same X,Y and i want to copy an attributevalue from point B point A
Hi, I am importing the shapefile from fme to smallworld, In my shape file i have 169 records but only 10 records are importing. In this process i am getting the error :: Error :Primitive a polygon.all_intersections failed status 1376267(0,21,11) Too many intersections How can i resolve this problem please help me and suggest me the solution as early as possible. Thanks in advance.
Hi ! Is there a way I can get my fanout result nested in a subdirectory in a KML/KMZ file ? Should be quite simple, but I just can't make it work. I have a MapInfo table with schools which I would like to separate in type of schools and by region. Type of schools, language and regions are held in columns in the MI table. Here is a sample of what I'm trying to achieve : Schools (document name) - Elementary (1st order subdirectory) - English (2nd order subdir) - Region 1 (3nd order subdir - that's where my fanout should be) - Region 2 - ... - French (2nd order subdir) - Region 1 (3nd order subdir - that's where my fanout should be) - Region 2 - ... Secondary - English (2nd order subdir) - Region 1 (3nd order subdir - that's where my fanout should be) - Region 2 - ... - French (2nd order subdir) - Region 1 (3nd order subdir - that's where my fanout should be) - Region 2 - ... University ... Every
I am trying to create ellipse features that are perpendicular to our drill hole trace (line feature). I have the centroid x, y, and z coordinates, the azimuth and dip data for each ellipse. I've only gotten to the point of creating the ellipsoid at the correct location but cannot seem to orient or rotate them accordingly. Does anyone have any advice? Thanks in advance.
Hello again, anyone know a quick solution for displaying an Autodesk 3DS-model of a tree for each point in an ESRI-point-shape? I will eventually merge it with a DEM an Orthophoto and 3D-buildings and write a 3d-PDF. Thanks for your considerations Patrick
I have a set of microsation v8 files. The files have a coordinate system attached to them. When I use FME to read in and output file to a different format (such as shape files), the readouts now show that everything has been shrunk to within fractions of a seconds of the origins of the file, instead of being in their true geographic location. Is there anyway to get FME to correctly read the coordinates so my output data is in the correct location?
I have a set of roads, where I have made the areas for road cover, and coded it with road-spesific metadata. So far so good - I can deal with manipulation. But I cannot properly write it without getting a metric ton of duplicate lines. I have run the data trough a topologybuilder before exportting, but to no avail. I used a different SOSI writer before (and guess I am forced to learn some of this stuff all over again) but want to cut some corners by asking: Does anyone have experience in writing to a SOSI-file that include polygons/areas?
I'm trying to import some MicroStation DGN data into an SDE Geodatabase (Oracle). My workflow is built specifically to preserve curved geometries, and when I write to a File Geodatabase, these are intact. However when I write to an SDE Geodatabse these are stroked into straight line segments. Looking at the logs I get the following warnings: WARN |Required columns 'GLOBAL_ID, OBJECTID, ' not specified for predefined table 'GISOWNER.TEST'. Using Definition from Database WARN |DEF line for the table 'GISOWNER.TEST' not fully specified. As a result, existing table definitions will be used WARN |Existing SDE table 'GISOWNER.TEST' allows the following shapes: SDE_NIL SDE_LINE SDE_SIMPLE_LINE SDE_MULTIPART . Shapes specified in mapping file for table allows: . Defined shape types don't match. WARN |Spatial column name for existing table 'GISOWNER.TEST' is 'SHAPE' while value specified in mapping file is ''. Usi
hello everyone I don't have good experience with FME, but i need to use it in my Master thesis project. The thing is i am developing an iPad App, one of the most important parts in this App is to send the GPS latitude, longitude to the GIS server (via FME) then get the GIS data related to that GPS location in a Wavefront obj file (in 3D) (ALSO via FME). So could you please provide me with any pointers to start. Any tutorials that explain this communication. I am using Objective c as the main programming language and also java for the servers. Many thanx for the help Cheers Saif ALSAIFI
Another question from me. I know that FME is capable of setting no data on geotiffs when making a conversion from polygon to raster. Setting a background value with the ImageRasterizer and then filling it with Nodata. Interpreting this image in ArcGIS, the Nodata actually means no data and can be excluded from calculations. I want to do the same process process manually without the conversion from a polygon. So GeoTiff --> GeoTiff. The RasterBandNodataSetter doesn't seem to actually work for me what should I fill in for "Nodata Value" when for instance I want all the 255,255,255 values to be regarded as NoData? To what attribute should it be linked? Any alternatives? I prefer not to make a conversion to shape first, if possible. FME desktop 2012
Hi, I created CityGML files with FME, which works quiet good. I now modelled the CityGML-ReliefFeature, but I'm not able to add the attribute <lod>. What I did: 1) I added a CityGML writer 2) I imported the CityGML feature type ReliefFeature 3) I checked all the available attributes (user and format) but no "lod" available. 4) I added my own user attribute lod (I tried different types, I suppose this should be xml_int16, but I also tried others...) 5) I gave it a constant value "2" the translation is succesfull, I see all the features, feature types, ... I want to see, but no attribute "lod" for the ReliefFeature :( afterwards, I added manually the tags to my CityGML file <dem:lod>2</dem:lod>. but offcourse, I want FME to do this for me :) hope someone can help me out! with kind regards, Ine De Cubber
'The domain '####' specified on the DEF line already exists in the geodatabase workspace, but with a different definition. The definition of the existing domain will be used' So what exactly does this mean? Where can I see the DEF line? Anyone else see this? -Sean
Afternoon All, i have a ESRI file gdb with 20 featureclasses within it. i want to change the value -99 to Blank within all the attributes and all the tables. LIke a global value mapper. Is there any simple solution im missing ? Thanks Steve
Hi, I'm experiencing an issue when attmepting to update an ArcSDE single merged feature type reader to pick up a new attribute added to one of the input tables. When right clicking on the reader and using the "Update..." option, FME will only pickup the attributes from the first feature class in the Table List, and ignore the attributes on the other 19 feature classes. Is there a way to update the reader without having to remove it completely and add it again?
Looking for optimal way to compute moving average on an attribute, based on a definable amount of freq of features. Any ideas on how to do this without writing a script?
Hi, my problem is that simple dgn->imageraterizer->geotiff is very slow .picture is big 10kmx10km with 0.13cell size (0.13995 m/pxl?) 82500x85000 pixels. Is there any way to get it faster than 3days and counting? My target is to get 0.13399 m/pxl tiff out from it
Hi, I have a FME Server 2012 installed on a virtual machine. When accessing the user and admin interface from my machine everything is ok. When accessing the user and admin interface directly on the VM these are just partially visible/usable, eg: - User interface: I can browse to a file and select it, but the "upload files" button stays grey and not usable. - Admin interface: I can only see the info in the admin home tab. All other tabs are there but clicking them shows nothing, only the page header (tabs, FME logo,...) Any ideas on this? I would think it is about VM settings somewhere but I have no clue where to start looking... thx, Rob
Hi, I ahve a query regarding writing out coordinates to a csv file. Been pulling my hair out trying to sort it for the last while but can't figure it out. I reckon i'm either missing something stupidly small or it just can't be done! Basically my simple workspace is reading in a .tab file, using the CoordinateConcantenator to retrieve each feature's coordinates and then using an AttributeSplitter to split the coordinate values into sperate list attributes. When I write it to a csv file the first Row contains the attributes of the first feature, second row containing the attributes of the second feature and so on... What I want to do it have the first Column of the csv containing the first feature, second column containing the attributes of the second feature etc, so basically flipping the layout of the csv file. Any suggestions greatly appreciated! Cheers, TK