Using readers and writers to extract and load data.
Recently active
Hi Guys, from a source .dgn file i read postal codes from TAGs into a destination .xls file. I want to fill these postal codes in the .xls file automatically in a Attribute filter and Attribute Creators should been created where an attribute is create which have this postal code. so when in the Excel file is an postal code 20000, i want to fil automatically a attribute filter which filter a named cell with 20000 and an attribute creator will be set after the filter where an attribute postal code is filled with 20000. Can I handle this in one workbench? Greetz and Cheers Franco
Dear FME experts, I’m getting quite desperate about a problem I still can’t solve. The input format is shape which contains areas. We use FME desktop (2013 SP1) to correct a great number of these geometries. The workbench contains AreaOnAreaOverlayers / Dissolvers etc. At the end we check the geometries with the GeometryValidator where we test all issues. 4 geometries are repaired. The output is shape again. Until here everything is fine. After this we use SPIT to load the shapes in PostGIS. Running isValid in PostGIS returns a lot of errors. Self intersections. Our workaround is to repair geometry in ArcGIS which solves the self intersections. (a lot of them!) Then we load the shape again in FME, run the feautures through the GeometryValidator with all checks. 16 geometries are getting repaired. Now we can successfully load the shapes in PostGIS. The isValid function returns nothing now. I would love to skip the repair geometry cycle in ArcGIS. My latest guess is i
Hey all. I wrote an FME Workbench file that reads data from two ArcSDE Geodatabase layers residing on an Oracle database, does some processing, and then writes the resultant output to a new ArcSDE Geodatabase layer on that Oracle database. When I run the Workbench file from my PC, it takes about one minute with no issues. I have published it to our FME Server and when I run the jobs, they never finish. I even let it run overnight earlier in the week and cancelled it the next morning, as it was still running 15 hours later. I have tried a number of things to identify where the issue is. If I disable the final link connecting to the writer transformer, the job completes and takes about 1 minute, just like on my PC. But the moment I enable the link to that writer, it goes back to never finishing. I also disabled all of the transformers and just connected the writer directly to one of the readers, and it finished successfully. This got me thinking that maybe the machine that is r
Hi, I'm working with (and constrained to) FME 2011. I'm using ArcSDE30 writer to load images into an ArcSDE 10.0 raster catalog which we then apply the arcGIS Server 10.1 temporal slider toolbar onto allowing us to animate a set of rainfall radar images. We're using FME to extract and load the images, which works fine. My problem is how can I get FME to delete those images that are know longer required? It appears that the arcsde raster catalog writer doesn't have the usual fme_db_operation capability which I was planning on using to send features to 'insert' or 'delete'. It does have a truncate option, but that doesn't appear to work either. Any Ideas? Incidentally, why doesn't the arcsde geodb writer handle rastercats? maybe it does in 2013? I haven't checked yet. (however ultimetely we're looking at deploying this on to server 2011, and it'll take us a while to upgrade from this server version - unfortunetaly)
I am trying to open the Manitoba Highway Conditions KML and getting an error: XML Parser error: 'Error in input dataset:'file:///C:/Users/lawiebe/AppData/Local/Temp/FME_OGCKML_KMZ_1363808830240_7172/Manitoba Highway Conditions.kml' line:1 column:425975 message:invalid byte 'l' at position 2 of a 2-byte sequence' At that location in the file there is a coordinate: -96.79388,50.18568,94 the 5 of ,50 is character 425975 in the file... doe not look like an invalid character, that is why I am wondering if there may be a line length limit? The KML opens in ArcGIS Desktop, Server and Google Earth. I have tried FMW Workbench, Universal Viewer, Data Inspector 2011,2012,2013 and all have the issue. The file can be accessed at: http://roaddata.gov.mb.ca/map/gearth/kmz/manitobahighwayconditions_e_kmz.kmz Thanks, Larry
I'm trying to put rasters into a local raster catalog. The writerer only gives me the option to write to a SDE raster catalog, any way to do this other then calling ArcPy?
Hello All. I would like to know if is possible to write geometries from MapInfo and AutoCAD to Oracle Locator and not Oracle Spatial. If yes, how can I do that? Thanks in Advance. Fernando Ferreira
Hello Just as info for those who may run into this. I had a customer complaint that ArcMap does not recognize the coordinate system from a GeoTiff file I created with FME. Well after lots of going here and there, trying out new GeoTiff writer options and the like the solution was very simple. ArcGIS 9.3.1 does not recognize the coordinate system in the GeoTiff ArcGIS 10.0 can read and use it without any problem. Michael
Hello Today I want to get rid of some repeated pain in workbench I'm going through, by telling it here. Thanks to steady development there are always added new options to writers. This by itself is very welcome. Right now I need to utilize a new option in GeoTiff writer which is labelled: "Write Esri-Compatible Coordinate System" (not documented in FME 2012 SP4 btw) What I have: I have a workspace which is used as a writer-adapter in the FUSION Data Service application we build on top of FME. Besides other such adapters used for all kinds of different formats, this one is specialized on Raster data handling. This writer-adapter contains 5 different writers (Tiff,GeoTiff,JPeg,JPEG2000,PNG). All of them are set up in a way so they use the same published parameters for as many settings as possible. These parameters then are used in the calling skript. Attribute fanout is used to control the resulting filename. Now my pain starts: 1) I cannot utilize new writer settin
I've got a CSV file that came from a flood modellnig package. I want to geocode and map the water levels at each point (calculation cell centroid) at a series of time slots. My problem is this: the file has 1 row for each time slot and 1 column for each calculation cell centroid (about 500,000 columns in all). When I created a CSV reader for this file FME 2013 just sat for hour after hour and never got as far as displaying the reader on my workbench. Presumably it couldn't cope with trying to generate the schema/list of attributes. Any ideas for processing this file? The only thing I can think of is writing a utility to transpose the file first. Thanks, Ian
Hi, I have a problem running an FME task (fmw) as an FME commandline scheduled task on Windows 2008 R2 (64bit). Background: 1. FME 32bit installed 2. Oracle Client 32 bit installed 3. Oracle client BIN folder n PATH 4. TNS_ADMIN environmental variable set to point to folder containing tnsnames.ora The problem: I created a scheduled task that runs fme.exe with my workbench file (fmw) as command line parameter. The task is set to use the SYSTEM account to run the task (this is because we cannot use a local or domain account as out policy doesn't allow password saving). When running the task in this configuration I get the "Oracle client libraries could not be loaded." error. When running exactly the same task using my user account it works. What works: 1. Running FME task via workbench. 2. Running the task via commandline (command prompt). 3. Running the scheduled task under my user account (when logged in). 4. As a sanity check I have
Looks like FMEServer 2013 does a Postgis query by default with the owner "public" before using the login specified in the fmw?? The error raised is causing me problems in my application NOTE: All my data is not in the public schema Log: Error executing SQL command ('select * from "public"."hafa_acoa_02_poly" limit 0'): 'ERROR: relation "public.hafa_acoa_02_poly" does not exist No spatial column was found for 'public.hafa_acoa_02_poly'. This is most likely a PostgreSQL table with no spatial data. No geometry will be read. If spatial data is not present, please try using the PostgreSQL reader instead PostGIS geometry type unknown or empty (). Setting PostGIS geometry to 'postgis_none' Error executing SQL command ('select * from "public"."hafa_acoa_02_poly" where false limit 0'): 'ERROR: relation "public.hafa_acoa_02_poly" does not exist SQL query on table 'public.ha
Hi, I adopted the example of a Catalog and Repository from: http://fmepedia.safe.com/articles/Samples_and_Demos/Integration-example-for-OGC-CSW-Data-Catalog-And-Repository-with-FME-Server to build a workbench that reads in files, guesses the format, gets, the bounds and dataset names and writes this metadata to an XML-Template and copies the original files to a definied directory. Works fine on my Computer and on our (windows-based) test server but fails to run on the Linux based Server of our partners. In order to identify the error, I have created a workbench that just copies the files. This runs well on the Linux server - so it isn't a permission problem. But as soon as I add the XML-templater the workbench will stop with an error on the Linux-based FME Server. Here is what the log says: 2013-03-09 22:48:52| 0.7| 0.0|INFORM|FME API version of module 'XMLTemplaterFactory' matches current internal version (3.7 20121025) 2013-03-09 22:48:52| 0.7| 0.0|WARN |XMLTemplater(XMLTem
Hi, another CityGML question! is there a possibility to write CityGML 2.0.0 already? I'm trying to model the buildings at LoD0, as lod0FootPrint, but this citygml_lod_name is not valid! "The 'lod20FootPrint' citygml_lod_name trait is invalid for 'Building' features, the geometry will be ignored, valid values are {lod1MultiSurface, lod1Solid, lod1TerrainIntersection, lod2MultiCurve, lod2MultiSurface, lod2Solid, lod2TerrainIntersection, lod3MultiCurve, lod3MultiSurface, lod3Solid, lod3TerrainIntersection, lod4MultiCurve, lod4MultiSurface, lod4Solid, lod4TerrainIntersection}." Can I add this possibility manually, or should I wait for a new (updated) cityGMLwriter? (next question I will ask, will be concerning the modelling of tunnels and bridges ;)) with kind regards, Ine De Cubber
Hi, For some reason the formats my workspace arent being recognised by the generic reader on FME Server. They are when I run it in desktop. Do I need to do something else on FME Server? Thanks, Owen
Hi there, I have a line feature class in an SDE database that changes daily. I need to compare this feature class with the newer shapefile and add the changes to the SDE feature class. Currently, I have a reader for the SDE feature class, a reader for the shape file, they go through the change detector transform, and then I have a writer to the same SDE feature class. However, the change detector is not detecting any duplicates, even when I test with the exact same file (so all output should be unchanged). This works correctly if I have two readers that are both shapefiles, or two readers that both read from an SDE feature class. Any ideas why it won't detect duplicates with a combination? Thank you.
I have 2 shapefiles (points). How can i copy the attributevalue from shape 1 to shape 2 if the points have the same geometry. Example if point A from shape 1 and point B from shape 2 have the same X,Y and i want to copy an attributevalue from point B point A
Hi, I am importing the shapefile from fme to smallworld, In my shape file i have 169 records but only 10 records are importing. In this process i am getting the error :: Error :Primitive a polygon.all_intersections failed status 1376267(0,21,11) Too many intersections How can i resolve this problem please help me and suggest me the solution as early as possible. Thanks in advance.
Hi ! Is there a way I can get my fanout result nested in a subdirectory in a KML/KMZ file ? Should be quite simple, but I just can't make it work. I have a MapInfo table with schools which I would like to separate in type of schools and by region. Type of schools, language and regions are held in columns in the MI table. Here is a sample of what I'm trying to achieve : Schools (document name) - Elementary (1st order subdirectory) - English (2nd order subdir) - Region 1 (3nd order subdir - that's where my fanout should be) - Region 2 - ... - French (2nd order subdir) - Region 1 (3nd order subdir - that's where my fanout should be) - Region 2 - ... Secondary - English (2nd order subdir) - Region 1 (3nd order subdir - that's where my fanout should be) - Region 2 - ... - French (2nd order subdir) - Region 1 (3nd order subdir - that's where my fanout should be) - Region 2 - ... University ... Every
I am trying to create ellipse features that are perpendicular to our drill hole trace (line feature). I have the centroid x, y, and z coordinates, the azimuth and dip data for each ellipse. I've only gotten to the point of creating the ellipsoid at the correct location but cannot seem to orient or rotate them accordingly. Does anyone have any advice? Thanks in advance.
Hello again, anyone know a quick solution for displaying an Autodesk 3DS-model of a tree for each point in an ESRI-point-shape? I will eventually merge it with a DEM an Orthophoto and 3D-buildings and write a 3d-PDF. Thanks for your considerations Patrick
I have a set of microsation v8 files. The files have a coordinate system attached to them. When I use FME to read in and output file to a different format (such as shape files), the readouts now show that everything has been shrunk to within fractions of a seconds of the origins of the file, instead of being in their true geographic location. Is there anyway to get FME to correctly read the coordinates so my output data is in the correct location?
I have a set of roads, where I have made the areas for road cover, and coded it with road-spesific metadata. So far so good - I can deal with manipulation. But I cannot properly write it without getting a metric ton of duplicate lines. I have run the data trough a topologybuilder before exportting, but to no avail. I used a different SOSI writer before (and guess I am forced to learn some of this stuff all over again) but want to cut some corners by asking: Does anyone have experience in writing to a SOSI-file that include polygons/areas?
I'm trying to import some MicroStation DGN data into an SDE Geodatabase (Oracle). My workflow is built specifically to preserve curved geometries, and when I write to a File Geodatabase, these are intact. However when I write to an SDE Geodatabse these are stroked into straight line segments. Looking at the logs I get the following warnings: WARN |Required columns 'GLOBAL_ID, OBJECTID, ' not specified for predefined table 'GISOWNER.TEST'. Using Definition from Database WARN |DEF line for the table 'GISOWNER.TEST' not fully specified. As a result, existing table definitions will be used WARN |Existing SDE table 'GISOWNER.TEST' allows the following shapes: SDE_NIL SDE_LINE SDE_SIMPLE_LINE SDE_MULTIPART . Shapes specified in mapping file for table allows: . Defined shape types don't match. WARN |Spatial column name for existing table 'GISOWNER.TEST' is 'SHAPE' while value specified in mapping file is ''. Usi
hello everyone I don't have good experience with FME, but i need to use it in my Master thesis project. The thing is i am developing an iPad App, one of the most important parts in this App is to send the GPS latitude, longitude to the GIS server (via FME) then get the GIS data related to that GPS location in a Wavefront obj file (in 3D) (ALSO via FME). So could you please provide me with any pointers to start. Any tutorials that explain this communication. I am using Objective c as the main programming language and also java for the servers. Many thanx for the help Cheers Saif ALSAIFI