Using readers and writers to extract and load data.
Recently active
Hi, I'm using the validate Output File option on the GML writer in application schema mode. i can see in my workbench log the number of fatal errors, errors and warnings it finds. But it doesn't fail the translation when it detects errors. How can I configure it to fail when validation finds errors? I'm testing in FME desktop and this workbench will be deployed to FME Server in production. example messages in log: <GML_1 Writer> - Setting external schema location for validation 'D:\\temp\\GML_Validation/myschema.xsd' XML Validation: Error in 'D:\\temp\\GML_Validation\\output.gml' on line 11, column 40: 'value '1.11' does not match regular expression facet '[+\\-]?[0-9]+'' <GML_1 Writer> - Found '0' fatal error(s), '1' error(s), and '0' warning(s) while validating dataset 'D:\\temp\\GML_Validation\\output.gml' Translation was SUCCESSFUL with 3 warning(s) (2 feature(s) output)
Hello, I want to create a SHAPE or KML from Oracle spatial table. I can do that by using FEATUREREADER (FME Desktop 2014). But I need table name to be passed as parameter, as every time I have diff table, to workbench. Since we can't pass table name to FEATUREREADER. How can I create SHAPE from oracle spatial table. Cheers, John
Hi, I write many Data from an ESRI enterprise Geodatabase to a PostGIS Database. All this data are copied by only one fme workbench. This means FME reads and writes the schema dinamically. So far so god. The Input Data has datefields wich are written to PostGIS as fileds in the format timestamp (2015-02-16 00:00:00). How can I tell FME that a datefield in PostGIS has to be created as date (2015-02-16) and not as timestamp (2015-02-16 00:00:00)? Thank's a lot Roman
Hi, so, is there a way to round parameters of tfw file (e.g. 6 decimal places) while writing a tiff file. I'm having a problem since FME changes the last (10th) decimal place of tfw file. And I'm using no transformers whatsoever. PS. The resolution of original tiff is 0.2 and the last decimal of output tiff is 4. Does this have any correlation or is it just coincidence?
Hi All, I have a workbench that I'm calling with a WorkbenchRunner. I want to be able to set the output filename (it's a CSV writer) dynamically, based on a parameter. There will be one unchanging filename per run of the workbench. But I do not want to use a Fanout because it caches results to RAM/disk and sorts them before writing at the very end. This is a problem because the datasets I'm processing are too large to want to do that, and as noted, there's no need as there's only one filename. Is there a way to do this? Maybe with Python? (I've already put in a request for a "features are ordered by group" option on the fanout, which would solve this problem) Thanks, Jonathan
I have three Oracle feature readers in my workspace, one each for dev, qa, and prod. Each Oracle database has a different password. I want to make a parameter so that the user chooses which feature reader to read from. I don't want the workspace to read from all three feature readers because the tables in each feature reader are very large. Two of the feature readers should be disabled each time that I run the workspace, based on the user's choice. I know that you can dynamically choose feature classes, but can you dynamically enable and disable feature readers as I want to do? Thanks
good night I wonder if there is any way to read the Features dataset within the GDB, it must have several features dataset created, with an unusual attribute. VEC01 to rivers. I want to add all VEC01 in a single line shapefile generating a rivers mosaic.
I am reading data form an Oracle database and writing it to an ESRI File Geodatabase. It works fine until I try to use the fanout feature. I get this error: Geodatabase Error (-2147219115): The row contains a bad value. FileGDB Writer: A feature could not be written It doesn't matter whether I use the fanout at the writer level or at the feature type level, I still get the same error. The data in the fanout field is a simple numerical version of the current date (20150209). There are no spaces in the field. I have tried changing the geodatabase overwrite settings, the name of the geodatabase, and creating a completely blank geodatabase. So far, nothing works. If there is another way to apend the current date to the feature type name in the writer, I would love to hear about it. Thanks!
I am reading an Excel spreadsheet into my FME workbench. The spreadsheet has 7 worksheets, each of which had various fields including x and y co-ordinate fields (for use with British National Grid). My Excel reader works fine for almost every feature. I have told it that the x and y fields are xy co-ordinates and it reads in all the rows (several hundred for each worksheet) except for the last one in each worksheet. Every time I get an error that says, "XLSX Reader: Read invalid value coordinate values, x-coordinate '', y-coordinate '' on row '357'. Values should be numeric. Point geometry will not be created" The Reader then ignores that row and doesn't read it in at all! The Excel spreadsheet is itself the product of another FME workbench and the xy attributes are specified to come out as numbers, so there shouldn't be any difference in the format of the final row. Does anyone have any hypotheses about why this is happening? I
Hi, I have a bulk of shapefiles and I just want to get the output name same as the input name. How can we do that in FME2015 (:
I have a workspace where I read a database, do some QA/QC and then write a text file that contains all the results of the QA/QC. Currently that text file is writen to the local C dirve of the computer where the workspace is run. I would like to write this file to the root folder where the database is read from but I am having trouble figuring out how to do that. Any suggestions are greatly appreciated.
Hi, I encounter a problem that might be a bug with FME 2015. In my workspace I have aa python caller that use a custom python27 dll that was workinig without any problem a lot of times before. Since I enabled the dynamic properties on a writer feature type, the python fails with that error message: |Python Exception <WindowsError>: [Error 127] The specified procedure could not be found If I uncheck the dynamic properties in the writer feature type, the pythonCaller process without error. Should I report as a bug or there might be an explanation for this problem?
Hi there, I've got polygons in shape format, some of which have holes, that I'm trying to translate into smallworld. The polygons with holes got translated without any holes into smallworld. When trying to write into smallworld, I hAve added "DonutBuilder" transformer bewtween the source and the target. Can any one please me regarding this translate the ploygons with holes into smallworld. Thanks, Seshu
How can I read a WFS service on a https url ? any fmw example?
i would like know what can i do to pass dwg files to small world. i have a trench in small wolrd and i could know what can i do to pass some elements define in CAD inside trench. i know that these elements would have the same inicial and finish point that trench. but i don´t know what can i do to put these elements inside the trench, thanks for all.
Hello, I want to create a shapefile from a view in Oracle Spatial. View is created by another application by querying number of table. So schema of the view changes every time. I am able to create shapefile first time but once schema changes I am not able to create. What should I need to do to handle this dynamic schema. Cheers
Hi All, I want to place the data in specific column+row like D3, C5, F8... I have mapped the column and row to attributes where I want for each record. I'm able to place to the data in required ROW with the help of "xlsx_row_id" and Writer mode to "Update Cell Contents". Could any one please guide me how to add the column number to Excel (writer)... I have atatched the output in inspector for reference... I want to place value of CNT in respective cell Pratap
Hello, I would like to create a shapefile from geometry in oracle table and attributes are stored in CSV. To explain further, I have 2 tables in oracle spatial e.g. STATES & ZIP with columns like ID, geometry. I would like to create a workbench which will accept ID as parameter and some additional attributes in csv and FME will query STATES or ZIP table to get geometry and create a SHAPE file with additional attribute data from csv. For this I have created a workbench with input params : ID READER : CSV e.g. CSV contains something like this ID,NAME,POPULATION,X,Y,Z 1,ANYNAME,100000,ABC,DEF,PQR FEATUREREADER : to read oracle geometry (currently ueing only one table not sure how to pass tablename ZIP or STATE) All CSVs will have ID in header plus other headers which may change e.g. CSV headers may vary from 5 to 20. WRITER : SHAPE(should create tab shape file with whatever attributes in CSV) But I am not sure how can I append attributes from CSV to SHAPE? Is there any other way
How to assign elevation variation from Lidar to shapefile / drap elevation on feature line. Line (ShapeFile) Lidar (.XYZ) I would like to have Z on the shapefile but split featureline when i have a difference (like 5m on Z) or simply put a Begining Z or End Z. I would like to produce 3D feature and have the profile from this.
Is it possible for the ArcSDEQuerier transformer in FME2014 to access data in an SDE "Child Geodatabase", otherwise known as a "schema-owned geodatabase" in official ESRI terms? The SDE is 10.2.0 on an 11g Oracle database and I ahve ArcGIS Desktop 10.2.2 installed on the machine I'm running FME 2014 from. I need to access GIS layers in this child geodatabase and filter them my a study area feature in my workspace. On the transormer there is nowhere to pick the child geodatabase. I have found this to be an issue on the ArcSDE30 reader as well. In order to read data from the child geodatabase I've had to create an sde connection file that points to the child geodatabase and then use the ArcSDE Geodatabase reader instead and point it to the SDE connection file. I can't do the same workaround on the ArcSDE querier. I could just do a spatialfilter tranformer in the workspace, but I want to avoid reading every feature off the SDE layer when there are mil
Is it possible to control the order of worksheets when writing to Excel? I have four worksheets: - page_1 - page_2 - page_3 - page_4 But the Excel document that gets generated has the order: - page_2 - page_1 - page_3 - page_4 Thanks
Hi! Im trying to open a CSW file, but it doesnt seem to be georeferenced correctly. It also comes with a mapinfo .tab file containing the referenced gpc points. It views fine in mapinfo. But opening the ECW in FME inspector/workbench show the coordinates as column/row and not my coordinate system, even though its set and I choosed to apply GCPs on reader properties. Using the RasterGCPExtractor give the following, which look good. 877 4705 93564.351 6224685.68 0;1633 4938 95497.304 6224058.249 0;3085 4617 99250.548 6224831.501 0;5541 1594 105637.368 6232546.944 0;5426 4554 105260.034 6224927.972 0;6210 4883 107279.391 6224071.996 0;5704 6159 105934.53 6220807.966 0;7168 7610 109679.126 6217034.355 0;8234 9617 112387.978 6211868.788 0;7190 11488 109633.351 6207098.583 0;7490 12392 110406.882 6204782.222 0;6614 12247 108151.826 6205172.54 0;6195 11625 107079.892 6206767.879 0 I also tried manually setting the corners with RasterGCPSetter without any success, it stays at the pixel-coord
Hi there. Constructing a workspace, but I need the user to choose a field from the source (of which the field names may vary), which is used later. I've started using a schema reader and was thinking it would have to be some sort of published variable. Any ideas?
How do I transfer primary and foreign key relationships during the translation of database tables from oracle to sql server?
I want to create a bounding box from grouped points (by permit number). I used the BoundingBoxAccumulator and in the inspector it comes out great except that it also is writing out the points! When I try to save this into the SDE as a polygon feature class, it fails and says that it doesn't accept multiple types of geometry... I also want to save out the points as well =, so how do I seperate out the points and lines into 2 seperate feature classes (appending existing). Origionally, In ArcToolbox, the tool I used was "Minimum Bounding Geometry", if that helps....