Using readers and writers to extract and load data.
Recently active
Hi all, Is there a way to create a list of valid drive letters for the user to select as a published parameter? That is on computer 1, the user could select from (C:, D:, F:) whereas computer 2 could have the options (C:, D:, R:, Z:). Using python I can get the list of available drives, but I can't figure out how to parse that into the equivalent of a choice, nor can I figure out how to limit the folder (existing) type to just the drive. Any thoughts?
I am trying to read a number of Microstation DGN (v8) files with tags into a number of ESRI shapefile attributes. I found that selecting a Group Elements by "Schema - Level Names" option from within the DGN V8 Reader Parameters works for a single DGN. It exposes tag values in User Attributes on the DGN Reader. However, I found that I cannot develop a single workbench to handle multiple DGNs with different set of tags (i.e. attributes), as the User Attributes are different for every DGN with different tags. For example, if I used an AttributeCreator and assign tag values to attributes, it would work for one DGN, but the parameters would be invalid for a DGN with different set of tags, i.e. other user attributes. How is it possible to read DGN v8 tags dynamically, i.e. so that they are read dynamically for every DGN and I can work with the tag values as attributes? I am a new user and would appreciate a step by step guide if possible.
I have some classfied Lidar and would like to generate 2D building footprints from them. I used a point cloud filter to separate the points with building classification and then used GeometryCoercer to turn them into points. I now have point cloud and points that look like buildings in the Data Inspector as shown: Point Cloud with building classification Points created by GeometryCoercer I'm not clear where to go from here. Buffer by certain amount? Is there a best transformer here? Thanks
Hi All, I am trying to create a PDF on which a title block in the bottom right hand corner is all ways visable for quaility control. i have had a look at a few examples and most people seem to do it by having a vewport within the PDF and zooming in/out from within the viewport and having the title block as a static element on the PDF is there a way i can creat a viewport for the PDF within FME or if you can think of a more effective way that FME could handle this?? thanks, in advance
Hi, I would like to know if anybody has any experience on how to access files on an FMECloud instance. To clarify a bit, I have a xls file in a folder in the resources section that I would like to access in mid-translation via FME desktop. The idea is to verify details that are on the xls file before continuing with the translation. I was thinking on using the HTTPCaller, but couldnt access the resources section on the instance. Any tips would be appreciated. Itay
Hi ppl, My input are XML files that are triple zipped (zip in a zip in a zip) I know I can read from a zip file, but is there anyway to read from a triple zipped input? If not does anybody have a tip on how to handle such a situation? ( any python/ tcl savy's advice?) Cheers, Itay
Hello, I am having some more performance issues with the workflow displayed below, basically my inputs are ~11 TB 1m Lidar Surface~500,000 - 3,000,000 points and goal is to extract elevation values using average 4 of average 16. Original, I just had the LIDAR reader directly connected to the PointonRasterExtractor but that caused memory issues I have taken these steps so far Added a bounding AccumlatorDissolver into 1 featureClipper to extract only the areas of LIDAR I needThan extracted the points I am open to any other solutions anyone might have to increase the performance
Hi All, I'm trying something that should be super-easy but it's simply not playing ball. I have a creator that creates a single point (X:500, Y:-500 for example). I feed that point into the MapnikRasterizer (MR) transformer, changing it to "Text" symboliser. I set a massive size to the raster (1000*1000), and "Use input data ground extents". But 9 times out of 10, there is no text anywhere on the raster. On the 1/10 times that I've had text, it hasn't been near the point, instead using the top-left as its anchor. I've tried just about every possible combination of settings I can think of, all to little avail. I've also looked at the examples Mark Ireland created for his blog post - those work, but when I try and copy the values to my data... it fails. So, incredibly simple question: How do you use MR to create text on a point? Thanks, Jonathan (Surprisingly few questions about the MapnikRasterizer transformer on here.)
Hi, I'm using the validate Output File option on the GML writer in application schema mode. i can see in my workbench log the number of fatal errors, errors and warnings it finds. But it doesn't fail the translation when it detects errors. How can I configure it to fail when validation finds errors? I'm testing in FME desktop and this workbench will be deployed to FME Server in production. example messages in log: <GML_1 Writer> - Setting external schema location for validation 'D:\\temp\\GML_Validation/myschema.xsd' XML Validation: Error in 'D:\\temp\\GML_Validation\\output.gml' on line 11, column 40: 'value '1.11' does not match regular expression facet '[+\\-]?[0-9]+'' <GML_1 Writer> - Found '0' fatal error(s), '1' error(s), and '0' warning(s) while validating dataset 'D:\\temp\\GML_Validation\\output.gml' Translation was SUCCESSFUL with 3 warning(s) (2 feature(s) output)
Hello, I want to create a SHAPE or KML from Oracle spatial table. I can do that by using FEATUREREADER (FME Desktop 2014). But I need table name to be passed as parameter, as every time I have diff table, to workbench. Since we can't pass table name to FEATUREREADER. How can I create SHAPE from oracle spatial table. Cheers, John
Hi, I write many Data from an ESRI enterprise Geodatabase to a PostGIS Database. All this data are copied by only one fme workbench. This means FME reads and writes the schema dinamically. So far so god. The Input Data has datefields wich are written to PostGIS as fileds in the format timestamp (2015-02-16 00:00:00). How can I tell FME that a datefield in PostGIS has to be created as date (2015-02-16) and not as timestamp (2015-02-16 00:00:00)? Thank's a lot Roman
Hi, so, is there a way to round parameters of tfw file (e.g. 6 decimal places) while writing a tiff file. I'm having a problem since FME changes the last (10th) decimal place of tfw file. And I'm using no transformers whatsoever. PS. The resolution of original tiff is 0.2 and the last decimal of output tiff is 4. Does this have any correlation or is it just coincidence?
Hi All, I have a workbench that I'm calling with a WorkbenchRunner. I want to be able to set the output filename (it's a CSV writer) dynamically, based on a parameter. There will be one unchanging filename per run of the workbench. But I do not want to use a Fanout because it caches results to RAM/disk and sorts them before writing at the very end. This is a problem because the datasets I'm processing are too large to want to do that, and as noted, there's no need as there's only one filename. Is there a way to do this? Maybe with Python? (I've already put in a request for a "features are ordered by group" option on the fanout, which would solve this problem) Thanks, Jonathan
I have three Oracle feature readers in my workspace, one each for dev, qa, and prod. Each Oracle database has a different password. I want to make a parameter so that the user chooses which feature reader to read from. I don't want the workspace to read from all three feature readers because the tables in each feature reader are very large. Two of the feature readers should be disabled each time that I run the workspace, based on the user's choice. I know that you can dynamically choose feature classes, but can you dynamically enable and disable feature readers as I want to do? Thanks
good night I wonder if there is any way to read the Features dataset within the GDB, it must have several features dataset created, with an unusual attribute. VEC01 to rivers. I want to add all VEC01 in a single line shapefile generating a rivers mosaic.
I am reading data form an Oracle database and writing it to an ESRI File Geodatabase. It works fine until I try to use the fanout feature. I get this error: Geodatabase Error (-2147219115): The row contains a bad value. FileGDB Writer: A feature could not be written It doesn't matter whether I use the fanout at the writer level or at the feature type level, I still get the same error. The data in the fanout field is a simple numerical version of the current date (20150209). There are no spaces in the field. I have tried changing the geodatabase overwrite settings, the name of the geodatabase, and creating a completely blank geodatabase. So far, nothing works. If there is another way to apend the current date to the feature type name in the writer, I would love to hear about it. Thanks!
I am reading an Excel spreadsheet into my FME workbench. The spreadsheet has 7 worksheets, each of which had various fields including x and y co-ordinate fields (for use with British National Grid). My Excel reader works fine for almost every feature. I have told it that the x and y fields are xy co-ordinates and it reads in all the rows (several hundred for each worksheet) except for the last one in each worksheet. Every time I get an error that says, "XLSX Reader: Read invalid value coordinate values, x-coordinate '', y-coordinate '' on row '357'. Values should be numeric. Point geometry will not be created" The Reader then ignores that row and doesn't read it in at all! The Excel spreadsheet is itself the product of another FME workbench and the xy attributes are specified to come out as numbers, so there shouldn't be any difference in the format of the final row. Does anyone have any hypotheses about why this is happening? I
Hi, I have a bulk of shapefiles and I just want to get the output name same as the input name. How can we do that in FME2015 (:
I have a workspace where I read a database, do some QA/QC and then write a text file that contains all the results of the QA/QC. Currently that text file is writen to the local C dirve of the computer where the workspace is run. I would like to write this file to the root folder where the database is read from but I am having trouble figuring out how to do that. Any suggestions are greatly appreciated.
Hi, I encounter a problem that might be a bug with FME 2015. In my workspace I have aa python caller that use a custom python27 dll that was workinig without any problem a lot of times before. Since I enabled the dynamic properties on a writer feature type, the python fails with that error message: |Python Exception <WindowsError>: [Error 127] The specified procedure could not be found If I uncheck the dynamic properties in the writer feature type, the pythonCaller process without error. Should I report as a bug or there might be an explanation for this problem?
Hi there, I've got polygons in shape format, some of which have holes, that I'm trying to translate into smallworld. The polygons with holes got translated without any holes into smallworld. When trying to write into smallworld, I hAve added "DonutBuilder" transformer bewtween the source and the target. Can any one please me regarding this translate the ploygons with holes into smallworld. Thanks, Seshu
How can I read a WFS service on a https url ? any fmw example?
i would like know what can i do to pass dwg files to small world. i have a trench in small wolrd and i could know what can i do to pass some elements define in CAD inside trench. i know that these elements would have the same inicial and finish point that trench. but i don´t know what can i do to put these elements inside the trench, thanks for all.
Hello, I want to create a shapefile from a view in Oracle Spatial. View is created by another application by querying number of table. So schema of the view changes every time. I am able to create shapefile first time but once schema changes I am not able to create. What should I need to do to handle this dynamic schema. Cheers
Hi All, I want to place the data in specific column+row like D3, C5, F8... I have mapped the column and row to attributes where I want for each record. I'm able to place to the data in required ROW with the help of "xlsx_row_id" and Writer mode to "Update Cell Contents". Could any one please guide me how to add the column number to Excel (writer)... I have atatched the output in inspector for reference... I want to place value of CNT in respective cell Pratap