Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,825 Posts
25,143 Replies

When you subscribe we will email you when there is a new topic in this category

6825 Posts

How can I read Microstation DGN tags?

I am trying to read a number of Microstation DGN (v8) files with tags into a number of ESRI shapefile attributes. I found that selecting a Group Elements by "Schema - Level Names" option from within the DGN V8 Reader Parameters works for a single DGN. It exposes tag values in User Attributes on the DGN Reader. However, I found that I cannot develop a single workbench to handle multiple DGNs with different set of tags (i.e. attributes), as the User Attributes are different for every DGN with different tags. For example, if I used an AttributeCreator and assign tag values to attributes, it would work for one DGN, but the parameters would be invalid for a DGN with different set of tags, i.e. other user attributes. How is it possible to read DGN v8 tags dynamically, i.e. so that they are read dynamically for every DGN and I can work with the tag values as attributes? I am a new user and would appreciate a step by step guide if possible.

A

Anonymous

Polygon from Point Cloud

I have some classfied Lidar and would like to generate 2D building footprints from them. I used a point cloud filter to separate the points with building classification and then used GeometryCoercer to turn them into points. I now have point cloud and points that look like buildings in the Data Inspector as shown: Point Cloud with building classification Points created by GeometryCoercer I'm not clear where to go from here. Buffer by certain amount? Is there a best transformer here? Thanks

A

Hi All, I am trying to create a PDF on which a title block in the bottom right hand corner is all ways visable for quaility control. i have had a look at a few examples and most people seem to do it by having a vewport within the PDF and zooming in/out from within the viewport and having the title block as a static element on the PDF is there a way i can creat a viewport for the PDF within FME or if you can think of a more effective way that FME could handle this?? thanks, in advance

fmelizardContributor

Accessing FME Cloud resources files

Hi, I would like to know if anybody has any experience on how to access files on an FMECloud instance. To clarify a bit, I have a xls file in a folder in the resources section that I would like to access in mid-translation via FME desktop. The idea is to verify details that are on the xls file before continuing with the translation. I was thinking on using the HTTPCaller, but couldnt access the resources section on the instance. Any tips would be appreciated. Itay

fmelizardContributor

Triple zipped XML

Hi ppl, My input are XML files that are triple zipped (zip in a zip in a zip) I know I can read from a zip file, but is there anyway to read from a triple zipped input? If not does anybody have a tip on how to handle such a situation? ( any python/ tcl savy's advice?) Cheers, Itay

Performance Issues with extracting a large number of points from 1m LIDAR

Hello, I am having some more performance issues with the workflow displayed below, basically my inputs are ~11 TB 1m Lidar Surface~500,000 - 3,000,000 points and goal is to extract elevation values using average 4 of average 16. Original, I just had the LIDAR reader directly connected to the PointonRasterExtractor but that caused memory issues I have taken these steps so far Added a bounding AccumlatorDissolver into 1 featureClipper to extract only the areas of LIDAR I needThan extracted the points I am open to any other solutions anyone might have to increase the performance

MapnikRasterizer and text

Hi All, I'm trying something that should be super-easy but it's simply not playing ball. I have a creator that creates a single point (X:500, Y:-500 for example). I feed that point into the MapnikRasterizer (MR) transformer, changing it to "Text" symboliser. I set a massive size to the raster (1000*1000), and "Use input data ground extents". But 9 times out of 10, there is no text anywhere on the raster. On the 1/10 times that I've had text, it hasn't been near the point, instead using the top-left as its anchor. I've tried just about every possible combination of settings I can think of, all to little avail. I've also looked at the examples Mark Ireland created for his blog post - those work, but when I try and copy the values to my data... it fails. So, incredibly simple question: How do you use MR to create text on a point? Thanks, Jonathan (Surprisingly few questions about the MapnikRasterizer transformer on here.)

gml writer validation - how to fail a translation

Hi, I'm using the validate Output File option on the GML writer in application schema mode. i can see in my workbench log the number of fatal errors, errors and warnings it finds. But it doesn't fail the translation when it detects errors. How can I configure it to fail when validation finds errors? I'm testing in FME desktop and this workbench will be deployed to FME Server in production. example messages in log: <GML_1 Writer> - Setting external schema location for validation 'D:\\temp\\GML_Validation/myschema.xsd' XML Validation: Error in 'D:\\temp\\GML_Validation\\output.gml' on line 11, column 40: 'value '1.11' does not match regular expression facet '[+\\-]?[0-9]+'' <GML_1 Writer> - Found '0' fatal error(s), '1' error(s), and '0' warning(s) while validating dataset 'D:\\temp\\GML_Validation\\output.gml' Translation was SUCCESSFUL with 3 warning(s) (2 feature(s) output)

Oracle Spatial to SHAPE

Hello, I want to create a SHAPE or KML from Oracle spatial table. I can do that by using FEATUREREADER (FME Desktop 2014). But I need table name to be passed as parameter, as every time I have diff table, to workbench. Since we can't pass table name to FEATUREREADER. How can I create SHAPE from oracle spatial table. Cheers, John

Default date format for writing to PostGIS

Hi, I write many Data from an ESRI enterprise Geodatabase to a PostGIS Database. All this data are copied by only one fme workbench. This means FME reads and writes the schema dinamically. So far so god. The Input Data has datefields wich are written to PostGIS as fileds in the format timestamp (2015-02-16 00:00:00). How can I tell FME that a datefield in PostGIS has to be created as date (2015-02-16) and not as timestamp (2015-02-16 00:00:00)? Thank's a lot Roman

zzupljaninContributor

Is there a way to round parameters of tfw file

Hi, so, is there a way to round parameters of tfw file (e.g. 6 decimal places) while writing a tiff file. I'm having a problem since FME changes the last (10th) decimal place of tfw file. And I'm using no transformers whatsoever. PS. The resolution of original tiff is 0.2 and the last decimal of output tiff is 4. Does this have any correlation or is it just coincidence?

Set writer feature type name dynamically (no fanout)

Hi All, I have a workbench that I'm calling with a WorkbenchRunner. I want to be able to set the output filename (it's a CSV writer) dynamically, based on a parameter. There will be one unchanging filename per run of the workbench. But I do not want to use a Fanout because it caches results to RAM/disk and sorts them before writing at the very end. This is a problem because the datasets I'm processing are too large to want to do that, and as noted, there's no need as there's only one filename. Is there a way to do this? Maybe with Python? (I've already put in a request for a "features are ordered by group" option on the fanout, which would solve this problem) Thanks, Jonathan

A

Anonymous

Enable and Disable Feature Readers

I have three Oracle feature readers in my workspace, one each for dev, qa, and prod. Each Oracle database has a different password. I want to make a parameter so that the user chooses which feature reader to read from. I don't want the workspace to read from all three feature readers because the tables in each feature reader are very large. Two of the feature readers should be disabled each time that I run the workspace, based on the user's choice. I know that you can dynamically choose feature classes, but can you dynamically enable and disable feature readers as I want to do? Thanks

GDB to Shapefile Mosaic

good night I wonder if there is any way to read the Features dataset within the GDB, it must have several features dataset created, with an unusual attribute. VEC01 to rivers. I want to add all VEC01 in a single line shapefile generating a rivers mosaic.

Geodatabase error (-2147219115) when using fanout

I am reading data form an Oracle database and writing it to an ESRI File Geodatabase. It works fine until I try to use the fanout feature. I get this error: Geodatabase Error (-2147219115): The row contains a bad value. FileGDB Writer: A feature could not be written It doesn't matter whether I use the fanout at the writer level or at the feature type level, I still get the same error. The data in the fanout field is a simple numerical version of the current date (20150209). There are no spaces in the field. I have tried changing the geodatabase overwrite settings, the name of the geodatabase, and creating a completely blank geodatabase. So far, nothing works. If there is another way to apend the current date to the feature type name in the writer, I would love to hear about it. Thanks!

Why does Excel Reader keep failing to read final row in worksheet?

I am reading an Excel spreadsheet into my FME workbench. The spreadsheet has 7 worksheets, each of which had various fields including x and y co-ordinate fields (for use with British National Grid). My Excel reader works fine for almost every feature. I have told it that the x and y fields are xy co-ordinates and it reads in all the rows (several hundred for each worksheet) except for the last one in each worksheet. Every time I get an error that says, "XLSX Reader: Read invalid value coordinate values, x-coordinate '', y-coordinate '' on row '357'. Values should be numeric. Point geometry will not be created" The Reader then ignores that row and doesn't read it in at all! The Excel spreadsheet is itself the product of another FME workbench and the xy attributes are specified to come out as numbers, so there shouldn't be any difference in the format of the final row. Does anyone have any hypotheses about why this is happening? I

writer name same as reader name

Hi, I have a bulk of shapefiles and I just want to get the output name same as the input name. How can we do that in FME2015 (:

Set file path for text file writer

I have a workspace where I read a database, do some QA/QC and then write a text file that contains all the results of the QA/QC. Currently that text file is writen to the local C dirve of the computer where the workspace is run. I would like to write this file to the root folder where the database is read from but I am having trouble figuring out how to do that. Any suggestions are greatly appreciated.

pythonCaller fails when writer feature type use dynamic properties

Hi, I encounter a problem that might be a bug with FME 2015. In my workspace I have aa python caller that use a custom python27 dll that was workinig without any problem a lot of times before. Since I enabled the dynamic properties on a writer feature type, the python fails with that error message: |Python Exception <WindowsError>: [Error 127] The specified procedure could not be found If I uncheck the dynamic properties in the writer feature type, the pythonCaller process without error. Should I report as a bug or there might be an explanation for this problem?

Issue in translating polygons with holes into Smallworld

Hi there, I've got polygons in shape format, some of which have holes, that I'm trying to translate into smallworld. The polygons with holes got translated without any holes into smallworld. When trying to write into smallworld, I hAve added "DonutBuilder" transformer bewtween the source and the target. Can any one please me regarding this translate the ploygons with holes into smallworld. Thanks, Seshu

francis_mContributor

read wfs from arcgis server https

How can I read a WFS service on a https url ? any fmw example?

fer_ruizContributor

small world - inside world (CAD to SW)

i would like know what can i do to pass dwg files to small world. i have a trench in small wolrd and i could know what can i do to pass some elements define in CAD inside trench. i know that these elements would have the same inicial and finish point that trench. but i don´t know what can i do to put these elements inside the trench, thanks for all.

Oracle Sptial Object Reader

Hello, I want to create a shapefile from a view in Oracle Spatial. View is created by another application by querying number of table. So schema of the view changes every time. I am able to create shapefile first time but once schema changes I am not able to create. What should I need to do to handle this dynamic schema. Cheers

pratapContributor

Data to Specific COLUMN+ROW in Excel

Hi All, I want to place the data in specific column+row like D3, C5, F8... I have mapped the column and row to attributes where I want for each record. I'm able to place to the data in required ROW with the help of "xlsx_row_id" and Writer mode to "Update Cell Contents". Could any one please guide me how to add the column number to Excel (writer)... I have atatched the output in inspector for reference... I want to place value of CNT in respective cell Pratap

Append attributes to SHAPEFILE

Hello, I would like to create a shapefile from geometry in oracle table and attributes are stored in CSV. To explain further, I have 2 tables in oracle spatial e.g. STATES & ZIP with columns like ID, geometry. I would like to create a workbench which will accept ID as parameter and some additional attributes in csv and FME will query STATES or ZIP table to get geometry and create a SHAPE file with additional attribute data from csv. For this I have created a workbench with input params : ID READER : CSV e.g. CSV contains something like this ID,NAME,POPULATION,X,Y,Z 1,ANYNAME,100000,ABC,DEF,PQR FEATUREREADER : to read oracle geometry (currently ueing only one table not sure how to pass tablename ZIP or STATE) All CSVs will have ID in header plus other headers which may change e.g. CSV headers may vary from 5 to 20. WRITER : SHAPE(should create tab shape file with whatever attributes in CSV) But I am not sure how can I append attributes from CSV to SHAPE? Is there any other way

1
...
237
238
239
240
241
242
243
...
273

Page 240 / 273

Badge winners

shweta13has earned the badge Integrate Data with the FME Platform Training
guihas earned the badge Welcome Back
evoteckhas earned the badge Webinar Watcher (Grey)
thogerb_cmpashas earned the badge Integrate Data with the FME Platform Training
rspears90has earned the badge Integrate Spatial Data

Show all badges

30,461: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.