Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 7,076 Posts
  • 26,068 Replies
7076 Posts
M
magdalena_n
asked in Data
Creating x- and y-label, WebCharter

Hi,  I wonder if someone know how to put axis-labels on your bar chart that's created with the WebCharter. Is it possible?  Is there ways to control the axes in a better way? My chart has the months on the x-axis, but the WebCharter automatically puts a zero instead of 1 where my data begins. Can I deside that the x-axis should be shown from 1 to 12?  Thank you!

230
david_r
Celebrity
P
paul21
asked in Data
Transferring Google Earth Images to Smallworld

What is the best way to bring Google Earth into Smallworld? I have been saving are capturing the image and spotting the 4 corners Lat-Longs to be used in configuration in Smallworld.  Thanks! Paul,

80
P
M
mfantin
asked in Data
Coordinates rounding issues: from GDB to SHP

Hi all,  is there a way to make sure that data from a shape file transfered to a gdb file using FME have the exact same coordinate values?  I happen to have to rounding happening in some features. This means that when I compare features from the shp and the gdb feature class, there will be some geometry discrepencies flagged up even though there should be.  I don't know when the rounding occurs (i.e. when it's written the first time to the gdb or when it's read the following time from the gdb)  Any idea? Anything I can set on the GDB writer or FeatureReader to make sure this doesn't happen?  Thanks in advance,  Maryse

380
david_r
Celebrity
A
alang
asked in Data
Fetch & Read OSM

This should be simple but I’m ready to throw up my hands.  I have a workspace that fetches an OpenStreetMap chunk of XML for a requested area.  I can save the data and then read the data using the FME OSM reader, a two-step process.    What I want to do is pass the OSM data it to the OSM reader in a single workspace.  I guess I could call the OSM fetcher in a startup Python script but that seems more convoluted than it should be.  Am I missing something obvious?  Thanks, Alan 

180
david_r
Celebrity
dustin
Influencer
dustinInfluencer
asked in Data
Logging input parameters to log file

I would like to log the parameters that the user inputs to the log file.  I realize that the information can be found throughout the log file, but I would like to have a list of the inputs in a central location.  At the moment, the user is taking a screenshot of the input screen for QC verification.  If QC could simply check the log file, the user wouldn't have to worry about screenshots.  What I've tried so far in the Startup TCL Script is:           FME_LogMessage fme_inform {FME_MacroValues(inputParameter)}  This was really just a stab in the dark, and didn't return what I was hoping for.

630
dustin
Influencer
A
anandak
asked in Data
Read 0..Many occurences of any element in FME.

I am reading one XML file. An element can have zero or multiple occurences. When I am reading one XML there are multiple occurences and after flattening the element it is recognized as a list in FME. e.g. VectorScaleRange.CompositeTypeStyle.CompositeRule{}  However When I am reading another XML (based on same XSD), there is only one occurence and after flattening the element it is recognized as an attribute in FME. e.g. VectorScaleRange.CompositeTypeStyle.CompositeRule.LegendLabel (CompositeRule element again contains some other elements e.g. LegendLabel  In case the element is non-existent, I am using TestFilter to check the condition if the attribute is present or not. How to check if the element occurs multiple times in the XML. ListElementCounter is not working, since if there is only one occurence it is not showing up as a list.  I am trying to create a custom transformer which should be able to read all occurences of data. Kindly suggest an approach.  Regards, Ananda

110
david_r
Celebrity
S
seesee
asked in Data
AUTOCAD .DWG to ESRI raster/symbols

Hi guys,   I am trying to migrate some .dwg file to ESRI raster/symbols.  1) when i use inspector on the .dwg reader, the colors for polygon or hatches are missing from the drawing.  May I know how resolve this?  2) How should i migrate .dwg file to geodatabase raster dataset or symbols?

90
fmelizard
Safer
D
dpavlicek
asked in Data
Writing compound polygon to Oracle

Hello, is there any way how to write compound polygon (lines + arcs) to Oracle with FME? When i try to write this kind of geometry i always get "ORA-13347 Description:the coordinates defining an arc are not distinct". But arcs seems fine to me (no redundant points, distance between them is larger than oracle tolerance).   FME 2013 (Build 13261 - WIN64) WIN 7 64bit Oracle 11gR2   Thanks for any advice, David  

1010
D
I
ian_mitchell
asked in Data
CSV Reader (in FME Server 2012 SP4)

Using the CSV reader. Encountering an extremely annoying problem ... the columns by default get named col0, col1 .. etc. up to col20 and are output in the same order which is fine EXCEPT that col9 is added at the end and not where it should be ... between col8 and col10.  Can't see how I can re-order.  Any ideas? Am I doing summat wrong.

180
ebygomm
Influencer
M
mike_gale
asked in Data
PostGIS to CAD Conversion - problems with autocad_text

Hi  I'm having problems translating POSTGIS text into Autocad_text. I have a project set up for originally converting GML to DWG and the process works fine. I am now changing the input to a postgis database and all layers work  fine except for the text translation.  I have the AutoCAD_entity set to: Autocad_text but I get the error message:  The following feature is not valid because its entity type of 'autocad text' and its  geometry type of 'IFMEPoint' do not match. The geometry failed to be converted to match the type, so the feature will be skipped.  Any help appreciated,  Mike

90
fmelizard
Safer
jaslee
Participant
jasleeParticipant
asked in Data
Is there MITAB Writer support for Korean Language?

Hi, I have a workflow which outputs MITAB in several languages: Arabic, Hebrew, Japanese  and Chinese Simplified. These come out fine when I check them in MapInfo using the Microsoft AppLocale tool.  Now I want to add Korean to the workflow but I can't find any option in the MITAB writer Character Encoding list for this language. Could anyone help confirm this is a limitation?  Thanks, Jason

80
jaslee
Participant
N
necroshine
asked in Data
Translating oracle dump into ESRI GDB,MDB

Hi dear forum users I want to transfer oracle dump features into one of the ESRI formats. I have a spatial Building table which have nearly 1.5m features inside.Here is the symptoms:   1) I am using Data interop extension on Arcmap 10. When i try them convert from ETL spatial tool; it waits too much when calculating intersections. Plus that; some of the string column records does not even loaded.   2) In order to see the string features i follow a way like that:    First i translate dump features into ArcInfo coverage. Then i create a feature class as the schema type in oracle and load all the data from coverage file. Is there a direct connection method?   3) quick export gives an error in the log file.  Thank you all.

100
N
S
seesee
asked in Data
Perfect Text to Annotation (Oracle Spatial DB to esri geodatabase)

Hi Guys,  My client currently uses autoCAD map and they store the data into oracle spatial DB.  My mission is to translate text to annotation.  Apparently autocad stores the TEXT in a field , justification in a field and coordinate using points and line.(Oracle Spatial DB). When I use geometry filter on text data, I will get point and lines, !NOT Text  My solution  1) I extract out the text using a series of textadder,coordinator extractor, rotation and setting geodb_v_align and  geodb_h_align.  They result is close but not perfect. There is still some alignment issue and text size.  The most irritating part is, when I open the original data using autocad and export them into a .dmg file and use esri toolbox(cad to geodatabase)  the output of those text are perfect.  ---------------------------------------------------------------------------  May I know is there a solution in FME to extract out this text perfect like how esri toolbox does?  Any hints will be greatly appreciated.

120
david_r
Celebrity
L
logan_pugh
asked in Data
How to read an SDE feature class with fmeobjects in Python?

Does anyone have any examples of reading an SDE feature class with fmeobjects in Python?  I was able to do it with a shapefile without any issue but am having trouble figuring out how and where to specify the parameters for the GEODATABASE_SDE format.  I am using an SDE connection file if that makes it any easier. However, whenever I try to open() the reader it pops up the SDE connection properties dialog. I get the feeling I'm just not specifying the reader parameters/directives correctly, but without finding any examples of the proper format I can only guess.  Thanks!

190
david_r
Celebrity
brooks
Participant
brooksParticipant
asked in Data
Tester output to file

I have three testers operating on the same data, but each on a different attribute. I want to write the features that fail to the same file, with a heading or prefix as to which rule it failed. It could be a text file or excel file to write to, it doesn't bother me.  After that I want to email that file to a user, but that might be another question.

270
sigtill
Supporter
G
goochy
asked in Data
FME Server (2012 SP 2) - Direct Workbenches to only run on a particular Engine via Passed parameter

Hello,  A similar quesiotn to this has been asked (by  me :) ) but I am having trouble getting a FME Server to use a certain engine when the value of "Engine 2" has been set in a parameter or passed to a parameter to a called Workbench.  Via FME Server, I have a workbench that displays parameters to the user for certain info, this workbench then runs the transformer FMEServerJobSubmitter setting the values of the 2nd workbench.  The 2nd workbench has a parameter of fmeInstance. Doesn't seems to make any difference if I set the parameter or pass the parameter.  If I rung the second workbench directly, it runs on Engine2 correctly.  Any ideas?

50
G
robertr
Contributor
robertrContributor
asked in Data
Create a Reader based on User Choice

Hello,  I am currently using a feature type reader with the Merge Feature Type filter * - wilcard to load a reader from command line, ex:    --folder all --data fullcoverage (the path formed with publish params: C:\\all\\fullcoverage\\area.shp What I would like to do, is to allow a user to choose between a default reader (let's say, the YES choice, which would be the above example) or to allow him to insert a completely new path (the NO option). So, if the choice is YES, it will take him on a branch, if the choice is NO, on a different branch. It should work somehow like this: "--choice yes" -> would load the default reader C:\\all\\fullcoverage\\area.shp "--choice no" (should require the "--path" param where the user could indicate the path for a completely different shapefile) which should create a reader like C:\\cities\\test\\dummy.shp if the command is: "--choice no --path C:\\cities\\test\\dummy.shp" I hope I stated t

570
robertr
Contributor
S
seesee
asked in Data
FME: How to consolidate all the feature classes not committed to anywhere?

Hi,  May I know how can I find all the feature class that has not been committed after a run?  Yes I know how to save those feature that have error/ignored by setting the writter but there are those that are miss out because they are not commited anywhere.  I do not wish to manually route them to a database or shape files because it can be quite a tedious task.  May I know if there is anywhere to say all feature classes not saved to be commited into a file or database table?     

40
S
V
vijai
asked in Data
Text moving in Y direction

Hi,  I want to move text  the in Y direction,using the line as a base(text created along the line nodes already) how to mve this?

150
takashi
Evangelist
B
b
asked in Data
extracting ground data from poitn cloud

so i have a point cloud (lots of them actually) in a LAS file and all of the data is unclassified.   I am wanting to extract the ground heights from the LAS file and then use those height values to create a DTM.  my thinking is to create a 1metre grid over the top of the area covered by the LAS file (or get FME to do this for me?) and then find all points within that 1m grid cell and assign the lowest Z value to the grid cell.  then once each cell has the lowest Z values i can use that grid to create a DTM. I know there will be cells that have tree tops etc in them and therefore the lowest Z value will be much higher than the ground, how to fix this i am not sure as i do not believe FME has convultion filter style transformers availabe?  so is my approach a effcient way? or is there other ways i can go about doing this? any other ideas on how to solve the inevitable issue of cells with no ground points in them?  any help would be apprecaited.

920
fmelizard
Safer
S
slikittyjim
asked in Data
Rearranging a File Structure

Hi all,  I've got a directory of MapInfo Tab files. I want to convert these to DBF files, and along the way restructure the Directory.  Currently, The Directory structure has 16 categories at the top, and each category has U.S. State subdirectories within it. The tab files are within the state folder.   For example:  USA_ACC (folder) >  CA_ACC (folder) > CA_ACC (TAB files)  I would like to rearrange this directory structure such that the U.S. states are at the high level, and the Tab Files for the 16 categories are within the state folders.  For Example:  CA (folder) > CA_ACC (DBF file)   I have experimented with 'Batch Deploy' and the 'File Copy' writer, but I still dont have a clear idea of how to achieve what I'd like to.  Thanks in advance!

90
S
Z
z77
asked in Data
Shape_Length in file geodatabase

Hi,  Input data are in fgdb_1. Ouptut data will be in fgdb_2 which is acctually copy of fgdb_1. One of columns (attributes) is Shape_Length with already known values. In my workbench I am doing some string manipulation and populate some another attribute. Output values for this attribute are being populated without any problem as well as others without changes, except Shape_Length attribute which now has value <Null> for all objects. Right before writing output data I inserted Inspector to check If there is still values for Shape_Length, and yes, values are there. But after writing to fgdb they dissappear. Where is a problem, why values for shape_length are lost? Tips? Database overwrite is set to NO, transaction type is transactions, table drop no, table truncate yes, attribute names are the same of course, i don't know..

970
Z
J
jphl
asked in Data
Skip (header) rows in excel

Hello folks,  I'm sure someone has ran into this issue before, but I can't seem to find any intuitive way of accomplishing this.  I am trying to setup an excel spreadsheet reader with the constraint that my header (column name) data is contained on row 3 and my actual data begins at row 4.  Row's 1&2 contain groupings of the column names (in row 3) and can be disregarded all together.  How can this be done in an FME workbench?  Is it possible out-of-the-box? or is custom coding/scripting required?  Thanks in advance.  Regards, JP

3960
N
M
michaeld
asked in Data
Creating a Mapinfo linked table from an Oracle database...I'm missing something.

Hi folks,  I've had luck outputting the Mapinfo table from Oracle including the MI_STYLE that picks up the symbology. The issue I'm having is the tables are coming out as a native table rather than linked. I'm using FME 2012 Desktop and I've not found anywhere in the Oracle reader or the MITAB writer where the metadata tags can be exposed.  We parse the U:P to our tables so we can refresh them in Mapinfo when required rather than outputing a new table.  Below is the tab contents that I'm expecting to see. What I'm currently getting is the attributes sans the metadata at the bottom of the file.  What have I missed???  Thanks  Michael   !table  !version 550  !charset WindowsLatin1 Definition Table    Type LINKED Charset "WindowsLatin1"    Fields 56      DOP_UID Decimal (10, 0) ;      DPR_UID Decimal (10, 0) ;      DRILLING_OPPORTUNITY_NAME Char (30) ;      CASED_AND_SUSP_EST_COST_JV1 Decimal (13, 3) ;      CASED_AND_SUSP_EST_COST_JV2 Decimal (13, 3) ;

180
A
fmelizard
Safer
fmelizardSafer
asked in Data
Autocad dimensions to ESRI geodatabase problem

Hi Is there an Autocad equivalent of the Microstation Convert_Dimensions.fmw file ?  I have tried modifying the settings in this file to suit Autocad attributes but can't seem to get it to work.  Can anybody please give me some pointers to modify it properly or provide a link to an already modified version?  Thanks Tim

70
fmelizard
Safer

Badge Winners

Show all badges

Community Stats

31,758
Posts
120,641
Replies
39,382
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.