Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 7,102 Posts
  • 26,146 Replies
7102 Posts
A
alang
asked in Data
File Not Being Written

Fellow FMEers, This must be a simple one but I’m stumped.  I just started with FME Server and I want to include some documents with the zip file that downloaded by the user.  I have a workspace that grabs an ArcOnline image and saves it as a JPEG in a folder.   In the same workspace is a datafile reader/writer pair that copies a file (found via UNC path on the server) to the same folder as the image.  When I run the workspace on my desktop I get both the image and the doc but when I publish to Server I only get the image.  Any one able to guess what I’m missing? Thanks, Alan 

110
sigtill
Supporter
johnniegis
Participant
johnniegisParticipant
asked in Data
Writing to SDE 9.3 and Oracle 10G with FME 2012 SDE Writer Error while inserting table into stream for table ERROR Code (-38)

Good Day, Not a question but rather a discovery which may be of use to some others out there. I realize there are newer versions of all the mentioned systems but for a number of reasons the client is required to utilize these.  So on to the problems: 1. All Feature Types (SDE layers) are created in SDE prior to running FME so Writers are created using Import Feature Types rather than using FME to create the layers. Again this is required as part of the business process. In order for FME to recognize these tables as spatial they must be opened in ArcCatalog/ArcMap first to initialize them without doing this FME tries to insert a NULL/nil geometry and fails. 2. For one particular non-spatial Feature Type, FME kept indicating that there was a missing column although did not specify which one. Google searches indicated it was likely an underlying issue with the SDE table. To try and determine the issue, we dropped and recreated the table, removed any contraints, keys etc but still no luck.

20
johnniegis
Participant
sigtill
Supporter
sigtillSupporter
asked in Data
Uploading file to a workspace with the REST-API

Is there any demo available uploading file to a workspace with the REST-API and not the HTTP PUT method as described in the documentation:  http://host[:port]/fmedataupload/<repository>/<workspace>/<filename>      

202
sigtill
Supporter
B
burton449
asked in Data
Tips to speed up process when clipping very large feature

Hi,  I am using the clipper on a dataset that contains many simple polygon features and few very large and complex features. I run the clipper in parallel processing and it seems to work correctly. However, the groups that contains the complex features take hours to complete while other groups with simple feature take few minutes. In this case there is no real performance gain with the parallel processing.  Do you have tips to speed up the whole process? Is it possible to divide the complex features in smaller part ?

1373
takashi
Celebrity
S
subrat
asked in Data
Setting value to 'Feature Types to Read' from Publish parameter

I have two workbenches. First one will gather some feature type names and use workspace runner to call second workbench which should read only selected feature types. I found i can send these values via published parameter.  But i do not know proper format of listing these names in publish parameter for 'Feature Types to Read' that can be understood by oracle spatial reader.  Please let me know how to handle this problem?  Thanks, Subrat

52
S
hakans
Contributor
hakansContributor
asked in Data
File Geodatabase Reader, single merged feature types-option ignored?!

Is there any way to make the File Geodatabase reader generic? It seems to be limited to the first feature type while using "single merged feature type" mode. Individual feature types is not an appeeling option...

102
hakans
Contributor
fmelizard
Safer
fmelizardSafer
asked in Data
WGS84 format for float from a string.

I have some exif GPS data that I want to plot points for. These are strings:      jpeg_exif_gpslatitude    (54) (59.0226) (0)  jpeg_exif_gpslongitude    (1) (44.0662) (0)    My problem is - how do I get these into a format 2d point adder will use? I can easily strip the brackets, but then its still a string and I get this:    2013-02-18 17:01:35| 0.6| 0.0|ERROR |2DPointAdder: @Tcl2 -- failed to evaluate expression `FME_Coordinates addCoord {1 44.0662 0} {54 59.0226 0}' -- String value `1 44.0662 0' contains invalid characters and could not be converted into a float    Thanks.    Note: Sorry about the colour etc. That's what happens when you copy/past it seems and there's no "reset" button.

428
hakans
Contributor
frantsch
Contributor
frantschContributor
asked in Data
PostGIS: Non geometry tables not importable to PostGIS reader / writer any more

Untill FME 2012 I was able to import feature types of PostGIS tables to a PostGIS reader / writer no matter if they had a geometry column or not.  Since FME 2013 this is no longer implemented, the feature types import would only indicate tables with geometry columns to be selected.  In order to add non geometry tables to a workbench, one has to add an additional PostgreSQL reader / writer. This is not very agreeable. I wish the prior functionality back!

583
frantsch
Contributor
S
subrat
asked in Data
Writing a feature with multiple geometries

Hi,    My input feature has 2 attribute (One numeric ID, Geom Point geometry). I found 2 map geometries(Multiline) for ID in db. So after fetching, sql executor generates 2 features as (ID,GEOM,MAP1)  and (ID,GEOM,Map2).  I used aggregator assuming that it will return me (ID,GEOM,(MAP1+MAP2)) and then trying to write into database but failing.  Please suggest me how to approach this problem?  Subrat

50
takashi
Celebrity
A
angela
asked in Data
translating SW 2d polygons with holes successfully to another format - e.g. shape file

Hi there,  I've got Smallworld polygons, some of which have holes, that I'm trying to translate into another format - ffs or shape file format.  With the writer set as FFS, the polygons with holes get translated as lines (with some extra lines added) while the ones without holes got translated as polygons.  I read that shape files support polygons with donut holes, so I then tried Shape file as the writer, but it completely failed to translate the polygons with holes.  When trying writing to Shape file, I tried with the "Allowed Geometries" set to shape_polygonm and subsequently set to shape_polygon but neither translated the polygons with holes.    

102
A
S
subrat
asked in Data
Text Stroking

How can i stroke text with UNDERLINE,OVERLINE,HALIGN,VALIGN in FME?  Thanks, Subrat

70
S
S
subrat
asked in Data
TextStroking Problem in FME desktop 2012

In FME desktop 2012, How can i stroke text with BOLD, ITALIC, UNDERLINE,OVERLINE,STRIKE THROUGH in TextStroker? I tried and it only strokes plain text.

172
S
S
subrat
asked in Data
Problem in returning SDO_GEOMETRY from oracle function/procedure

I am able to read geometry from oracle but how can i return geometry from oracle function and expose it in FME 2012?

742
S
bo
Contributor
boContributor
asked in Data
Case for exposing output ports in Writer?

I consider myself a veteran in spatial IT but newbie in using the FME tool - less than a year.  In my limited practice using FME, I increasingly feel the need to access "output ports" of Writers.  I saw some discussions dismissing such needs which for the most part I understood.  However, since ETL processes often times are synchronous in nature, picking up the "committed" results from database transactions for the following process will allow us to author fewer workspaces.  For example, feature elements of different types from ACAD files are extracted and processed before they are stored in several Oracle QC tables.  Without accessing the output ports of the QC tables just generated, I have to write a different workspace to Read from the tables for the subsequent process.  To piece automate the entire process in the sequence, I will need to use Python...  Any comments or advise is highly appreciated!  Bo 

105
bo
Contributor
S
subrat
asked in Data
TextStroking Issue in 2013

How can i pass stroking text to text stroker in FME desktop 2013?

40
S
U
ug
asked in Data
Running a Workspace with FME Server and Silverlight

Hi everyone,  i am trying to run a Data Download Workspace from a Silverlight Application and i really dont get any futher. I tried it with the WebClient class and the DownloadStringAsync Method but i have absolutly no success. Does anyone have experiences with Silverlight and FMEServer?  Thanks in advance!  Ulf

54
U
jhawks
Contributor
jhawksContributor
asked in Data
passing parameters from a web form to fme server workbench.

I've built six custom web form to pass variable to publicly available workbenchs. But I can't quite figure what the url should be in the webform so that the user input gets passed to the workbench.     Webform: http://fmeserver.ncd.noaa.gov/encdirect_extract_overview.html     Workbench:     https://fmeserver.ncd.noaa.gov/fmeserver/repositories/encdirect_extract/orapub2multiformat_overview.fmw

70
jhawks
Contributor
S
sv
asked in Data
Authorization Error - FMEServer 2013 SP1

I have a java application which uses the fmeserver api methods to run a translation. The code runs without error on our development server and produces a dataset as requested.  When  I run the application on the production server I get the following error when it tries to initialse the server session;   Error initialising FME Server: COM.safe.fmeserver.api.FMEServerException: QSInvalidRequest: Authorization Error: Unauthorized request by user  due to lack of proper permissions.   I have checked the entry in the Security/Resources tab for the  application with the appropriate clientid and roles assigned.   My question is how does FME Server know which box the request comes from ( requesterHost value listed under ‘Transformation Manager Directives’ in the Jobs/request data tab) ?

40
S
F
fme_89
asked in Data
KMLPropertySetter bug?

I have recently been trying to use the KMLPropertySetter to create KML from TAB, as per the documentation I enter the correct values for the Navigation Tree, Description Ballooon and Geometry. However when viewing the KML the properties I have set do not appear, for example I want the Navigation Tree name set to my Area column (ie Controlled Parking Zone A).  Please have a look at my KML and let me know if I am missing anything. In my workbench the only KML transformer I am using is KMLPropertySetter  https://maps.google.co.uk/maps/ms?msid=217615190311347014347.0004df7ec96af6fe732ac&msa=0&ll=51.558503,-0.090122&spn=0.077909,0.154324&iwloc=0004df7ec9ace9d65ef59  Any advice would be very much appreciated.

50
F
M
markd
asked in Data
Apostorphe in excel field name - how to remove

When I generate an excle table as an output in FME, the field name appears to have an apostrophe as the first character in each of the field names but you can only see this when you click on the field cell...... 'TOTAL NUMBER OF BUILDINGS. I say appears, because you can not do a search and replace in excel to remove it.  The only way I found to remove it is by running a trim function in excel to remove blanks. Is it possible to produce an excel table, in FME, without this apostrophe/blank as the first character in a field name?

215
M
A
aquamarine
asked in Data
Creating MS Access files

Hi,  I want to write to an MS Access File - which I have been able to do successfully.  However, it requires me to create the blank Access file manually before running the workspace.  Is there a way inside FME to create a blank MS Access File?  Thanks,

183
A
P
pat8037
asked in Data
Method to mirror a shape object?

Hi,  I'm currently trying to create a mirror copy of a set of rectangles. Each rectangle needs to be mirror on one particular side to create its other half.  So far, my method has been to identify a centerpoint on the side I want inorder to use rotater transformer, but I've had limited luck getting the procedure working in the correct order when I attempt to aggregate the original rectangles with the centrepoint.  Are there any other methods or transformers I  could potentionally use?  

822
P
J
jamesstott
asked in Data
Only drop dataset if reader suceeds

I am reading data from 5 WFS feeds and writing them to the same PostGIS database table. I schedule the FME workspace to run once a week so I get fresh data.    I only want to drop the data from the PostGIS table if the WFS readers complete. At the moment it is dropping the table, and then writing it as it reads the new data. If the WFS feed reader fails, I am left with a partial dataset.    So I have two questions:    1) I would rather that FME didnt write the data until after it had downloaded all of the data from the WFS readers. Is this possible?    2) Is it possible to make FME continue with the other WFS readers in the workspace if one reader fails?    I have found this page, is this the best way to achieve what I want?    http://safe.force.com/articles/How_To/Rolling-back-a-database-load-in-one-transaction

62
K
A
aquamarine
asked in Data
DGN to CSV

I am trying to extract x, y and z values out of a DGN file into a CSV file.  I used the following transformers: CoordinateConcatenator, AttributeSplitter and ListExploder.  Everything works except that the output has each x, y and z value in a separate row rather than all in one row.  Does anyone know how to change this?

487
takashi
Celebrity
rudy_v
Contributor
rudy_vContributor
asked in Data
Add New Attribute to Dynamic Properties in writer

Hi,  I've worked through all the various schema mapper examples but could not find one on how to add a new attribute to the writer schema.  I would like to read the source and add a attribute called  CadLayer as varchar(30) with value of autocad_layer from the source autocad drawing  The source can have various object data attribute fields  one example i have in source dwg MCCID_INT     integer MCCID_STR   char  255 NAME               char  255   i also would like to change them to char 50  I'm writing to arcsde 10.0 feature class  tx Rudy     

457
takashi
Celebrity

Badge Winners

  • Online Training
    zapperhas earned the badge Online Training
  • FME Flow Authoring Training
    jvadvianhas earned the badge FME Flow Authoring Training
  • Integrate Spatial Data
    mathildekrhas earned the badge Integrate Spatial Data
  • Integrate Data with the FME Platform Training
    gisplanhas earned the badge Integrate Data with the FME Platform Training
  • Welcome Back
    julian_talahas earned the badge Welcome Back
Show all badges

Community Stats

31,853
Posts
120,992
Replies
39,486
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.