- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,779 Posts
24,921 Replies

When you subscribe we will email you when there is a new topic in this category

6779 Posts

Recently active

Most replies Most views Newest first

fmelizardContributor

asked in Data

Using Oracle Cloud? Also, what common formats are you using with Oracle?

A fellow FME user asked me if there are many people using Oracle Cloud and also they were wondering what formats are commonly used in combination with Oracle. I figure you all might be able to help answer this one.

7 years ago

stanislavvyskoc

asked in Data

SHP attribute validation against geodatabase XML Workspace Document

Hi,I need to vallidate SHP (or DWG blocks with attributes) attribute value against Field Data Type and Domains specified in template GDB or XML Workspace Document. Reader: ESRI SHP Writer: ESRI GDB ISSUE: If the SHP attribute value doesn't match with GDB Field Data Type, the translation fails. I need to validate those values and write the fails.I wanted to use 'AttributeValidator' but the Validation Rules must be specified manually. Is there any way how to read the Validation Rules from the template (GDB or XML Workspace Document) and write them automatically?EXAMPLE:Reader SHP feature 'PIPE' has got field 'MATERIAL' with attribute value 'UPVC'. Writer GDB feature 'PIPE' has got field 'MATERIAL' with specified domain values: 'PVC-U, HDPE, PE' There is no match so the translation failsThanks.

Extract image from Google / Bing

Hi all,I'm very new to FME and GIS so sorry if I get any terminology wrong!To give you a run down, I've created a TIN surface from an ESRIASCIIGRID file. I have then extracted the boundary of this to get a footprint in a .shp file.With this, I am trying to download a satellite image from either google earth or google/bing maps (to drape over the surface later).Attempt 1:Import the .shp file into google earth, I then attempted to export an image from the extents of the polygon from the .shp file. I can't figure out a way to do this so I've just saved an image from google earth manually with 4K resolution, showing the extents of the polygon in red.Is there a way for FME to detect a red polygon and to clip the image around this? Would it then be possible to add geo-spatial data to this image to match the previously created surface?I have read through this post but am unable to get it to work, but thankyou @takashi as it's helping me to better understand FME.Attempt 2:U

ArcGIS Online Feature Reader 400 Error

I'm trying to read a feature layer and write to a geodatabase. I'm able to connect to my feature layers but I get the following error when running the processArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Cannot perform query. Invalid query parameters.'. Details: 'Unable to perform query. Please check your parameters.'

Data created in AutoCAD 3d using snapping is no longer coincident when imported into geodatabase. How can I maintain this coincidence exporting to a file geodatabase?

7 years ago

redgeographicsCelebrity

asked in Data

Bug in GML arc representation?

See this question, I suspect it may be a bug and would appreciate it if somebody from support could take a look at it.

7 years ago

mrmartinstreet

asked in Data

AutoCAD xrefs and the writer

For some reason when you change the "name" of an xref in a workbench the writer doesn't replace the old xref, it just adds a new one. Purging in the writer doesn't work. Does anyone know how to get rid of defunct xrefs?

7 years ago

robin123

asked in Data

Batching combining a1.shp, a2.shp, a3.shp and b1.shp, b2.shp and so on into a.shp and b.shp.

HiI have a few thousand shape-files arranged in pairs of 5 in the form of a1.shp, a2.shp, a3.shp...... and b1.shp, b2.shp..... and so on. I would like to batch merge these into a.shp, b.shp and so on.Some guidance on how to create this batch would be much appreciated.Best regards, robin123

7 years ago

rogerrapp

asked in Data

Control quantity of surfaces for curved solids when reading DWG and writing OBJ?

We are using FME to read DWG and write OBJ. OBJ only supports flat surfaces, so objects such as cylinders in the DWG are converted to flat surfaces in OBJ. Which DWG reader parameter I should look for to increase the number of flat surfaces written to the OBJ? I have an existing fme workbench made by someone else, and I'm new to fme. Thanks much for any quick help from the community!

7 years ago

ggarza

asked in Data

What is the most efficient way to handle SQL Server table updates in Linux containers?

We are attempting to standup FME server in an automated fashion using Docker to spin up Linux containers. Because of the linux containers, our workspaces can only run SQL Server JDBC reader/writers per FME. Plus, in order to spin up the containers quickly, we avoid using any ESRI dependencies. For one of the workspaces, we are using Spatial readers and Non-Spatial writers because we are just updating attributes based on the processing results. The JDBC writers work but are twice as slow as the native SQL Server writers. Do we have any other options for updating the attributes in these SQL Server tables that may give us a performance boost since we don't actually have to write any data?

296

7 years ago

sunsilk11Contributor

asked in Data

Replace commas within quotes when using CSV Reader

Hi I have a CSV file with X,Y coordinates. I am loading this to a point feature class. However the XY coordinates sometimes come in quotes and have a comma, e.g.GLOUCESTERSHIRE,ST BRAIVELS COMMON,GL15 6SD,"355,280","203,644"Any suggestions what's the best way to handle this when using the CSV reader.

I am using mysql executor to fetch pvoutput.org data into my mysql databases. The whole data is being fetched but its not going into my mysql databases

INSERT INTO `stations`.`observation` (`station_id`, `date`, `time`, `energy`, `power`, `average`, `temperature`, `voltage` ) VALUES ( 1, @Value(interval_start), @Value(_timeOutSubstring), @Value(_dataEnergyOutString), @Value(_dataPowerOutString), @Value(_dataPowerAvgString), @Value(_dataTempString), @Value(_dataVoltString) )

7 years ago

dbklingdom

asked in Data

unique constraint error coming from an index

Hey, I'm getting a unique constraint error coming from an indexThe error number from ArcObjects is: '-2147216072'. The error message from ArcObjects is: {Underlying DBMS error [ORA-00001: unique constraint (FACILITY.A17846_IX1) violated]}Is there a switch in the writer I can set?? I have tried GRID 1 = Nothing and GRID 1 = 0 and both fail.Thx Brian

624

7 years ago

fmencoContributor

asked in Data

WFS data not coming through

Hi, I'm trying to read data from this server:https://geodata.nationaalgeoregister.nl/bag/wfs?request=GetCapabilitiesbut only a 1000 features (the same ones it seems) come through. I've tried switching some parameters around, like what was suggested in previous questiosn about WFS on this forum (ignoring the schema etc. ). However, nothing has worked so far.

18311

7 years ago

takashiContributor

asked in Data

Error when adding AGOL Reader to Workspace

Hello,FME 2017.1.0.0 64-bit, FME 2017.1.1.1 64-bit / Windows 7, Windows 10I encountered this error when adding the Esri ArcGIS Online (AGOL) Feature Service Reader to the workspace.Logged Message:ArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '500' and the message was: 'Unable to get user.'. Details: 'Unable to get user.'The Feature Service list has been retrieved correctly, but I cannot get the Layer List from any service.The AGOL account has been provided by a client in order to test collaboration between their AGOL site and FME Server. I can access their AGOL site with the account using a web browser. The error occurs only when accessing the AGOL feature service via FME AGOL reader. (I also have my own AGOL account, and the reader can access the feature service in my AGOL site with no problem)Question: How can I resolve the error and read the layers from the feature services?Thanks.

7 years ago

jitkam

asked in Data

Combining polygons to create larger area

Hello,I have a shp file with ZIP code level polygons. I need to combine all of them to give me polygon for the state, is it possible to do in FME?I tried to use the Aggregator, which took all my polygons and showed 1 output, but when inspecting the file, there was no geometry.Thank you!

465

7 years ago

tfcwParticipant

asked in Data

How can I make FME output an error when a source table doesn't exist?

I have a lot of .fmw files with Oracle readers pointing to sources outside my control. Sometimes, the names of the tables I'm reading from will change, or they'll get dropped, or my credentials will lose permission to them. When this happens, FME just reads 0 features, and says the translation was successful.How can I make FME output an error instead when this case happens?

7 years ago

fmeuser_gcContributor

asked in Data

Does MongoDB writer support multi-polygon geometry type?

Couldn't write to MongoDB with multi-polygon geometry. I get this error.MONGODB writer: Bulk write: OperationException: { index: 890, code: 16755, errmsg: "Can't extract geo keys: { _id: ObjectId('59fcc51628de9b19a60bf281')Any parameters to be changed for bulk write/multi-polygon geometry type?Thanks.

7 years ago

hektopascal

asked in Data

Problem writing spatialLite or sqlite

I'm having a frustrating hit-and-miss writing a handful of non-spatial feature types to sqlite non-spatial. Regular row-column tables, no relationship between the features or anything else. And sometimes it works, and sometimes one of the feature types will FAIL SQLite 3 Writer: Failed to write to table `myFeatureTypeName' in the database. SQLite3 Engine error: `SQL logic error or missing database' Removing the feature and then adding it manually will SOMETIMES fix the problem. And sometimes not... I've tried fiddling with the writer parameters (different modes of writing, No luck there. Finally, just now, I fiddled with the "Initialize Tables" - setting and changed it from FIRST FEATURE => IMMEDIATELY. This did the trick for me -- for the time being, at least. Hopefully this will make my problems go away for good. Anyone else having these kind of problems? Other sqlite / spatialLite hints and tricks I should know about? Oh, and running FME desktop 2014 Build 14235 win32.

Bringing in Data for past 30 days from SQl server using SQL to run before read

Hello I am new to FME and I am trying to bring in spatial data from SQL server by adding where clause in the reader using function "SQL to Run before Read". I am not sure what query do I use?I am using the following statement but it is giving error. select * from SDEDBO.Services where Date>=Dateadd('day', GETDATE(),-30)thanks for your help!

How to split/cut/clip a 3d model?

Hi,I need to tile a 3D city model. I have the model in formats .obj, .dxf, .dwg and .gdb. I drawed polygons (shape) which i intend to use as clipping/cutting/splitting boundaries, whatever helps. After hours of googling and trying in FME with different formats and with clipper boundaries as shape as well as 3D obj, and trying in NetFabb and other software, i really dont know how to address this problem. I found a thread in this forum:https://knowledge.safe.com/questions/5061/splitcut-3d-solids-and-surfaces.htmlBut the links to the example workbenches are unavailable. Can anyone point me in a direction or maybe even provide an example workbench? Many thanks for any type of help!

Determine which tif tags to be written to output tif

Hello,I am trying to generate a *.tif-File with certain tags. I found that setting the Photometric Interpretation parameter in the writer leads to the tag of the same name being set (eg. to "YCbCr") in the resulting file. However, I am looking for a FME way to set the XResolution, YResolution and ResolutionUnit tif tags so that they are included in the resulting tif file. thank you,Ludwig

7 years ago

oscardInfluencer

asked in Data

INSPIRE GML - How to change gml:id position?

Greetings!I'm using the INSPIRE GML reader to create a GML for the CadastralParcel theme.My FeatureCollection tag looks like this:<gml:FeatureCollection xmlns:xsi="..." xmlns:gml="" xmlns:cp="..." xmlns:base="..." gml:id="MY_ID" xsi:schemaLocation="...">Is there a way to change the position of the gml:id attribute. I would like to obtain the following:<gml:FeatureCollection gml:id="MY_ID" xmlns:xsi="..." xmlns:gml="" xmlns:cp="..." xmlns:base="..." xsi:schemaLocation="...">Maybe I'm missing a setting of the Reader to do this.My FME version is 2017.0Thanks for any help provided!

7 years ago

vincent

asked in Data

GML: CircleByCenterPoint

Hello, I have a GML in WGS84 coordinate system (EPSG:4326). The GML contains CircleByCenterPoint element, which has its radius set in kilometers. However, if I open the file with Universal Viewer, FME interprets the radius in degrees of latitude/longitude and the circle is therefore extremely huge. I would appreciate a suggestion how to convince FME to take the units of measure into account. Thanks Example: <gml:patches> <gml:PolygonPatch interpolation="planar"> <gml:exterior> <gml:Ring> <gml:curveMember xlink:type="simple"> <gml:Curve> <gml:segments> <gml:CircleByCenterPoint interpolation="circularArcCe

Writing danish Plansystem.dk GML

Hi allIm trying to set up a gml writer to write to a gml file that matches the attached gml. Im new to GML writing a have been trying to get FME to use this xsd schema: http://soap.plansystem.dk/pdk_schemas/PLANDK2_KommunePlanRammeType.xsd as a baseI anyone has an idea where to start making a working writer i would be very happy :)

7 years ago

Page 180 / 272

Badge winners

adarshluminahas earned the badge English Speaker
sterlahas earned the badge Student (Grey)
sameerbajracharhas earned the badge FME Form Basic Training
sameerbajracharhas earned the badge Integrate Data with the FME Platform Training
mglancloshas earned the badge Integrate Data with the FME Platform Training

Show all badges

30,099: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.