- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,822 Posts
25,136 Replies

When you subscribe we will email you when there is a new topic in this category

6822 Posts

Importing spatial data into PostgreSQL

Hi all, Does anyone know how to import spatial data into Postgre? It seems the option Allowed Geometries is greyed out. Thanks, Darius

7 years ago

timboberooskyContributor

asked in Data

Define json precision?

Hello,I am wondering if there is a way to define precision for json files generated with the ESRIJSON writer. I am reading from a 10.1 ESRI File Geodatabase, writing to ESRIJSON and get 4 digits after the decimal, where I'm looking for 10. The coordinate system of the reader is web mercator (meter) - I know 10 digits is unnecessary but am trying to match the format of other files. Using the ArcGIS geoprocessing tool 'Features to json' gives me the 10 digit precision.FME 2012, ArcGIS 10.1 SP1.Any help would be appreciated.Thanks

glTF from FME cannot be verified with Khronos glTF validator

After I generate the file using the glTF output writer, and tried the Khronos glTF validator it presents me with errors.Not sure if anyone else has this problem. In addition, I cannot load using Cesium or threejs glTF loaders.

7 years ago

jomme

asked in Data

ESRI shapefile to GML not correctly generated from application schema

I am trying to transform an ESRI shapefile to a GML.To generate the GML I use a template/schema (supplied by the recipient). Unfortunately the result does not look like the delivered example . Because of this, the file will not be accepted. How can this be corrected? I am fairly new to this so please try to keep it simple. Below is the template/schema 1) First of all the naming is incorrect, rws:Objecten is expected but gml:FeatureCollection is generated.2) Below that, I expect the xmlns extensions to be underneath each other instead of in one line.3) Also gml:id="GML-ID-0" should be behind rws:Objecten but it is somewhere else.4) It also generates gml:boundedBy, this is not in the source data.5) gml:pointProperty is created instead of rws:puntObject.6) Inside gml:pointProperty, naming and positioning is different. Why is this happening and how can I generate a GML that looks exactly like the example XML format?If you need to see/test it for yourself, . Thanks in adva

7 years ago

philippe33

asked in Data

Write arcbycenter geometry in gml output aixm format

Hi,Probably this question has been asked before. ...I have a geometry IFME arc well made in the workbench ( arc by centerpoint, or arc by centerpoint with end points ).When i extract this geometry with GeometryExtractor i didn't obtain a <gml: arcbycenterpoint > description but a <gml: linestring > description. Only exception : arc with 3 points.I used 2Darcreplacer to construct this arc.It seems the only solution to obtain what i want is to write an XML templater with the desired squeleton and put the attributes inside. And when i retrieved the geometry with a geometry replacer + geometry extractor It doesn't change.The problem is when i want to aggregate arcs with lines or with arcs again to obtain a complex geometry. With the transformers inside FME it's well made ( 2Darcreplacer, arcpropertysetter. ...) and i obtain a <gml: surface> made with many parts. ( aggregate in FME workbench made of IFME Polygon with IFME Paths made of IFME arc and IFME L

DWG solid model to IFC

I am new to FME. We want to use it at our office to convert dwg building models with ACIS solids to IFC models (and the other way around). In the process we want to map every DWG layer to an IFC object type (ex: objects in DWG layer A-42------ are converted to IFC walls).I started trying to convert one of our building models, but the IFC output is only 1,5 kB and contains no geometry.Now I am trying to convert a test file containing only two solid boxes, with the same result, and I can see in the log that the objects fail when the IFC file is written.I have tried to convert the same model to Collada format with success, so there is nothing wrong with the reader side, but something goes wrong (or I have not understood some needed setting) when the IFC writer are doing it's job.My conversion log is attached.Hope someone can point me in the same direction!Cheers, Mikael

DWG / island detection style

Hi,I am trying to transform a dwg (to dwg) but I have a problem with hatch features.I noticed when I have hatches with the acad option "Outer Island Detection " as type, I can't write them into my dwg file output. When I swich it to "normal", then I can. I was wonderring if it is posible to handle this option directly in FME before writing the output as I have plenty of dwg with this problem to tranform.Thank you in advance,Fabien

7 years ago

plidianContributor

asked in Data

How do I read EXIF information from a database?

I've got a MSSQL database that stores JPEG images in a varbinary(max) field. I can of course bring this data into FME desktop with either the SQL Creator or the MSSQL_ADO reader. I also know I can get at the EXIF information using the JPEG reader and exposing those attributes. Where I get stuck is how to get from the fme-binary data into the JPEG reader to expose that meta data. Ultimately I'm trying to extract the GPS coordinates from the JPEG but nothing I've tried has worked. Since this is an ARCmap Feature Attachment table I can't be the first person who wants to extract the timestamp and GPS to verify or update the feature data to which the attachment is associated, but I can't figure it out.

DGN V8 won't show up in FME Data Inspector.

Hi,I have two Microstation V8 file that's suppose line up side by side spatially, but for some reason one file won't line up correctly. FILE_01.dgn looks correct when I view in FME Data Inspector, however FILE_02.dgn shows up as a empty screen. Yet when I open the file in Bently Data Viewer, I can see the data. I suspect it's some sort of Global Origins issues, however, I don't have access to Microstation and not sure how to trouble shoot.Any advice would be greatly appreciated. Regards,Thomas

120

7 years ago

jeroenContributor

asked in Data

Dynamic database connection with published parameters

Hi,I am working on a workflow that can do some simple calculations on different data sets but within just one database of my choosing. Each project has its own database with tables(data sets) and i would like to connect to them by just giving FME the pXXX project number and data set number. I tried to use published parameters to set the same values that i normally use in a more static workflow. This ends up in an error when adding the reader.Undefined macro `database' dereferenced in file `'Program TerminatingTranslation FAILED.Workspace generation failed. Parameter file was C:\Users\Jeroen.GPA\AppData\Local\Temp\FME_1510569791750_7796.Is it not possible to set the database into a parameter or do i need to save it as something else than text? Or is there another way to get dynamic connections to different databases on the same server(login credentials are the same for all tables and databases on that host and port).edit: i, of course, filled in the host, port and other information tha

Error while reading WFS Datas

I can get my Feature Types, but when I connect them to an Inspector, I can't read more than 150000 entities. I get this message : Is this an error because of my parameter ou because of the WFS Data ? I'm using FME Desktop 2017 (build 17652, 32-bits and 64-bits version). My project use only about 300 Mo RAM. I keep the WFS Reader's default parameter, except : Max Feature : 150000 WFS Version : 1.1.0 WFS Output Format : GML 3.1.1 Connection & Transfert Timeout Length : 1000 s If I set "Max Features" to 100000, I can visualise my datas. Thanks for any help or advice ^_^ Patrick

I am trying to manually geocode some addresses, and am having a hard time developing the correct workflow to acheive this. I have a dataset coming from a SQL database that is full of addresses with unknown coordinates. I am geocoding with a CSV file that I have created that contains the addresses compiled from county auditor websites with the associated latitude and longitude fields for each address. I am starting with FeatureMerger because if both address fields are an exact match then this works perfect. -- address geocoded successfully. However some addresses will not match based on different suffix types. (i.e. ROAD vs. RD or HIGHWAY vs HWY) I have added a string replacer transformer to the workflow to trim off the suffixes that could eliminate the addresses from matching via a rubular expression. The part I am struggling with is how do I compare these fields again after I have trimmed off the various suffixes? I have attached a picture of my workflow.

7 years ago

asked in Data

Problem with multiple MSWordParagrapher for a harvard referencing workspace

Hello everyone,I've just started my PhD and referencing takes me forever so thought FME could do the heavy lifting. The idea is to have an excel chart (example attached) that I manually fill in with the referencing details and run it through a workspace and at the end I have a full bibliography written to a word document. The process for this is to take the excel file and sort it alphabetically based on authors surname and then filter the attributes based on the type of reference and number of authors. From there I use the MSWordParagrapher to list the Harvard reference format that I wrote in the text editor The problem I have run into is that for the life of me I cannot get more than two MSWordParagraphers working at once. If I link up attributes to a third one I get a failed workspace and I will ideally want around 20. Is this possible? Am I missing something simple? Or is there a better way of doing it?, I've attached the workspace and the source datasets if anyone can help

7 years ago

samstibbs73

asked in Data

Is there a reader for .pts files?

Is there a way of reading .pts files within FME

SDE Table not being read in workbench. PLEASE READ

Hello everyone,I am back and I have 99% of this very important workbench completed (thanks to you all for helping with last question).My next "issue" is stumping me. My workbench is reading form SDE and writing to a GDB.One of the features I have is a Cutout object and within the SDE is the Cutout_tb (Sde table object) which carries the Child records of the Parent Cutout.I simply bring it in and connect it to feature merger to get the attribute I want (fuse size).Seems simple enough but the Workbench wont read records from the table in the workbench whether I put it in its own reader or not. Its puzzling because if I make separate workbench and simply write to access database it reads and writes the records fine.Is there any way to get the workbench to get the child records straight from SDE upon reading the cutout object (such as reading the SDE Relationship Class object in SDE)? Or is there a way to get the simpler way of simply having the table read in workbench and join

7 years ago

friesewoudloper

asked in Data

How to solve ORA-13224 (zero tolerance value provided for layer in USER_SDO_GEOM_METADATA) error?

Hi,When we try to create a new feature class using the Esri Geodatabase (ArcSDE Geodb) writer, we get the following error: Geodatabase Writer: Creating feature class `OBJ.Duikers_2017'An error occurred while attempting to create the feature class 'OBJ.Duikers_2017'. The error number from ArcObjects is: '-2147216072'. The error message from ArcObjects is: {Underlying DBMS error [ORA-13224: geen tolerantie opgegeven voor laag in USER_SDO_GEOM_METADATAORA-06512: in "MDSYS.MD", regel 1723 ORA-06512: in "MDSYS.MDERR", regel 17ORA-06512: in "MDSYS.SDO_GEOM_TRIG_INS1", regel 39 ORA-04088: Fout bij uitvoering van trigger 'MDSYS.SDO_GEOM_TRIG_INS1'.]}A fatal error has occurred. Check the logfile above for detailsI think the correct translation for the ORA-13224 message is:ORA-13224: zero tolerance specified for layer in USER_SDO_GEOM_METADATAIn you can find the sql statements that are executed by the trigger MDSYS.SDO_GEOM_TRIG_INS1 that raises the error.The problem seems to be that no toleran

Convert excel csv x,y meter coordinates into dwg file format

New to FME: need to convert excel csv x,y meter coordinates into dwg file format

JSON – Get Attribute values from file

I have a JSON file and need to extract the attributes from this file. How can I do it? Example:{ "id" : null, "revisionNumber" : "1.0.0", "periodTimeInterval" : { "start" : "2014-10-10T01:00Z", "end" : "2014-10-11T01:00Z" }, "timeSeries" : [ { "id" : "silo:67688:536653:raw", "name" : null, "tskeys" : null, "dimensions" : { "attribute" : [ { "value" : { "item" : [], "type" : "String", "value" : null }, "name" : "Datenquelle" }, { "value" : { "item" : [], "type" : "Integer", "value" : "0" }, "name" : "Netzbetriebsplanung" }, { "value" : { "item" : [ { "key" : "0", "name" :

7 years ago

fmelizardContributor

asked in Data

Using Oracle Cloud? Also, what common formats are you using with Oracle?

A fellow FME user asked me if there are many people using Oracle Cloud and also they were wondering what formats are commonly used in combination with Oracle. I figure you all might be able to help answer this one.

7 years ago

stanislavvyskoc

asked in Data

SHP attribute validation against geodatabase XML Workspace Document

Hi,I need to vallidate SHP (or DWG blocks with attributes) attribute value against Field Data Type and Domains specified in template GDB or XML Workspace Document. Reader: ESRI SHP Writer: ESRI GDB ISSUE: If the SHP attribute value doesn't match with GDB Field Data Type, the translation fails. I need to validate those values and write the fails.I wanted to use 'AttributeValidator' but the Validation Rules must be specified manually. Is there any way how to read the Validation Rules from the template (GDB or XML Workspace Document) and write them automatically?EXAMPLE:Reader SHP feature 'PIPE' has got field 'MATERIAL' with attribute value 'UPVC'. Writer GDB feature 'PIPE' has got field 'MATERIAL' with specified domain values: 'PVC-U, HDPE, PE' There is no match so the translation failsThanks.

Extract image from Google / Bing

Hi all,I'm very new to FME and GIS so sorry if I get any terminology wrong!To give you a run down, I've created a TIN surface from an ESRIASCIIGRID file. I have then extracted the boundary of this to get a footprint in a .shp file.With this, I am trying to download a satellite image from either google earth or google/bing maps (to drape over the surface later).Attempt 1:Import the .shp file into google earth, I then attempted to export an image from the extents of the polygon from the .shp file. I can't figure out a way to do this so I've just saved an image from google earth manually with 4K resolution, showing the extents of the polygon in red.Is there a way for FME to detect a red polygon and to clip the image around this? Would it then be possible to add geo-spatial data to this image to match the previously created surface?I have read through this post but am unable to get it to work, but thankyou @takashi as it's helping me to better understand FME.Attempt 2:U

ArcGIS Online Feature Reader 400 Error

I'm trying to read a feature layer and write to a geodatabase. I'm able to connect to my feature layers but I get the following error when running the processArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Cannot perform query. Invalid query parameters.'. Details: 'Unable to perform query. Please check your parameters.'

Data created in AutoCAD 3d using snapping is no longer coincident when imported into geodatabase. How can I maintain this coincidence exporting to a file geodatabase?

7 years ago

redgeographicsCelebrity

asked in Data

Bug in GML arc representation?

See this question, I suspect it may be a bug and would appreciate it if somebody from support could take a look at it.

7 years ago

mrmartinstreet

asked in Data

AutoCAD xrefs and the writer

For some reason when you change the "name" of an xref in a workbench the writer doesn't replace the old xref, it just adds a new one. Purging in the writer doesn't work. Does anyone know how to get rid of defunct xrefs?

130

7 years ago

Page 181 / 273

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.