- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,778 Posts
24,917 Replies

When you subscribe we will email you when there is a new topic in this category

6778 Posts

Recently active

Most replies Most views Newest first

stagha

asked in Data

MongoDB Writer doesn't write attributes,MongoDB Writer not writing fields

Hello,I am evaluating FME for a project but have hit a hurdle trying to write to a MongoDB database. I have put together a very simple workspace that reads data from an Excel file and dumps it into MongoDB. When I run it, I get the following error:MONGODB writer: Existing feature type 'rawData' does not contain an attribute matching the schema attribute 'customerId'. Attributes named 'customerId' on incoming features will not be written to the existing feature typeI get the same error for each attribute that I have defined. The writer succeeds in creating the collection and populating it with documents, but all the documents only have the '_id' field set.On the writer, I've set Attribute Definition to Automatic and also given the collection name under the General tab. Otherwise I've left the defaults.Am I missing something?,Hello,I am evaluating FME for a project and put together a simple workspace that pulls data from an Excel spreadsheet and d

248

7 years ago

tim_woodContributor

asked in Data

Attribute type message when opening 2016.1 Workspace in 2017.0

I've just opened one of my 2016.1 Workspaces that reads a ShapeFile in 2017.0 and some ArcSDE layers and writes to 2 File Geodatabases (FGDBs). I got the following message in the translation log:Attribute type 'fme_char' not found in ATTR_TYPE_MAP. Trying 'fme_int8' Attribute type 'fme_int8' not found in ATTR_TYPE_MAP. Trying 'fme_int16'I've still got 2016.1 installed so I'll run the Workspace in that, but I'd appreciate any explanations of what this means. I'll try re-creating the Readers and Writes in 2017.0 when I get a chance.

Hi,Yet another newbie here.I am just wondering if its possible to change writers output in some quick way (drop down list, etc).let me explain... I have an excel spreadsheet and 13+ feature classes (ArcGIS 10.3.1) I am using FeatureMerger to join the table with every single feature class (not always basing on the same common field). So far so good, it is working fine but sometimes i need to change an storing location, eg. output1: local test area, output2: internal server (SDE), output3: external server (SDE). How to change the output locations all at once. At the moment i have 13 writers and i don't want to change each of them every time and i don't want to create workbenches for each of the potential outputs. How to do that? Thanks,

913

7 years ago

mygisContributor

asked in Data

Writing LOD2 and LOD3 into a single citygml file

Hi, is it possible to mix lod2 and lod3 geometries into a single CityGML file?

7 years ago

dirk1964

asked in Data

shp to dwg area,SD30 Area to shp polygon settings

The area did not exist in the dwg-File, which parametres Needs the dwg polygon. In the DATA_Inspector out of des Workbench it Looks so:Which Settings are Missing for the Export to dwg?, to convert an area to dwg the area did nor exist. By Output in Dataexpector the Area are there. AutoCAD_entity=autocad_mypolygonDie Flächen werden nicht in im DWG gespeichert, bei der Ausgabe der Workbench in einen Datainspector werden diese angezeigt:autocad_entity (encoded: utf-8)= autocad_mpolygonautocad_mpolygon_object_type (encoded: utf-8)=0autocad_mpolygon_pattern_name (encoded: utf-8)=1autocad_with (64 bit integer)=2Für Hilfe wäre ich dankbar

7 years ago

philips3256

asked in Data

Extracting 4th dimension with oracle spatial reader

I am trying to extract an Oracle spatial feature type to a text format. The geometry in Oracle has four dimension. I need to extract this fourth dimension in a text format. I was looking into extracting this into gml or geoJSON. However, I haven't managed to extract the Mth dimension coordinates...I was wondering if anyone has any idea how to do this?Thank you

7 years ago

bbbutler

asked in Data

Populate WHERE clause with value from another table

Hello,I'm working on a workspace that will update a AGOL Feature Service. I need to pull from two different data sources, normalize the attributes and do some additional processing in the middle then write updates to the master. Both source data sets are fairly large so I am trying to not have to read each of them in their entirety every time the workspace runs. Rather I would like to leverage a "Modified On" field in the source data to only read in features that have been modified since the last time my workspace ran. I plan to push the workspace I'm building to FME Server and then sschedule it to run nightly. Currently I use the "time stamper" transformer to park the current data/time when the workspace runs in a .csv file. My thought is that I could then read in that timestamp and use it in my WHERE Clause. That's the thought however, I cannot seem to find a way to leverage that timestamp in my workspace parameters. Does anyone have some experience tr

Hello everyone, Does someone know how to set the srsName in a geometry for child nodes? So that it also appears in my AIXM File. This is how my ElevatedSurface looks like (ElevatedSurface has the right srsName=" urn:ogc:def:crs:EPSG::4326" but the srsName of curve is still "EPSG:4326" which is wrong) <aixm:ElevatedSurface srsName="urn:ogc:def:crs:EPSG::4326" srsDimension="2" gml:id="ts_4ccd28dc-d169-4905-bc3e-0d0908fa4042-0"> <gml:patches> <gml:PolygonPatch> <gml:exterior> <gml:Ring> <gml:curveMember> <gml:Curve gml:id="IDff4a11b2-b59c-4347-9b45-8872a5e8678b" srsName="EPSG:4326" srsDimension="2"> <gml:segments> <gml:LineStringSegment> <gml:posList>50.0298955820538...</gml:posList> </gml:LineStringSegment> </gml:segments> </gml:Curve> </gml:curveMember> </gml:Ring> </gml:exterior> </gml:PolygonPatch>

Is there a way to add an additional value to absolute value in the KMLPropertySetter Parameters?

For example, I would like to add 40 meters to the current absolute value height.

7 years ago

gnawali66

asked in Data

Printing infrared images on the top of point cloud?

I am working with FME 2017. I am quite a new user, now i tried to colorize point cloud with infrared color (i.e. integration of thermal images with 3D point cloud). LAS file has the local co-ordinate system but Jpg thermal images does not have any co-ordinate system. How can i integrate them on single file?

7 years ago

grishmash

asked in Data

How to create FME workbench so it reads excel Formula? it needs to read columns with no formulas and give the values in that column and then also columns with formulas and give back those formulas

Finding all shapefiles nested in one directory

Hello, I have a bit of a problem that I can't find a solution to. I have a list of directories and sub directories. Some contain shapefiles. Some contain tables, gdbs etc. Eg: S:\\NEW\\170530\\test.shpS:\\NEW\\170529\\NewData\\NewTest.shpS:\\OLD\\170428\\test.xlsxS:\\OLD\\170428\\MoreData\\MoreTest.shpThere are more folders within those dated directories. The root drive is always the same "S:\\"The root data directories (eg, OLD, NEW) will be provided by users as a user parameter. There won't be any navigating to those specific directories. How can I have a workbench that reads all the shapefiles nested in all those different directories, once the root data directory has been passed to it? Everything from the PATH reader up to the FeatureReader only specifies up to the dated directory based on user input. Eg:S:\\NEW\\170530I saved the directory path and passing the following to the FeatureReader: S:\\NEW\\170530\\**Now it works.. but with a couple of drawbacks. For on

AGOL Writing - Limited to ~20 seconds

Hi I am trying to use FME to update data on AGOL. This works with small data sets, however on larger datasets I get a timeout error (see below), when the process takes more than about 20 seconds.I am using FME 2015.1.1.0 and can't upgrade at the moment :-(I have tried using system proxy settings (but this did not make any difference)If I process the updates in batches this works (but is messy), and I can't truncate a large tables (as this is one large transaction)Has anyone else had a similar issue with a known work around? FME Error: "The error was 'HTTPSConnectionPool(host='services2.arcgis.com', port=443): Read timed out"

125

7 years ago

fmelizardContributor

asked in Data

My workspace cannot write to File Geodatabase due to Geodatabase Error (-2147024894)

I have set up my Geodatabase Writer but can’t write to it. The log file gives me this message: “Geodatabase Error (-2147024894): The system cannot find the file specified.” even though I’m creating a new file geodatabase within my workflow.

FME crashes without error but runs if tasks are done separately

Hi,I have a simple workspace. I read a file (interlis2) and have 4 parallel transformers attached (GeometryReplacers, followed by GeometryFilter and AttributeRenamer).When I run the workspace it crashes at exactly the same data row in my input file without any further error message except "fme has stopped working". Nothing in log file either.If I disable two of the four parallel transformers and run the workspace and afterwards disable them and enable the two remaing ones all data is read and written (Autodesk sdf3).Memory is no issue - FME just uses 500 MB, there is plenty left.Any ideas why that happens? I would like to run the workspace in one go.Thank you, Rob

7 years ago

oscardInfluencer

asked in Data

Split JSON into several features

Hi.I have the following .json file:{ "0": { "0": { "Group 1": { "Sub 1": 0, "Sub 2": 70 }, "Group 2": { "Sub 3": 0, "Sub 4": 29 }, "Group 3": { "Sub 5": 136, "Sub 6": 120 } }, "1": { "Group 1": { "Sub 1": 0, "Sub 2": 76 }, "Group 2": { "Sub 3": 1, "Sub 4": 35 }, "Group 3": { "Sub 5": 157, "Sub 6": 115 } } },"1": { "0": { "Group 1": { "Sub 1": 5, "Sub 2": 72 }, "Group 2": { "Sub 3": 51, "Sub 4": 2 }, "Group 3": { "Sub 5": 16, "Sub 6": 20 } }, "1": {

Point in Polygon Calculations

Hi I created a workspace to evaluate if a point is inside a polygon, the workspace looks:The first input is an Esri ArcGIS Server Feature Service I'm loading the polygons from a Feature service, the second input is a csv file with a list of points. The workspace is working as expected, PointOnAreaOverlayer is detecting is the points are inside any polygon.Now, my goal is to sent the points from another application to the workflow (can be to a rest endpoint) and call another rest endpoint if the point is inside any polygon, additionally, I want to keep in memory the polygon list (loaded from an external arcgis feature service) and refresh the geofences list periodically (The geofences changes time to time).[More information]Basically we need:A way to send features from an external application, We have an AVL application that receive vehicle data we can forward each message receive by vehicles to FME (about 500 messages per second)We need to evaluate for every single message if the v

itayContributor

Hi All,I have noticed that when creating a large number of ffs files (with spatial index option on) just one fsi (index file) is created for all the ffs files. This is done via a ffs writer in a workspace.When using the ffs files is a spatial intersection, FME warns:Unable to apply native search envelope for file 'C:\\mmm_1.ffs' due to missing index file 'C:\\mmm_1.fsiSo can somebody explain to me: if this is a warning does FME actually uses the spatial index ? or is it not used and therefore a bug? should actually a index file per ffs file be created? (only seen that happens if the ffs is re-read and saved again)Cheers,Itay

KMLTourBuilder orbit over point

@DeanAtSafeI saw your article on using KMLTourBuilder linked below. It is very helpful however I'm getting stuck creating my tour. I would like my tour to orbit over a single point. I have created a buffer around my subject point and set my tour to follow the buffer circle. This seems to work but I need to adjust my heading as I work my way around the circle. Ideally this would be a heading adjustment of thoroughly 7 roughly 51 times (360 degrees) so my camera view (heading) is always facing the middle of the circle. http://fmepedia.safe.com/articles/Samples_and_Demos/Climbing-Sydney-Harbour-Bridge-with-FME

7 years ago

endest

asked in Data

Adobe Geospatial PDF writer cann't output some text

Hi, I cann't use the Adobe Geospatial PDF writer to output Chinese or Japanese text. I have tried modify my font file's name and it's name show in FME's font window to non-Chinese; also flow the help's instruction to modify the fme_text_string to rich format, like "&#20320;&#22909;", and set the parameter of Writer "Text in Rich Text Format" to yes. But both failed. If you can output some special non-English characters to PDF? Thanks

Compare 2 shapefile for changes

Hi There, I recently upgraded my workspace from version 2015 64 bit to 2016 64 bit. This workspace generates a shapefile as an output. I noticed that there are differences in records count in these shapefiles. I want to know the difference between the two file shapefiles to see what changed. I was hoping that ChangeDetector transformer might do this but it show all the records as changed, curious if there is a better transformer suited for this. Thanks Jay

Finding Latitude and Longitude of a point feature from Shape file

7 years ago

rhildebrand

asked in Data

Writing Polygon Geom to Spatialite that is on the date line

When I write a polygon geometry whose western edge is equivalent to -180.0, but in Spherical Mercator (-20037508.342789244), the longitude value switches signs and becomes positive. I have tried the same process, but writing to a GeoJSON file and no problem occurs.Is there any value modification occurring when features are written to the Spatialite format?I can provide a very simple workspace to replicate this if it is needed.For what it's worth, I believe this is a precision problem. Simply changing the western longitude from -20037508.342789244 to -20037508.34278924 "solves" the problem. It does however translate to changing the actually geometry because something that originally was equivalent to -180.0 is now -179.99999999999997.

How to convert Shapefile to CSV and extract Postal Code as well as coordinates

How can I convert .shp to .csv and include Postal code as well as lat/long? I am able to make the conversion, but only Postal code is exposed in the .csvThe original shape file has x and y axis and is using EPSG 102015, the .csv would preferably convert to EPSG 4326 and include lat/long

202

7 years ago

bubblebebContributor

asked in Data

Does FME write to MongoDB?

Does anyone know if FME can write / read / interact with MongoDB?

163

7 years ago

Page 197 / 272

Badge winners

wouterdusardohas earned the badge Teacher (Grey)
wouterdusardohas earned the badge Conversationalist
cnorthhas earned the badge Welcome Back
maadh.mamarihas earned the badge Teacher (Grey)
dietervdshas earned the badge Integrate Data with the FME Platform Training

Show all badges

30,085: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.