- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,700 Posts
24,701 Replies

When you subscribe we will email you when there is a new topic in this category

6700 Posts

Recently active

Most replies Most views Newest first

philips3256

asked in Data

Extracting 4th dimension with oracle spatial reader

I am trying to extract an Oracle spatial feature type to a text format. The geometry in Oracle has four dimension. I need to extract this fourth dimension in a text format. I was looking into extracting this into gml or geoJSON. However, I haven't managed to extract the Mth dimension coordinates...I was wondering if anyone has any idea how to do this?Thank you

7 years ago

bbbutler

asked in Data

Populate WHERE clause with value from another table

Hello,I'm working on a workspace that will update a AGOL Feature Service. I need to pull from two different data sources, normalize the attributes and do some additional processing in the middle then write updates to the master. Both source data sets are fairly large so I am trying to not have to read each of them in their entirety every time the workspace runs. Rather I would like to leverage a "Modified On" field in the source data to only read in features that have been modified since the last time my workspace ran. I plan to push the workspace I'm building to FME Server and then sschedule it to run nightly. Currently I use the "time stamper" transformer to park the current data/time when the workspace runs in a .csv file. My thought is that I could then read in that timestamp and use it in my WHERE Clause. That's the thought however, I cannot seem to find a way to leverage that timestamp in my workspace parameters. Does anyone have some experience tr

Hello everyone, Does someone know how to set the srsName in a geometry for child nodes? So that it also appears in my AIXM File. This is how my ElevatedSurface looks like (ElevatedSurface has the right srsName=" urn:ogc:def:crs:EPSG::4326" but the srsName of curve is still "EPSG:4326" which is wrong) <aixm:ElevatedSurface srsName="urn:ogc:def:crs:EPSG::4326" srsDimension="2" gml:id="ts_4ccd28dc-d169-4905-bc3e-0d0908fa4042-0"> <gml:patches> <gml:PolygonPatch> <gml:exterior> <gml:Ring> <gml:curveMember> <gml:Curve gml:id="IDff4a11b2-b59c-4347-9b45-8872a5e8678b" srsName="EPSG:4326" srsDimension="2"> <gml:segments> <gml:LineStringSegment> <gml:posList>50.0298955820538...</gml:posList> </gml:LineStringSegment> </gml:segments> </gml:Curve> </gml:curveMember> </gml:Ring> </gml:exterior> </gml:PolygonPatch>

7 years ago

kirsten

asked in Data

Is there a way to add an additional value to absolute value in the KMLPropertySetter Parameters?

For example, I would like to add 40 meters to the current absolute value height.

7 years ago

gnawali66

asked in Data

Printing infrared images on the top of point cloud?

I am working with FME 2017. I am quite a new user, now i tried to colorize point cloud with infrared color (i.e. integration of thermal images with 3D point cloud). LAS file has the local co-ordinate system but Jpg thermal images does not have any co-ordinate system. How can i integrate them on single file?

7 years ago

grishmash

asked in Data

How to create FME workbench so it reads excel Formula? it needs to read columns with no formulas and give the values in that column and then also columns with formulas and give back those formulas

7 years ago

fariyafarhad

asked in Data

Finding all shapefiles nested in one directory

Hello, I have a bit of a problem that I can't find a solution to. I have a list of directories and sub directories. Some contain shapefiles. Some contain tables, gdbs etc. Eg: S:\\NEW\\170530\\test.shpS:\\NEW\\170529\\NewData\\NewTest.shpS:\\OLD\\170428\\test.xlsxS:\\OLD\\170428\\MoreData\\MoreTest.shpThere are more folders within those dated directories. The root drive is always the same "S:\\"The root data directories (eg, OLD, NEW) will be provided by users as a user parameter. There won't be any navigating to those specific directories. How can I have a workbench that reads all the shapefiles nested in all those different directories, once the root data directory has been passed to it? Everything from the PATH reader up to the FeatureReader only specifies up to the dated directory based on user input. Eg:S:\\NEW\\170530I saved the directory path and passing the following to the FeatureReader: S:\\NEW\\170530\\**Now it works.. but with a couple of drawbacks. For on

7 years ago

nichowardwork

asked in Data

AGOL Writing - Limited to ~20 seconds

Hi I am trying to use FME to update data on AGOL. This works with small data sets, however on larger datasets I get a timeout error (see below), when the process takes more than about 20 seconds.I am using FME 2015.1.1.0 and can't upgrade at the moment :-(I have tried using system proxy settings (but this did not make any difference)If I process the updates in batches this works (but is messy), and I can't truncate a large tables (as this is one large transaction)Has anyone else had a similar issue with a known work around? FME Error: "The error was 'HTTPSConnectionPool(host='services2.arcgis.com', port=443): Read timed out"

7 years ago

fmelizardContributor

asked in Data

My workspace cannot write to File Geodatabase due to Geodatabase Error (-2147024894)

I have set up my Geodatabase Writer but can’t write to it. The log file gives me this message: “Geodatabase Error (-2147024894): The system cannot find the file specified.” even though I’m creating a new file geodatabase within my workflow.

7 years ago

rob_f

asked in Data

FME crashes without error but runs if tasks are done separately

Hi,I have a simple workspace. I read a file (interlis2) and have 4 parallel transformers attached (GeometryReplacers, followed by GeometryFilter and AttributeRenamer).When I run the workspace it crashes at exactly the same data row in my input file without any further error message except "fme has stopped working". Nothing in log file either.If I disable two of the four parallel transformers and run the workspace and afterwards disable them and enable the two remaing ones all data is read and written (Autodesk sdf3).Memory is no issue - FME just uses 500 MB, there is plenty left.Any ideas why that happens? I would like to run the workspace in one go.Thank you, Rob

7 years ago

oscardInfluencer

asked in Data

Split JSON into several features

Hi.I have the following .json file:{ "0": { "0": { "Group 1": { "Sub 1": 0, "Sub 2": 70 }, "Group 2": { "Sub 3": 0, "Sub 4": 29 }, "Group 3": { "Sub 5": 136, "Sub 6": 120 } }, "1": { "Group 1": { "Sub 1": 0, "Sub 2": 76 }, "Group 2": { "Sub 3": 1, "Sub 4": 35 }, "Group 3": { "Sub 5": 157, "Sub 6": 115 } } },"1": { "0": { "Group 1": { "Sub 1": 5, "Sub 2": 72 }, "Group 2": { "Sub 3": 51, "Sub 4": 2 }, "Group 3": { "Sub 5": 16, "Sub 6": 20 } }, "1": {

7 years ago

velasquezvictor

asked in Data

Point in Polygon Calculations

Hi I created a workspace to evaluate if a point is inside a polygon, the workspace looks:The first input is an Esri ArcGIS Server Feature Service I'm loading the polygons from a Feature service, the second input is a csv file with a list of points. The workspace is working as expected, PointOnAreaOverlayer is detecting is the points are inside any polygon.Now, my goal is to sent the points from another application to the workflow (can be to a rest endpoint) and call another rest endpoint if the point is inside any polygon, additionally, I want to keep in memory the polygon list (loaded from an external arcgis feature service) and refresh the geofences list periodically (The geofences changes time to time).[More information]Basically we need:A way to send features from an external application, We have an AVL application that receive vehicle data we can forward each message receive by vehicles to FME (about 500 messages per second)We need to evaluate for every single message if the v

7 years ago

itayContributor

asked in Data

FFS and FSI

Hi All,I have noticed that when creating a large number of ffs files (with spatial index option on) just one fsi (index file) is created for all the ffs files. This is done via a ffs writer in a workspace.When using the ffs files is a spatial intersection, FME warns:Unable to apply native search envelope for file 'C:\\mmm_1.ffs' due to missing index file 'C:\\mmm_1.fsiSo can somebody explain to me: if this is a warning does FME actually uses the spatial index ? or is it not used and therefore a bug? should actually a index file per ffs file be created? (only seen that happens if the ffs is re-read and saved again)Cheers,Itay

7 years ago

mikeymess

asked in Data

KMLTourBuilder orbit over point

@DeanAtSafeI saw your article on using KMLTourBuilder linked below. It is very helpful however I'm getting stuck creating my tour. I would like my tour to orbit over a single point. I have created a buffer around my subject point and set my tour to follow the buffer circle. This seems to work but I need to adjust my heading as I work my way around the circle. Ideally this would be a heading adjustment of thoroughly 7 roughly 51 times (360 degrees) so my camera view (heading) is always facing the middle of the circle. http://fmepedia.safe.com/articles/Samples_and_Demos/Climbing-Sydney-Harbour-Bridge-with-FME

7 years ago

endest

asked in Data

Adobe Geospatial PDF writer cann't output some text

Hi, I cann't use the Adobe Geospatial PDF writer to output Chinese or Japanese text. I have tried modify my font file's name and it's name show in FME's font window to non-Chinese; also flow the help's instruction to modify the fme_text_string to rich format, like "&#20320;&#22909;", and set the parameter of Writer "Text in Rich Text Format" to yes. But both failed. If you can output some special non-English characters to PDF? Thanks

7 years ago

jaygis

asked in Data

Compare 2 shapefile for changes

Hi There, I recently upgraded my workspace from version 2015 64 bit to 2016 64 bit. This workspace generates a shapefile as an output. I noticed that there are differences in records count in these shapefiles. I want to know the difference between the two file shapefiles to see what changed. I was hoping that ChangeDetector transformer might do this but it show all the records as changed, curious if there is a better transformer suited for this. Thanks Jay

7 years ago

chagantisasikir

asked in Data

Finding Latitude and Longitude of a point feature from Shape file

7 years ago

rhildebrand

asked in Data

Writing Polygon Geom to Spatialite that is on the date line

When I write a polygon geometry whose western edge is equivalent to -180.0, but in Spherical Mercator (-20037508.342789244), the longitude value switches signs and becomes positive. I have tried the same process, but writing to a GeoJSON file and no problem occurs.Is there any value modification occurring when features are written to the Spatialite format?I can provide a very simple workspace to replicate this if it is needed.For what it's worth, I believe this is a precision problem. Simply changing the western longitude from -20037508.342789244 to -20037508.34278924 "solves" the problem. It does however translate to changing the actually geometry because something that originally was equivalent to -180.0 is now -179.99999999999997.

7 years ago

jitkam

asked in Data

How to convert Shapefile to CSV and extract Postal Code as well as coordinates

How can I convert .shp to .csv and include Postal code as well as lat/long? I am able to make the conversion, but only Postal code is exposed in the .csvThe original shape file has x and y axis and is using EPSG 102015, the .csv would preferably convert to EPSG 4326 and include lat/long

7 years ago

bubblebebContributor

asked in Data

Does FME write to MongoDB?

Does anyone know if FME can write / read / interact with MongoDB?

7 years ago

chagantisasikir

asked in Data

How to convert XY coordinates to Latitude and Longitude. I have got the XY values from shape files. Please need your support

7 years ago

udhayarose

asked in Data

How to convert from shp file to citygml with texture and attribute information?

Hi All, I have 3D building model in *.shp format with LOD2. I have to apply the textures and covert that model into citygml format with attribute information. Please if any have the template share with me as well idea or suggestions also......

7 years ago

asked in Data

Incremental (ongoing) migration

Hi,What is the simplest way of to create an ongoing process that will import all "recently modified" records. "recent" means all rows in source where modified date > latest "Modified date" in destination.I have millions of rows in about 10 tables.Each row has a unique ID which can be used to overwrite the destination.I am planning to copy all fields and all rows (replica).Source database: MS SQL 2008B, Destination database: MongoDB.Thank you,

7 years ago

arthyContributor

asked in Data

how to dynamically create a json

Hello,I implemented a changed detection on oracle table.Now I would like to be able to create a json for each change per object. For instance, for an object where changes were detected on 5 attributs, below will be the json that I would like to obtain:{ "ATTRIBUT1": { "OLD_VALUE": "OLD1", "NEW_VALUE": "NEW1" }, "ATTRIBUT2": { "OLD_VALUE": "OLD2", "NEW_VALUE": "NEW2" }, "ATTRIBUT3": { "OLD_VALUE": "OLD3", "NEW_VALUE": "NEW3" }, "ATTRIBUT4": { "OLD_VALUE": "OLD4", "NEW_VALUE": "NEW4" }, "ATTRIBUT5": { "OLD_VALUE": "OLD5", "NEW_VALUE": "NEW5" }}How can I proceed to obtain this in fme?I was tinking of the agregator to group all the changes from the same object (based on an objectid) and then build the json but I don't know how to proceed.Please keep in mind that the number and names of attributes will change from one object to another one.Thanks,

7 years ago

abidoua

asked in Data

ERROr in convert CItygml to IFC

i have to convert CityGML to IFC ! an i get no gemetry at the end ! Why ?

7 years ago

Page 194 / 268

Badge winners

favoritesdishas earned the badge English Speaker
paulmcm601has earned the badge Teacher (Grey)
bwnhas earned the badge I Treasure Lists
vadishas earned the badge English Speaker
vadishas earned the badge Swedish Speaker

Show all badges

29,707: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.