Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,785 Posts
24,961 Replies

When you subscribe we will email you when there is a new topic in this category

6785 Posts

Recently active

Most replies Most views Newest first

MapInfo .MAP file sizes

Hi All, Encountered an interesting problem today... The background is that we are currently migrating from MapInfo to Esri and are in the process of migrating the data. With MapInfo on life support we need to provide users with the data now residing in the SDE back into TAB format. So to do this we've written quite a few workbenches. What we have noticed is that the .MAP file is consistantly 20-30% larger in size than the original .MAP before it went into the SDE. I would normally attribute this to picking up some extra "stuff" in the double translation process, but if you take the TAB into MapInfo and pack the table, the .MAP returns to it's original size... Very strange. Can any-one tell me why? It's not an issue (for me) but I would love to know what's going on!

Layer/Shp/Geodatabase files - How to get this into a oracle table/database?

Hi guys, Pretty much written in subject. But got a few gis esri products. Shp, layer and geodatabases. I am wondering what is the best method to get these into a oracle database. Does anyone have any examples or point me into how to get this setup? Thank you

Creating feature-linked annotations in an ESRI geodatabase

Hallo everyone, I tried a lot, but can't find a solution. I have a polyline feature class in a file geodatabase and want to create several annotations out of it. That means, the non-annotation-feature has already been written. Writing multiple annotation classes according to the feature's attributes is already possible in my workflow, but they are not feature-linked yet. It is stated here, that the "geodb_linked_feature_id" attribute connects the feature's Object ID to the ID of the annotations and thereby virtually the two datasets. But what am I supposed to enter in this field? When I choose the OBJECTID attribute of the polyline feature nothing happens. A second point that confuses me: If the polyline feature would not be already written, the documentary (here) tells me to use the 'geodb_text_feat_class_name' format attribute to link annotations to the feature. In the example, the annotation class name is entered for this attribute. But what does it he

Extracting parameters from an FME Server notification message

Hi all, I’m using FME Server and ActiveMQ to chain together a series of workbenches, running each in turn depending on the notification messages sent between FME Server and ActiveMQ (JMS). The notifications sent from ActiveMQ are JSONs with the parameters required by the workbench to run successfully. For example, the notification will contain Source Dataset, Coordinate System, File Type, etc. My problem is that I need to pass the parameters defined in the notification to the workbench at runtime and don’t know how to accomplish this when the notification is being read from an FME Server Topic. Initially I was going to use scripted parameters to read a json containing the required parameters from a url and extract the required information. This works really well if the notification and its endpoint is well defined but, now that I’m trying to read my notification message from an FME Server Topic, I don’t have a well defined JSON (notification message) to read from. As an alt

almosttransform

Swiss Interlis 1 to Oracle no sdo_geometry column?

Hi Guys, I'm loading data from the Swiss interlis 1 reader (ili2fme) into Oracle Spatial Relational. All run fine but the oracle geometry is not created. Instead of this I have a my_table_sdgeom table created and inside a lot of columns and coordinates(sdo_X..). I'm a bit confuse because I would have expected the Oracle Spatial Relational writer to to create a sdo_geometry column. How can I create this sdo_geometry column? Regards!

vkiContributor

output to oracle

I'm new to FME, so my question may be quite simple: In ORACLE I would like to output the content of a table into a new table. Except for two attributes, the structure of new table is the same as the one of the input-table. The input-table has a field "Geometry" with the type "SDO_GEOMETRY" and the output-table has to have it too. (We don't have Oracle Spatial though). I first defined a reader (format: Oracle Spatial Object) and tried to define a writer. But what format do I have to choose for the writer? With oracle non-spatial I loose the geometry and with oracle Spatial Relational the geometry is no longer saved in an "SDO_GEOMETRY"-field, but in four new tables. How could I do this (is it possible at all without oracle spatial)? Many thanks in advance!

francis_mContributor

KML folder icon

Hi I have a workbench that create a kmz file with placemark and overlay within some nested folder. My placemark and photooverlay use a style that is referenced onto a web server. I want my folder to use a custom icon. All folder the same icon as my placemark and photooverlay. Any idea how to do this in FME ? thanks!

FME -> log file

Hello, Our source control team asks that we use the major, minor, build, patch identifier on our FME scripts. When they go to production they drop the patch. So...we start with blah_1.2.0.1.fmw and when promoted to production we have blah_1.2.0.fmw. What I'm struggling with is ensuring that the log generated for the blah_1.2.0.1.fmw is named the same; blah_1.2.0.1.fmw. Moreover, when in production...I need the log to be named blah_1.2.0.fmw. I've tried unsetting the log value among the workspace properties, but this only works one time in execution - i.e. the log being named the same as the script. How do I ensure this behavior is consistent? Note - I cannot, at this time, introduce additional flags when we call fme on the command line, nor do we allow scripts to be touched (edited) when in production...i.e. manually set the log name. Any help or advice would be greatly appreciated. -abe Longmont, Colorado

Basic question: How to extract nodes from polys ?

Hi, This simple task has been stumped. I'm trying to extract 3D nodes from 3D polylines and 3D polygons, to be stored as point features in a separate dataset.. I've tried TopologyBuilder, GeometryExtractor and a handful of other transformers, but I can't seem to find the right combo. I'm sure it's quite simple, but I do need advice on this. Cheers. Lars

issues with Writer

I'm using FeatureMerger to join a spatial and non-spatial database based on a common attribute (country column) and in the output, I'll like to write all attributes from both databases. I used "Copy attribute from Transformer", but it copied only some of the attributes...I tested it with just one database and selected Copy Attribute from Feature, it didnt select all the attributes as seen in picture. Please what am I doing wrongly? Thanks

Read XML via Web

Hi there, I am new to XML and the FME resources availible have been great so far. I am stumped though. I am trying to read a dynamic XML file via the web (similar to RSS I would assume). At this point I can access an XML file via the web and can save this file onto my local computer. Once that is done I take this XML file and use FME to flatten it for attributes and can also add in a 2D point to populate coordinate information... I am loving the FME funcationality so far. Where I am stuck is that I would like to have FME connect into to a web source to read an flatten the XML file instead of having to access the XML via a web browser and then save the XML file onto my local machine. If I plug in the XML url into a FME reader I get an error, here is an example of the error: "Sending HTTP 'GET' request to 'http://www.enetpulse.com/wp-content/uploads/sample_xml_feed_enetpulse_soccer.xml', waiting for response ... The uri-map document 'C:\\ap

Trying to find out if your software supports the conversion of ESRI shp file data to Spatial Info objects, (not just Autocad objects). Thanks in advance. Erc

Float / double value from XML

Hi, Let me explain what I want to do: I have a ".obj" file, and a ".xml" file which contains some metadata. The coordinates in the ".obj" file are in a local reference frame. Thus, to get them in a projected SRS, I need to translate them using some values that I can parse in the ".xml" file. What I want to do is: Read ".obj" and ".xml" file Compute convex (concave) hull of the geometries in the ".obj" file Translate the hull with values read from the ".xml" file Save the translated geometry in a ".shp" and force its EPSG with a value read in the ".xml" file In the ".xml" file, the EPSG is in the tag <SRS> (e.g. <SRS>EPSG:2154</SRS>) and the origin of the coordinates (the transltion I want to apply) is in the tag <SRSOrigin> (e.g. <SRSOrigin>652367,6862971,0</SRSOrigin>). These tags are enclosed in a ModelMetadata tag. To do the tra

sigtillContributor

KML Network Link Service - No active engines

It seems when running KML Network Link Service with a workspace after a while I have "No active engines". Then I need to reboot FME Server and then it finds the floating license again. So 2 questions: 1. Have anyone else experienced this? This is very unstable behaviour 2. I noticed you can only have one user using the KML-service at the time. Do you really need 1 engine PER user that wants to look at the KML? I assume I havent found the workaround - but that it exists.

Sending/Receiving notifications in FME Server 2013

Hi all, I need some help with sending receiving success/fail notifications with FME Server 2013. I've read all I can find online but it only really covers FME Server 2012. Are there any good documents out there that are for FME Server 2013? Here are a few of my questions: When I publish a workspace to FME Server under the Job Submitter service I select the success and fail topic to publish (Is this where my success/fail notification will go?), the I have the option to select a Notification Writer. Do I have to create this writer and all the content of the notification writer in my workbench? Thanks Rob

Can FME Server Output a JSON feed?

Is it possible to use FME Server to deliver a JSON feed in this format? http://open511.org/event.html If so, has anyone done so at this point? Thanks in advance, M

VectorOnRasterOverlay with overlapping pointcloud

I'm trying to turn a pointcloud into a DEM raster using VectorOnRasterOverlay. My problem is that some of the points in my pointcloud overlap (in Z), and when creating the raster sometimes only the lower points from the point cloud end up in the DEM. Obviously it has something to do with the order the points are processed, but I can't find an easy way to fix it. Any ideas?

Generic Reader and Schema Reader - Published variable issues

Hi, I have a chained set of translations in development. I have been using Schema Reader and Generic Reader while publishing their Source Dataset and chaining them together with Workspacerunner (I do not have FME Server). I have had great success with chaining translations in the past, but I have never used the Generic Reader or the Schema Reader. I would post the translation, but right now I cannot. The problem is, I have a lot of file geodatabases (*.gdb) and I need to send a combination of many or all of them through as the source for the schema reader in a child translation. So I make sure the child translation has the source for the schema reader published and then I create the string for the gdb paths and send it through the workspace runner to the child translation from the parent. Here is how the string looks before it goes through the workspace runner: C:\\Projects\\Area1\\ClientNetwork.gdb,C:\\Projects\\Area2\\ClientNetwork.gdb Now when the child trans

tbs_gis_teamContributor

Special Charcaters in Access MDB file writer

I have a attribute name Unit # and the writer makes it and underscore. Is there a way to write out the special characters? Thanks, Chad

FME server Email template language

Hi Guys, I'd like to be able to send a link to download a log file by using the Email template language: http://docs.safe.com/fme/2012/html/FME_ServerRefManual/ServerCore/EmailTemplateLanguage.htm I know how to send the link to resulting data but this is not giving any sensible result: <fmeblock type="optional">Click to download the full log: {urlPrefix}{LogFileLocation}/{LogFileName}</fmeblock> This is not giving any result at all: <fmeblock type="optional">{LogFileLocation}</fmeblock> Any help would be much apreciated. JP.

Positional improvement - points and improved large scale

Hi all I have large scale data and a copy of the same data that has been positionally improved. I have the Point data associated with the original large scale data and would like to apply the point data to the positionally improved data so that the points remain within their polygons (ensuring that the improvement shift does not leave a point outside its original polygon). With FME capable of all tasks, has anyone any ideas how I can use it to do this? Much appreciated Colm

Writing to File Geodatabase without geometry type in name

Hello, I've setup a workbench that has a generic reader writing to a file geodatabase with dynamic properties. In the output it keeps appending the geometry type to the feature class name e.g. xxxx_polygon. Can I stop it from doing this? In the dynamic properties section if I set the schema source to the generic reader then I get this issue but if I set the schema source to a SDE reader for example then it doesn't put the feature type on the end. I've tried editing the fme_basename and fme_feature_type properties to force the name to be the value of a user parameter but it still appends the geometry type without me asking it to. Thanks, Peter.

davideagleContributor

FME Store Access

Does anyone know (or can test) if when you only have access to the ESRI Data Interoperability Extension license...assuming you have ArcGIS 10.1, which gives you FME 2012 under the bonnet... can you access FME Store components like custom transformers? This is possible IF you have the ESRI Edition of FME Desktop if you extend ESRI, but I'm wondering if you can see the store or install downloaded FMX files if you have only bought the Data Interoperability Extension direct from ESRI? Cheers, Dave

writing metadata

Hi everybody. I have checked the tutorials on how to write metadata but am troubled. it seems like FME includes extra xml tags causing ArcCatalog not to recognize the metadata. I have included the tags in the text below. What am I doing wrong? any pointers? -<fme:xml-tables xsi:schemaLocation="http://www.safe.com/xml/xmltables signs.xsd" > -<fme:NewFeatureType-table> -<fme:NewFeatureType> <fme:geodb_metadata_string> METADATA GOES HERE </fme:NewFeatureType> </fme:NewFeatureType-table> </fme:xml-tables>

Reader which is not listed among the formats

Can someone point me to know where I can find this reader format: "geocode [FILEGDB]" It is a reader that cannot be edited in an existing workspace. When I try to recreate the same transformation in a new blank workspace...Im unable to find that reader format. The reader should be reading a geodatabase file (but we are trying to not have to use ArcGis to consome the file). Any advice or assistance would be appreciated. -abe

1
...
253
254
255
256
257
258
259
...
272

Page 256 / 272

Badge winners

mahmoud_m.talalhas earned the badge FME Form Basic Training
nick_ahas earned the badge Integrate Data with the FME Platform Training
reveszhas earned the badge FME Flow Authoring Training
magdahirschhas earned the badge FME Certified Professional
sandrawanghas earned the badge FME Flow Authoring Training

Show all badges

30,159: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.