- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,818 Posts
25,116 Replies

When you subscribe we will email you when there is a new topic in this category

6818 Posts

how to adjust writer to a flixible folder?

HI,how can I adjust the writer, so I can specify the destination folder every time different?I have the same Workspace, but I need to write the results all the time in the other Folders. I do not want to create/add all the time a new one. And I need to publish it into a Server, so the writer, and also the reader need to be a flexible.Thanks

5 years ago

xander

asked in Data

SQL database records to featureclass

Hi. I'm a new to FME and so far I am excited and overwhelmed. I am trying to connect to an exteral SQL database (CAD 911), run query, geocode query results, and write to an existing esri point featureclass. I'd like this to be a scheduled job where it updates the featureclass with new sql database records daily. This seems like FME 101...

5 years ago

susan

asked in Data

CityGML_data_Geometry_Repair

I have a set of the CityGML data (LoD2). I have to add the missing ground floor layer “building footprint”. Also, repair other errors in the geometry. Is there an automatic way to do that?

Error connecting FME Desktop to ArcGIS Online

I am trying to connect FME desktop to ArcGIS Online. Taking hint from the article in this url, the networks team whitelisted www.arcgis.com and also bypassed authentication. Attached is the image showing the steps carried out by them (for people with knowledge of proxy/firewall). I have rubbed out some parts.I have been able to create Web Connection however unable to retrieve data from AGOL. I get the error file attached agol_fme_error.txt when trying to fetch Feature Service in the AGOL in Esri AGOL Feature Service Parameters dialog box.I didn't mention filtering to the networks team before carrying out the work. Could it be a reason? Any other suggestions are welcome.Extra information:a. FME Desktop 2018 64bitb. Able to login to AGOL in web browsersc. Able to connect to AGOL via ArcGIS desktop v 10.6 Thanks in advance Vidya

Postgis writer stop working

Hi,My problem is about a process that update a postgis table from an other geographic database. Sometimes the import stop working nearly at the end as you can see :POSTGIS writer: 6589 of 6765 features writtenPOSTGIS writer: 6601 of 6765 features writtenPOSTGIS writer: 6606 of 6765 features writtenPOSTGIS writer: 6628 of 6765 features writtenPOSTGIS writer: 6649 of 6765 features writtenand then, no more log for hours.The fact is that it doesn't seems to come from data, cause when i start the process by little packet sometimes it works, actually this slowness seems to be unpredictable. But always occur at the end of the process. And yes computer is working and doesn't seems to be saturated : Proc 8%; Memory 21%. Does someone have any idea of what can i try to understand what happen ??Thanks

160

5 years ago

ostojaContributor

asked in Data

Coordinates precision changed when writting to ESRI FGDB

Hi all,I noted that coordinate precision of the objects is changed when loaded into the ESRI FGDB.Using the coordinate rounder, all objects in my migration process are rounded on three decimals (on a mm), and even the data in the source system have only 4 decimals.I want to load them as such into the ESRI FGDB using FGDB writer. Source for writing is FFS file.After successful loading process, I checked results in ArcMap and in Inspector. What I can see is that objects and vertices have many more decimals then in the data, which I loaded.The resolution of the database is 0,0001 and tolerance is 0,001. This is also not clear to me, how I managed to write so many digits with 0,0001 resolution.I removed all coordinate systems in order to avoid coordinate transformations. I tried to set same coordinate system on the target as on the source, but unfortunately, the result is the same.Does someone have an idea why does extra vertices are appearing? How I can simply write the data which I have

The current version does not support editing (base, consistent, or closed) [An open transaction was detected

I have a ESRI Geodatabase (ArcSDE Geodb) writer which is returning: An error occurred while attempting to start an edit session. The error number from ArcObjects is: '-2147217150'. The error message from ArcObjects is: {The current version does not support editing (base, consistent, or closed) [An open transaction was detected. All user transactions must be closed prior to StartEditing.]}The problem is there are no locks on this feature class layer so no open transactions?

1120

5 years ago

mredpathParticipant

asked in Data

ArcGIS REST API Truncate operation?

I saw on this page ( https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/arcgisonlinefeatures/ft-parameters-w.htm ):The ArcGIS Online Feature Service writer performs a truncation by reading all feature IDs from the layer, and then making deletion requests in batches according to the Features Per Request advanced parameter.I was wondering if there were plans to incorporate the ArcGIS REST API Truncate operation?https://developers.arcgis.com/rest/services-reference/truncate-feature-layer-.htm

Editing CityGML building height

Hello FME Community, i am currently trying to combine stock and flow simulations with CityGML. As a tool in between i try to utilize FME.My question:How can I edit the height of a citygml building (LoD2)? I am trying to increase the number of floors and try to show a before and after version.Can i just change the z-axis of the building?Best regardsTobias

Aecosim written IFC custom attributes not appearing

I'm an infrequent user of FME so apologies if this is a simple solution. I have an IFC file that was created by exporting from Aecosim and I'm trying to expose the custom attributes (See image below) that I can see when opening the ifc in Solibri. I've searched this community and found nothing that can help me so far. If anyone has a solution or a way forward, your help would be much appreciatedI should add, my goal is to get this information out into an Excel document.Thanks for your help

5 years ago

asked in Data

GML Reader: "Unable to determine features from the parsed XML Schema files"

I get the error above and the following warnings<SOURCE_GML Reader> - Unable to determine features from the parsed XML Schema files, the following namespace URIs were processed<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/1999/xlink<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/2001/XMLSchema<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/2001/XMLSchema-instanceThe same file is read by QGIS without any problems.Any Ideas how I can find out the reasons?

Driver GPS Point Start Stop Sequence

I am looking to take a point feature class that acquires a GPS location from our Utility trucks every 15 seconds and create routes driven based upon historical data. End goal is I would like to build a polyline feature class to reduce the amount of data that I am publishing to our Portal to improve the performance of querying data, as we are acquiring approximately 2.5-3 million points within a 30 day span.Below is an example of the data being received.Here is what the data means:Vehicle is Offline = IsIdle - 0 & GpsActive - 0Vehicle is active but in a Idle State = IsIdle - 1 & GpsActive - 1Vehicle is Actively Moving = IsIdle - 0 & GpsActive - 1The part I am getting stumped on is how I can define routes driven. In the example above, there would have been 2 routes driven. The first route would be fromto and the second route being toBelow is an example of where I would like to take the data, with the addition of some sort of RouteID field. Any help is greatly appreciated.

5 years ago

thomas_

asked in Data

Is there a way to generate multiple Excel workbook using only one Writer?

I have to generate approximatively 850 Excel workbook and I was wondering if it was possible using only one Writer or if I had to use 850 Writers.I thought of the possibility of generating 850 sheets in one Excel workbook, but I would have trouble actually opening the workbook with my computer (lot of memory used).Also I work with a 2017 version of FME (I stumbled in the past on issue that could be esaily resolved with 2018, but I had to work in the limit of 2017).Thanks

How can i read/write user attributes from dgn elements

I have a dgn that have attributes for some elements:these attributes i'm guessing that are from exporting a shp file to dgn directly from microstation.How can i read these attributes and if possible create new one or change the value of existing ones.Is it even possible?Inspector does not show these attributes anywhere.Readers also does not show them anywhere

associate subtext to the heading text

Hi So I have a text document and I need to parse into specific headings and then extract that heading and all the sub text. The issue is the subtext is lettered. Is there a regex syntax that will continue to extraxt until it finds a new match? any ideas? Im using string searcher and have managed to get all this data as seperate lines, just not sure if its easier to try and find a way to put the data back together or if theres a more efficient way to parse Current using syntax: chicken{1}\\s|(. Example: I need every line that starts with "chicken" the chickens name and all the numbered lines below TEXT TEXT TEXT TEXT TEXT TEXT TEXT TEXTTEXT TEXT TEXT TEXT TEXT TEXT TEXT TEXTChicken: Rene(1) lays three eggs a day(2) escaped two weeks agoTEXT TEXT TEXT TEXT TEXT TEXT TEXT TEXTChicken: Stacey(1) etcand so on

5 years ago

fhilding

asked in Data

Send JSON via websocket

I'm trying to send a message to the websocket server on my FME Cloud instance. I can successfully transmit the following: {"ws_op" : "send","ws_msg" : "hello"} But I want to send a JSON message as "ws_msg", so I tried: {"ws_op" : "send","ws_msg" : fme_get_attribute("payload")} Which isn't received on the other end, similarly to if we have an incorrect message, i.e. without the "send message"-format from the documentation of the WebSocketSender. I would guess it's something with the quotes around the message, but I am unable to escape quotes in the message formatting window. So, how can I send a JSON message (Payload-attribute attached) to a websocket using FME? { "type": "Feature", "properties": { "icon-image": "pulsing-dot-blue"}, "geometry": { "type": "Point", "coordinates": [ 17.3016102, 59.6615453 ] } }

5 years ago

mikegresham1Contributor

asked in Data

KML view setter with exif data

Hi,I am in the process of creating a workbench to transform geotagged jpegs into KMLs. Ideally I want my photos to popup in google earth balloons at the location they were taken at. In order to do this I first need to extract the exif geographical information i.e.latitude, longitude, altitude, bearing etc. I would've thought that KML viewsetter would be the right tool for this however when I fill in the location fields with the appropriate exif information the KML still defaults to latitude 0, longitude 0. I'm quite sure I've got the right parameters "jpeg_exif_gpslongitude", "jpeg_exif_gpslatitude" etc. but it's not working for me.Any ideas from the community?Thanks,Mike

5 years ago

paulopires16

asked in Data

LAS (LiDAR) to OBJ to FLT (OpenFlight) with textures

Is it possible with FME Desktop?LAS (LiDAR) to OBJ (Wavefront) to FLT (OpenFlight) with textures???Thanks

Error in PDF Generation em version 2019.2.0.0

Greetings, I´m getting a strange error when trying to generate a PDF in 2019.2.0.0 version (Build 19752 - WIN64 or Build 734 - win32). The same flow works perfectly in version 2018.1.2.0 Build 18590 - WIN32, and we are planning to migrate to the new version soon but in our tests we enconter this error. For some unknow reason, in this example,some polygon near the "LTP" and "FTP" entrances in the 2nd table are dissapearing. In my original flow (not this sample), this behavior occurs in the polygons in the middle of table, so I don´t think it´s a problem related of the fact of be one of the last rows. I generated a small flow with the same problem to reproduce the situation for your avaliation. Thanks a lot for the help.

5 years ago

philippebEnthusiast

asked in Data

Use newest FME Desktop with an old FME Server

Hello there!If I want to use the newest FME Desktop functions (v2019) with an old FME Server (let's say v2017), do you think it would be possible to publish on my server a worskspace created on FME Desktop 2017 who will call (with a SystemCaller or whatever) a batch file that will run FME Desktop 2019?Batch file line command example"C:\apps\FME2019.1\fme.exe" "\\NASASERVER\c$\FME\Workbench\Talk2Aliens\SolutionHere.fmw"First of all, is that legal? Does Safe permit that?Secondly, would that work?Thanks!

ESRI PORTAL ITEM Fanout

Hi, Could anybody tell me if this possible with FME please? I'm new to using ESRI Portal Items and FME .I have a Feature service on Portal published via arcgis server from an enterprise geodatabase in Oracle, I wish to create views of this data in Portal by Fanout on an attribute value. e.g a Feature service of Polygons with and attribute of Sheet_no, I'd like to create a Portal item for a definition query on the master layer for each group of unique Sheet_no values, giving these items a new name based on the original item name + the Sheet_no... The data cannot be duplicated and the view must reference the original service and data source.This apparently can be done using the Portal Python API .... but I'd like to see if it can be done in FME. Any pointers are appreciated RegardsPaulg

5 years ago

fmencoContributor

asked in Data

Microstation Symbology from Oracle to PostGIS

We have an Oracle (Locator) Database, where we have stored geometric objects that were generated through Microstation. The database also contains attributes pertaining to the symbology of the objects. These attributes are:- a style column which contains a number- an angle column, which is set to 0 for non- point geometries- X-scale column, which is set to 0 for non point-geometries-Y- scale column, which is set to 0 for non point-geometries-a cellname column, which is null for non point geomtries, but contains the name of the DGN cell/symbology used for point geometriesPosting these attributes to another database (PostGIS for example) is not a problem. However, when reading this database in another (GIS) application, how do I get to see the same symbology?Is it something I need to set in the FME workspace, by setting somewhere that these attributes need to be interpreted as special symbology attributes? Or is it something I need to set within the GIS application itself?How do I even go

5 years ago

mapsrus

asked in Data

Does FME Server support Microsoft Exchange Server for notification emails?

AutoCAD 3D Object data table read in FME Cloud (workaround/alternative)

I noticed in the applications and formats supported page that AutoCAD Object Data tables (AutoCAD Map 3D) are not able to read in when using FME Cloud - in my workbench on my desktop this reader works great in getting the additional information stored there so seeing if there is an alternative or workaround in being able to get that data while using FME Cloud

Revit file (.rvt) Projection System

Hi, I have .rvt file which is created with DUB DLTM projection system, I do not see the feature on the correct location in FME inspector, or in ArcMap after transforming the file into multipatch file geodatabase.I can see the feature on correct location when adds the file directly into ArcGIS Pro but facing issue with FME.I am using FME 2019.1, which allows direct reading of .rvt file, no need to convert .rvz or ifcLooking for a solution.

190

5 years ago

Page 105 / 273

Badge winners

tb0505has earned the badge Welcome Back
thomasshas earned the badge English Speaker
philiphas earned the badge Welcome Back
marys2has earned the badge Welcome Back
marys2has earned the badge FME Form Basic Training

Show all badges

30,418: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.