Using readers and writers to extract and load data.
Recently active
Hi. I'm a new to FME and so far I am excited and overwhelmed. I am trying to connect to an exteral SQL database (CAD 911), run query, geocode query results, and write to an existing esri point featureclass. I'd like this to be a scheduled job where it updates the featureclass with new sql database records daily. This seems like FME 101...
I have a set of the CityGML data (LoD2). I have to add the missing ground floor layer “building footprint”. Also, repair other errors in the geometry. Is there an automatic way to do that?
I am trying to connect FME desktop to ArcGIS Online. Taking hint from the article in this url, the networks team whitelisted www.arcgis.com and also bypassed authentication. Attached is the image showing the steps carried out by them (for people with knowledge of proxy/firewall). I have rubbed out some parts.I have been able to create Web Connection however unable to retrieve data from AGOL. I get the error file attached agol_fme_error.txt when trying to fetch Feature Service in the AGOL in Esri AGOL Feature Service Parameters dialog box.I didn't mention filtering to the networks team before carrying out the work. Could it be a reason? Any other suggestions are welcome.Extra information:a. FME Desktop 2018 64bitb. Able to login to AGOL in web browsersc. Able to connect to AGOL via ArcGIS desktop v 10.6 Thanks in advance Vidya
Hi,My problem is about a process that update a postgis table from an other geographic database. Sometimes the import stop working nearly at the end as you can see :POSTGIS writer: 6589 of 6765 features writtenPOSTGIS writer: 6601 of 6765 features writtenPOSTGIS writer: 6606 of 6765 features writtenPOSTGIS writer: 6628 of 6765 features writtenPOSTGIS writer: 6649 of 6765 features writtenand then, no more log for hours.The fact is that it doesn't seems to come from data, cause when i start the process by little packet sometimes it works, actually this slowness seems to be unpredictable. But always occur at the end of the process. And yes computer is working and doesn't seems to be saturated : Proc 8%; Memory 21%. Does someone have any idea of what can i try to understand what happen ??Thanks
Hi all,I noted that coordinate precision of the objects is changed when loaded into the ESRI FGDB.Using the coordinate rounder, all objects in my migration process are rounded on three decimals (on a mm), and even the data in the source system have only 4 decimals.I want to load them as such into the ESRI FGDB using FGDB writer. Source for writing is FFS file.After successful loading process, I checked results in ArcMap and in Inspector. What I can see is that objects and vertices have many more decimals then in the data, which I loaded.The resolution of the database is 0,0001 and tolerance is 0,001. This is also not clear to me, how I managed to write so many digits with 0,0001 resolution.I removed all coordinate systems in order to avoid coordinate transformations. I tried to set same coordinate system on the target as on the source, but unfortunately, the result is the same.Does someone have an idea why does extra vertices are appearing? How I can simply write the data which I have
I have a ESRI Geodatabase (ArcSDE Geodb) writer which is returning: An error occurred while attempting to start an edit session. The error number from ArcObjects is: '-2147217150'. The error message from ArcObjects is: {The current version does not support editing (base, consistent, or closed) [An open transaction was detected. All user transactions must be closed prior to StartEditing.]}The problem is there are no locks on this feature class layer so no open transactions?
I saw on this page ( https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/arcgisonlinefeatures/ft-parameters-w.htm ):The ArcGIS Online Feature Service writer performs a truncation by reading all feature IDs from the layer, and then making deletion requests in batches according to the Features Per Request advanced parameter.I was wondering if there were plans to incorporate the ArcGIS REST API Truncate operation?https://developers.arcgis.com/rest/services-reference/truncate-feature-layer-.htm
Hello FME Community, i am currently trying to combine stock and flow simulations with CityGML. As a tool in between i try to utilize FME.My question:How can I edit the height of a citygml building (LoD2)? I am trying to increase the number of floors and try to show a before and after version.Can i just change the z-axis of the building?Best regardsTobias
I'm an infrequent user of FME so apologies if this is a simple solution. I have an IFC file that was created by exporting from Aecosim and I'm trying to expose the custom attributes (See image below) that I can see when opening the ifc in Solibri. I've searched this community and found nothing that can help me so far. If anyone has a solution or a way forward, your help would be much appreciatedI should add, my goal is to get this information out into an Excel document.Thanks for your help
I get the error above and the following warnings<SOURCE_GML Reader> - Unable to determine features from the parsed XML Schema files, the following namespace URIs were processed<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/1999/xlink<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/2001/XMLSchema<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/2001/XMLSchema-instanceThe same file is read by QGIS without any problems.Any Ideas how I can find out the reasons?
I am looking to take a point feature class that acquires a GPS location from our Utility trucks every 15 seconds and create routes driven based upon historical data. End goal is I would like to build a polyline feature class to reduce the amount of data that I am publishing to our Portal to improve the performance of querying data, as we are acquiring approximately 2.5-3 million points within a 30 day span.Below is an example of the data being received.Here is what the data means:Vehicle is Offline = IsIdle - 0 & GpsActive - 0Vehicle is active but in a Idle State = IsIdle - 1 & GpsActive - 1Vehicle is Actively Moving = IsIdle - 0 & GpsActive - 1The part I am getting stumped on is how I can define routes driven. In the example above, there would have been 2 routes driven. The first route would be fromto and the second route being toBelow is an example of where I would like to take the data, with the addition of some sort of RouteID field. Any help is greatly appreciated.
I have to generate approximatively 850 Excel workbook and I was wondering if it was possible using only one Writer or if I had to use 850 Writers.I thought of the possibility of generating 850 sheets in one Excel workbook, but I would have trouble actually opening the workbook with my computer (lot of memory used).Also I work with a 2017 version of FME (I stumbled in the past on issue that could be esaily resolved with 2018, but I had to work in the limit of 2017).Thanks
I have a dgn that have attributes for some elements:these attributes i'm guessing that are from exporting a shp file to dgn directly from microstation.How can i read these attributes and if possible create new one or change the value of existing ones.Is it even possible?Inspector does not show these attributes anywhere.Readers also does not show them anywhere
Hi So I have a text document and I need to parse into specific headings and then extract that heading and all the sub text. The issue is the subtext is lettered. Is there a regex syntax that will continue to extraxt until it finds a new match? any ideas? Im using string searcher and have managed to get all this data as seperate lines, just not sure if its easier to try and find a way to put the data back together or if theres a more efficient way to parse Current using syntax: chicken{1}\\s|(. Example: I need every line that starts with "chicken" the chickens name and all the numbered lines below TEXT TEXT TEXT TEXT TEXT TEXT TEXT TEXTTEXT TEXT TEXT TEXT TEXT TEXT TEXT TEXTChicken: Rene(1) lays three eggs a day(2) escaped two weeks agoTEXT TEXT TEXT TEXT TEXT TEXT TEXT TEXTChicken: Stacey(1) etcand so on
I'm trying to send a message to the websocket server on my FME Cloud instance. I can successfully transmit the following: {"ws_op" : "send","ws_msg" : "hello"} But I want to send a JSON message as "ws_msg", so I tried: {"ws_op" : "send","ws_msg" : fme_get_attribute("payload")} Which isn't received on the other end, similarly to if we have an incorrect message, i.e. without the "send message"-format from the documentation of the WebSocketSender. I would guess it's something with the quotes around the message, but I am unable to escape quotes in the message formatting window. So, how can I send a JSON message (Payload-attribute attached) to a websocket using FME? { "type": "Feature", "properties": { "icon-image": "pulsing-dot-blue"}, "geometry": { "type": "Point", "coordinates": [ 17.3016102, 59.6615453 ] } }
Hi,I am in the process of creating a workbench to transform geotagged jpegs into KMLs. Ideally I want my photos to popup in google earth balloons at the location they were taken at. In order to do this I first need to extract the exif geographical information i.e.latitude, longitude, altitude, bearing etc. I would've thought that KML viewsetter would be the right tool for this however when I fill in the location fields with the appropriate exif information the KML still defaults to latitude 0, longitude 0. I'm quite sure I've got the right parameters "jpeg_exif_gpslongitude", "jpeg_exif_gpslatitude" etc. but it's not working for me.Any ideas from the community?Thanks,Mike
Is it possible with FME Desktop?LAS (LiDAR) to OBJ (Wavefront) to FLT (OpenFlight) with textures???Thanks
Greetings, I´m getting a strange error when trying to generate a PDF in 2019.2.0.0 version (Build 19752 - WIN64 or Build 734 - win32). The same flow works perfectly in version 2018.1.2.0 Build 18590 - WIN32, and we are planning to migrate to the new version soon but in our tests we enconter this error. For some unknow reason, in this example,some polygon near the "LTP" and "FTP" entrances in the 2nd table are dissapearing. In my original flow (not this sample), this behavior occurs in the polygons in the middle of table, so I don´t think it´s a problem related of the fact of be one of the last rows. I generated a small flow with the same problem to reproduce the situation for your avaliation. Thanks a lot for the help.
Hello there!If I want to use the newest FME Desktop functions (v2019) with an old FME Server (let's say v2017), do you think it would be possible to publish on my server a worskspace created on FME Desktop 2017 who will call (with a SystemCaller or whatever) a batch file that will run FME Desktop 2019?Batch file line command example"C:\apps\FME2019.1\fme.exe" "\\NASASERVER\c$\FME\Workbench\Talk2Aliens\SolutionHere.fmw"First of all, is that legal? Does Safe permit that?Secondly, would that work?Thanks!
Hi, Could anybody tell me if this possible with FME please? I'm new to using ESRI Portal Items and FME .I have a Feature service on Portal published via arcgis server from an enterprise geodatabase in Oracle, I wish to create views of this data in Portal by Fanout on an attribute value. e.g a Feature service of Polygons with and attribute of Sheet_no, I'd like to create a Portal item for a definition query on the master layer for each group of unique Sheet_no values, giving these items a new name based on the original item name + the Sheet_no... The data cannot be duplicated and the view must reference the original service and data source.This apparently can be done using the Portal Python API .... but I'd like to see if it can be done in FME. Any pointers are appreciated RegardsPaulg
We have an Oracle (Locator) Database, where we have stored geometric objects that were generated through Microstation. The database also contains attributes pertaining to the symbology of the objects. These attributes are:- a style column which contains a number- an angle column, which is set to 0 for non- point geometries- X-scale column, which is set to 0 for non point-geometries-Y- scale column, which is set to 0 for non point-geometries-a cellname column, which is null for non point geomtries, but contains the name of the DGN cell/symbology used for point geometriesPosting these attributes to another database (PostGIS for example) is not a problem. However, when reading this database in another (GIS) application, how do I get to see the same symbology?Is it something I need to set in the FME workspace, by setting somewhere that these attributes need to be interpreted as special symbology attributes? Or is it something I need to set within the GIS application itself?How do I even go
Does FME Server support Microsoft Exchange Server for notification emails?
I noticed in the applications and formats supported page that AutoCAD Object Data tables (AutoCAD Map 3D) are not able to read in when using FME Cloud - in my workbench on my desktop this reader works great in getting the additional information stored there so seeing if there is an alternative or workaround in being able to get that data while using FME Cloud
Hi, I have .rvt file which is created with DUB DLTM projection system, I do not see the feature on the correct location in FME inspector, or in ArcMap after transforming the file into multipatch file geodatabase.I can see the feature on correct location when adds the file directly into ArcGIS Pro but facing issue with FME.I am using FME 2019.1, which allows direct reading of .rvt file, no need to convert .rvz or ifcLooking for a solution.
An operator is thinking of migrating to Oracle on premise ExaCC with Oracle 12c. I have not worked with an on premise version yet and wanted to know if anyone has seen issues. The operator is a heavy user of FME Server and Desktop.