Data

I have some LIDAR data to work with, but need to removal artifacts, noise and add classification. Does FME deliver the appropriate tools to do this?

Hello,I would like my FME script to download some data directly from OSM (probably using Overpass) when executed. At first I wanted to get the result from a specific Overpass QL request (using HttpCaller ?), but I don't know how to do that.I have tried the OSMDownloader, but the resulting file has no geometry ... And even if it would work, how to wait for the file to be entirely written before reading it with a reader ? Or is there any other way to do that ?I also tried a solution from friesewoudloper, but I don't understand the XSL template (XSLProcessor) and how to use it the way I want ...Any help with that issue would be much appreciated :)  Thanks in advance

I'm using FME Desktop 64-bit (v 2017.1.2.1) and trying to read a large CSV file (approx 1gb and 60 million records) into a PostgreSQL database table with no geometry involved. The only transformers I am using are an attributerenamer to map the fields and two expressionevaluators to calculate KM/hr and Metres/Sec from Miles/Hour (see below).My issue is that running the workbench consumes most of the 8GB RAM available on the VM and this appears to be due to the CSV reader reading in all the records prior to the first transformer (the attributerenamer). I ran the workbench overnight and it failed due to an FME app crash at approx. 52 million records processed and I'm assuming this was memory related as the last few lines of the log are: 2018-03-03 01:20:55|17816.4| 1.0|STATRP|AttributeRenamer(AttrSetFactory): Processed 52421236 of 59977315 features2018-03-03 01:20:56|17818.1| 2.8|STATRP|ResourceManager: Optimizing Memory Usage. Please wait...2018-03-03 01:20:56|17818.1| 2.8|IN

Hi advanced experts~Just reading of my kmz file generating error message in a row as follows;HTTP transfer summary - status code: 200, download size: '20 bytes', DNS lookup time: '1e-6 seconds', total transfer time: '0.266 seconds', url: 'http://cloudrf.com/API/ppa/rx.php?uid=20574&f;=0220003602_Dairy_Flat_1a.4326&'KML: The file `C:\\FME_TEMP\\FME_OGCKML_DLTEMP_1520219068411_14984\\FME_KML_1520219072179_14984\\rx.php' has an invalid or unsupported extension `php'KML: The url `http://cloudrf.com/API/ppa/rx.php?uid=20574&f;=0220003602_Dairy_Flat_1a.4326&' was downloaded, but the resulting file, with mime-type`text/html', does not appear to be a supported file typeany experience in this?please your experience..ThanksDavid

I want to read csv files with different schemas but with some attributs which are part of all csv files:file1in: attribute1, attribute2, attributeA, attributeB, attributeCfile2in: attributeD, attributeE, attribute1, attribute 2, attributeF, attributeGThen I want to do some processing and write the files with some additional attributes to new files:file1out: attribute1, attribute2, attributeA, attributeB, attributeC, attributeX, attributeYfile2out: attributeD, attributeE, attribute1, attribute 2, attributeF, attributeG, attributeX, attributeYFile names for output are the filenames of input with additonal postfix like "_transformed":<filename1in> => <filename1in>+"_transformed" (<filename1out>How can I do this? I have tried to use a csv writer with dynamic properties but then I get resulting filenames of "CSV". If I change the feature type names from "format names" to "file names" in the csv reader, then I get the fil

I have tried using the old SDE connection file and created new SDE connections. Both fail when using the FME reader Esri Geodatabase (ArcSDE Geodb). The following is the error message I receive:================================Opening the Geodatabase readerThe ArcObjects license 'Advanced' is being selected from the ESRILicenseInfo ArcObjects callFME has checked out an Esri license. The product checked out is 'Advanced'Installed ArcGIS version is '10.4'Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147209112'. The error message from ArcObjects is: {FDO error: -2147209112}Please ensure the connection parameters are correct (server=`gisnas1', instance=`sde:sqlserver:gisnas1', user=`***', password=`***', database=`Cadastral_SDE', version=`sde.DEFAULT')A fatal error has occurred. Check the logfile above for detailsFailed to obtain any schemas from reader 'GEODATABASE_SDE' from 1 datasets. Th

Hello , i got textured CityGML files and converted them to .b3dm format using FME.But when i visualize them on Cesium , its becoming amazingly slow.I dropped quality of textures and gzipped them but still same problem occuring.Here is link for CityGML files: https://www.dropbox.com/s/1dbf9gvmatbvem3/cesme_citygml.rar?dl=0 And for converted 3DTiles https://www.dropbox.com/s/7lh01wo25dqzarf/cesme_3dtiles.rar?dl=0I would be so appreciated if you can solve my problem.

Hi,My question is: how do I do this? I have a ECW file which is clipped using the clipper transformer. The output needs to be stored in a postgres database. It has postgis installed.When I inspect the clipper output I see the right aerial photo in the data inspector. Do I need to use the postgres writer, postgis or postgis raster? I tried all three, and I don't get any error messages when running the workbench. But when I try to read the data back out, I get a whole lot of nothing, and a weird raster of pixel without a photo.Has anyone done this? Does anyone know how to do this. Please let me know what info you need from me (I recently started working where I currently work so I'm still learning the ropes). Thanks! 

Hey all,Just wondering if anyone has figured out how to write a brand new google sheet to a folder?I have the following file and folder directory structure:My Drive/My Drive/Statistics/My Drive/Statistics/2017 <---googlesheetI want fme to create the google sheet, '2018' in the "My Drive/Statistics/" folder automatically (without user intervention), but no matter if I include the string "My Drive/Statistics/" or the folder ID & "/" , it always writes the new sheet to the root of My Drive. If the Google Sheet already exists, this is not a problem.

Does FME support migrating Smallworld Dimensions to the ESRI Dimensioning Feature Class?

Is FME already capable of working with a Service Desk / Ticketing type application?  Right now I am researching applications that I could use to manage emails & tickets (tasks). An idea (or hope) I have is for a user to email a zip file to a ticketing system, and then FME Server could be triggered to work along side the ticketing application to do some work with the zip file. We currently don't have a ticket management system, and so I am open to suggestions. Some cloud applications that I have seen online are: Zendesk, Freshdesk, or Freshservice.Thank you for your time,

I have 1.6TB of .tif files. Each file (11,500 of them) are named numerically and stored in individual .zip files. I need to convert all of the .tif files to JPEG2000. So far I ran the tif to Jpeg2000 reader/writer through the batch Deploy on small test runs of 10 files and it worked just fine. But when I run the full meal deal FME freezes. Please Advise

I have a FeatureReader for WFS. Because I want it to work with any WFS source I have parameterised the Dataset and "Feature types to read" fields and set the output to Single Output port.This means that I have to use the Generic output port.Further down the workspace I have some transformers that do logging. I have a ListBuilder followed by a ListElementCounter, so I can log the number of records returned by the WFS service. I also have an UpdateDetector with the same arrangement.Before I started using the generic output port, everything was OK. But since I have used the Generic port, some ListElementCounters are showing problems. (The one connected to the WFS reader and also the one connected to the Unchanged port of the UpdateDetector. Others are OK.) The ListAttribute fields are showing up as red and they don't seem to be able to read the _list{} attribute that should be supplied by the ListBuilder.If I run the workspace, it seems to still work, but of course I get a w

I am trying to create a workflow that would update an existing table in a file geodatabase. It works when i have feature operation set to "Insert" and Table Handling set to "Create If needed" under Format Parameters. When I try to change the Table Handling setting to "Truncate Existing", the workflows fails and errors outError:"Geodatabase Error (-2147220987): The user does not have permission to execute the operation.FileGDB Writer: A feature could not be written"

I am searching for a method to take an XML based array and insert each array value into a new record. Currently my workspace parses non-array XML tags\\variable and inserts them into one single SQL record, but now I need a one to many relationship. The number of array items is indefinite.  The use case is that we get field inspections in the form of an XML document that gets inserted into our SQL database (various tables - all 1:1). We now want to start registering file\\photo attachments to a reference table, however the photos are stored in an array (not a simple 1:1 insert).  Has anyone accomplished this? Idea would be much appreciated. Thanks!

I have a raster in which I need to change the vertical datum. I tried using the CSMapReprojector but it didn't work. It looks like FME just always sees the Raster at 2D when I view it in the Data Inspector. Is this a bug?

Is it possible to get AutoDesk BuzzSaw reader?

I may have encountered an issue with reading Excel sheets with attribute names that start with parts of existing FME format attribute names.My first experience with this was while using the SchemaMapper transformer, but when I investigated the Excel reader, I noticed similar behaviourThe attribute names I wanted to use were:fme_geometry_namefme_type_nameIf a sheet with these attribute names is loaded into the SchemaMapper transformer or the Excel reader, I notice the following behaviour:SchemaMapper Dataset can be loaded and Parameter window works as expected. When clicking Next, a popup with 'Reading Dataset' appears and disappears very quickly. I am not able to finish the SchemaMapper wizard.Excel Reader Dataset can be loaded, but after completing the Add Reader wizard, the FeatureType object on the canvas does not contain the added attributes.When repeating the process with the following attribute names, everything behaves as expected:geometry_name_fmetype_name_fmeMy impress

Hi gents and ladies,I'm trying to move my GIS in cloud:) unfortunately I didn't find the information about how can I add files stored on FME-Cloud to AGOL.F.e. I have the Vessels.kml file in Data folder on FME-Cloud/Resources and I want to add this file to AGOL. Is it possible or not?Thanks in advance.

When will an exporter plugin be available for Revit 2017? We here at the Denver International Airport have upgraded to Revit 2017 and updated our models. We currently are taksed with exporting our facility models from Revit to ArcGIS...

HiI'm new to JSON and GeoJSON, but I have some text for a geometry generated by Mapbox coded as GeoJSON:"{"type":"FeatureCollection","features":[{"id":"c2fc8b172269fb5b220d5661e804a7e5","type":"Feature","properties":{},"geometry":{"coordinates":[[[5.7289984618329015,58.97117391031097],[5.727435803187348,58.97244926566199],[5.725808033947516,58.97459712581869],[5.728542686566385,58.97520118738589],[5.729714680561443,58.974630685071816],[5.728868240463584,58.973858813964995],[5.728314798897173,58.9731876075123],[5.729193794339011,58.972449265591706],[5.730040234436871,58.971274597908206],[5.7289984618329015,58.97117391031097]]],"type":"Polygon"}}]}"In my workspace I have added a creator with an attribute containing this text. I the add a Geometry-replacer and choose GeoJSON. Upon running the workspace I get syntax errors.JSONFragmenter(JSONQueryFactory): A

Hi,We have FME Server 2017.1 with lots of scheduled tasks and sometimes, for several reasons, some of them fails.Do you know if it's possible to tell FME Server to run the process (for some workbench only) a second time if the first time it failed?Exemple : I have a scheduled task supposed to run at midnight but for a reason it fails. FME could try to run automatically an hour later the same process with success, or not. If not, it could stop there, or try an hour later a third time or indefinitely, until it succeed.So, is that possible or I'm dreaming?

Hi,When will the File GDB open API be able to read and write a File Geodatabase without completely locking down the database? We find that only one bench can be in a File Geodatabase when using the OPEN API reader and writer, else we will start getting failures.When using the ESRI GDB reader/writer, you can have as many operations occurring simultaneously as you want in a File GDB, as long as no one is trying to drop and create a table that is currently in use.When will the OPEN API be able to do the same?Thanks!

Will the IFCGUID value differs for a building model entity say IFCProject for LOD200 and LOD300?

hi , i am getting below error while connecting SQL Server from FME desktop ,  Making a direct connection using instance 'sde:sqlserver' and userId = 'username' Error connecting to instance 'sde:sqlserver' for database 'sde' on server '!not_used!' for user 'eifme'.:SDE_ERROR_CODE(-324) Cannot connect to database because the database client software failed to load.  Be sure the database client software is installed and configured correctly.. Error connecting to instance 'sde:sqlserver' for database 'sde' on server '!not_used!' for user 'eifme'.:SDE_ERROR_CODE(-92) Bad connection handle  Currently using Arcgis 10.2.1   any idea...