Data

Hello,We have incoming data from terrestial laser scanners in E57 format. My question is about reading/keeping point coordinates in spherical format as we write data back to E57. Problem is, that E57 reader seems not to read spherical coordinates in the first place.In FME I'd be only renaming geometry names. The only reason why we want to keep spherical coordinates is use of Autodesk ReCap's RealView visualization mode.E57 reader only finds following components;Components (7)x Int32, Scale: 1e-5y Int32, Scale: 1e-5z Int32, Scale: 1e-5intensity Real32, Min: 0, Max: 1rowIndex Int16, Min: 0, Max: 2366columnIndex Int16, Min: 0, Max: 10119cartesianInvalidState Int8 Reader does not show more components to be available.Inspector view: The same cloud is recognized to have spherical coordinates in ReCap. I've tried with two different scanner data on FME 2019.0 19238 with same results.iHow could I debug this data with FME to read spherical coordinates?

I am using SQL creator to initially query a Oracle dB.I am using a few transformers and writing my results in a PostGIS db.I however notice that the accents (french) don't survive this transformation.Is there a way I can pass the encoding along?

Hello,I have a table with many columns stored in a postGIS dB.These include:-transformed data-data extracted from an oracle dBThe columns have been renamed and transformed in the PostGIS table.There are a certain amount of columns I wish to update with data contained in a Oracle dB.What is the best way to drop data in certain columns of my PostGIS table and repopulate it with data from the oracle dB?Thank you

I have an oracle table which is supposed to be type 3003 but has a type 3007 in it somewhere.  How can I test for type 3007, multi-polygon? I'm running 2012 SP 2 build 12238 64 and 2013 SP4 build 13547.   Cheers,

I wrote a (Dutch) blog post to explain how you can download data using the ArcGIS REST API, in particular how to do multiple requests when the number of features you want exceeds the server limit.@arnovananrooij pointed out to me that the Esri ArcGIS Server Feature Service reader does the job very efficiently. As I wrote the post also for readers that do not use FME Desktop, I wondered which requests FME does 'under the hood'.As it turns out, FME first does one POST request to get all objectIds (the server limit is not a problem for this request):Endpoint:https://www.gdngeoservices.nl/arcgis/rest/services/blk/lks_blk_rd/MapServer/1/query?f=jsonBody:where=1=1&outSR=28992&returnIdsOnly=TrueNext, FME does multiple POST requests to get all the data. For every new request the objectIds in the `where` query parameter are updated in order to get the next batch of 1.000 features:Endpoint:https://www.gdngeoservices.nl/arcgis/rest/services/blk/lks_blk_rd/MapServer/1/query?f=jsonBody:obje

Is there a way to autoscan for new excel files in a folder and then load them into SQL Server tables depending on the name.

Hi,I am running on Windows 10, FME Desktop 2018.1 writing from ArcSDE Environment to a File Geodatabase.If i write directly over I find the SDE Editor (NCGIS_GIS) is written into the name of the dataset (Roads), if I change the dataset (Roads-->Road) than the SDE parent prefix is not written out. I am unable to determine how to remove the Parent SDE naming from the dataset and I have 550 feature classes to migrate over that I do not want to manually (via user parameter) set.Thanks!

Hi,I have a strange issue when writing data using the FeatureWriter (Build 19238 - WIN64). This is possibly something stupid I'm missing.I am reading from various PostGIS tables, performing a clip and then writing out to other new PostGIS tables in a different schema. This part is fine.Later in the process I read these newly created PostGIS tables, perform some Geomertry validations on the data and then overwrite the tables I've just read from. For every dataset I am losing one or two features per table when rewriting, whether that is two features going down to one, or 11,050 going down to 11,048! I have skipped the geometry validation step so I'm just reading in and writing out again and still have the same issue. I have also changed the writer to FileGDB with the same result. Just as the data goes into the FeatureWriter the correct number of features (e.g. 11,050) are going in just not all being saved.Thanks

I'm a total FME novice trying to convert an ecw (Generated from a tif) to a jpg, but it keeps failing because the jpg writer cannot support more than 3 bands.... What are these bands and how do i get around this problem? I just need a straight forward jpg.. no coordinates. Thanks in advance for your help..

I am able to write inspire GML (it validates, too). I do it in FME. Now I would like to write that gml directly to the postgresql database (add postgresql writer), so that i have the entire data flow in one workspace, but i cannot join two writers (inspire gml writer and postgresql writer) together... I am very new to FME.

Hi, we are coming up against an issue now that is now a real blocker to our workflow. We are running a workbench attached on FME cloud which picks up content in postgis and writes to fgdb. The problem is at random - (honestly) it will fail with the error:Geodatabase Error (-2147220987): The user does not have permission to execute the operation.If you run the task again specifically running on the feature it failed on, it will run no problem.I know there are other cases of this reported, however when we run locally there is no issue.https://knowledge.safe.com/questions/45200/writing-esri-file-geodatabase-issue.html https://knowledge.safe.com/articles/362/workspace-fails-on-fme-server-when-using-unc-paths.html @brianatsafe @david_r @mark2atsafe have all commented on this error before, reading through I can't see any issues that relate - as we are running as superuser and also have tested locally.The two logs attached outline the error, the larger log, is for running a very big task

Hello! I have to transform a PointCloud Dataset (LAS) from EPSG 31256 to EPSG 4326. Therefore I used the transformer CSMapReprojector. My output PointCloud always looks like this: This was the Input dataset:  Thanks for your suggestions.    

I am trying to connect to a hosted feature service in our GIS Portal. I am receiving the following error:..."Check your credentials and try again. The error code from the server was '400' and the message was: 'Unable to generate token.' A fatal error has occurred. Check the logfile above for details"...I am using our fully qualified domain name with /sharing/rest/generateToken with our service account credentials.Ideas??Thanks,--gary

I Want to know More aboutWhat is a Point Cloud? What is LiDAR?  I Need Brief Clarification i have Seminar on this topic. your Answers would be appreciated.

@takashiHi I am using an SQLCreator to return all incidents reported in the last hour. I then want to use an XML file to define levels for each alarmtype, which determine whether an alert record is created depending on the type of incident and count e.g. <incidentype name="gasleak" level="1,5,10"/><incidenttype name="electricityinterruption" level="1,3,10"/> therefore for gasleak, an alarm record is created if count of incidents is as follows:count alarmcreated Level AlarmTime 2 Yes 14 No N/A7 Yes 511 Yes 10Note when count=4, no alarm is created as level 1 alarm has already been created.So far, I have added an XML reader and use FeaturePaths. I have also obtained the count of incidents for the last hour using SQLCreator. Any suggestion how FeaturePaths could be used in this case? Is pythonXML the b

I've just started using FME. We have a few feature-services in ArcGIS Online with a lot of features (+/- 150.00). We are creating replica's every night on our server by using a Python script from esri. In essence the script works fine. But the replica's fail at least half the time because of time-outs, or sudden server error's on esri's side. I want to know if we can replace some of our workflows by using FME. I've created a script that reads the AGOL feature service and checks for changes/new features. This gets written to our Postgres database. The script works fine, but again, I get the same errors.I've changed the batch size to 10 features, but no luck. There's an option in the reader to start reading from a certain feature. I thought this might be a solution, but it still starts from 0 (maybe it's not reading / downloading it, but it still runs every 10 features. The corresponding log is: "ArcGIS Online Feature Service Reader: Getting featu

Hi I'm loading data from an ESRI .gdb file geodatabase into an Oracle database. When I run the .fmw script from Windows, the date loads fine into an Oracle table 'date' field (e.g. 06/22/2019). But when i run the same .fmw script from Linux FME Desktop, the date in oracle (same oracle db) is messed up (e.g. 02/12/1937). Anyone know how to fix? NOTE: Windows is FME Desktop 2017.1.2.1 Win 32, Linux version = FME 2017.0.1.1 (linux-x64). The .fmw script used was created from the Windows FME Desktop. All other fields seem to load just fine.

Hello,  I want to write a dwg with several layer. In layer i can have block, points or Text. How can i do to order the objects in a systemaic way?  Bernard Dinon

I can not just copy the curl command from kibana and paste it into the FME transformer. Can you please provide me helpful sites, links, where i can learn how to tone it down to one liner query to use in FME transformers?For example, in kibana console, the following code gives me the documents that matches company_name=shell. But, if I need the same result in FME, i have to use FeatureReaders/httpcaller/elasticReader with the query: GET /prod_gffp_filings/_search?q=COMPANY_NAME:chevron  GET prod_gffp_filings/_search?pretty{ "query": { "match": { "COMPANY_NAME": "Shell" } } }

Just using the sample file rac_advanced_sample_project.rvt Even not in data inspector, it does read most of it correctly, but not glass.  Where it should looks like this:  So is there any more features that not currently be supported?

Howdy,Two questions: 1) Is there a method for using a Tester like transformer to identify if a "JPEG datastream" contains an image or not prior to a record reaching the RasterReplacer. Details below.2) Purely out of curiosity, how would I go about turning off the Translation Log error referenced in the snippet below? (...this warning can be turned as an error by setting GDAL_ERROR_ON_LIBJPEG_WARNING to TRUE) I'm processing images that were taken via Esri's AGOL Collector as attachments to a feature record. In my workflow I'm using RasterReplacer to extract the images from the AGOL data field (arcgisonline_attachment{0}.data (encoded: fme-binary)) and I have come across an issue where some images are corrupted.When these bad images reach the RasterReplacer it throws a translation error "JPEG reader: libjpeg: JPEG datastream contains no image". Full translation log error message below: 2019-05-14 14:05:48|   6.8|  0.0|WARN  |JPEG reader: libjpeg: Premature end of JPEG file (this warning 

I am working on FME 2019 in windows. I want to upload a folder on S3 bucket but do not want the parent folder to be included. Be like:C:\\abc\\xyz\\mno.zip, C:\\abc\\xyz\\nbc.zip - these zip files to be uploaded toAmazon S3\\abc\\prtand the data should be replaced with the new one(the old data exit in the folder on S3.But, when I say upload the folder, it is like- Amazon S3\\abc\\prt\\xyz\\mno.zip, Amazon S3\\abc\\prt\\xyz\\mno.zipand I want it to be like- Amazon S3\\abc\\prt\\mno.zipSo, basically no parent folder in between. Also, if I select data source to upload to file, I can only upload 1 file, not multiple.Any options to upload multiple files? Or to upload the folder but not including parent folder.Thanks.  

I have installed ArcGIS Pro 2.3.3 which uses Python 3.6 with FME Desktop 2019.0.1.0 64 bitFME log is returning error in the title with FME Translation Settings:Preferred Python Interpreter:ESRI ArcGIS Pro 2.1/2.2/2.3 Python (3.6)ArcGIS Pro is licensed to work offline.Any suggestions to get this working appreciated.

Hi, does anyone know of a nice trick to delete features (rows/records) from a shapefile. We currently do this using the delete property in feature writer but this isn't available with shapefile.We basically want to be able to delete where a property = true, the only other thing to mention is this might leave the shapefile empty, so we cant simply use a filter and a writer because FME wont write out an empty shapefile.Many Thanks,Oliver

Hi, Im trying to emulate an Alteryx process, but I dont quite know how to do it. Here is the video to show a summary of how to do it https://www.youtube.com/watch?v=nmbWf6-PFhE  And here is the test data  <area shape="poly" alt="" coords="496,172, 496,232, 566,232, 566,121, 496,172" href="BLUE"> The process is taking a shape from adobe illustrator, exporting to HTML (as above) then extracting each of the above into a csv that can be read in tableau and produce a shape.  Ideally from this <area shape="poly" alt="" coords="496,172, 496,232, 566,232, 566,121, 496,172" href="rrrr"> to this BLUE,X,496,Y,172BLUE,X,496,Y,232BLUE,X,566,Y,232BLUE,X,566,Y,121BLUE,X,496,Y,172 There maybe multiple variables in the amount of X and Y coordinates per shape. Anyone got any ideas on how to do this? Thanks Chris