Data

Hi Folks I have a question of a customer. He tried a very simple manipulation : Updating a data in a Oracle Non spatial writer, by adding a column, but do not succeed. In the writer, there is the column information, that has to contain fiels to be updated. But we don't find where encoding the key field ...  In old versions, there was a line indicating clearly, the key field of the table, to match. ANy idea or truck ?

Hi,Every time I try to remove a reader, my workbench crashes. Are there users with the same problem who has a solution?I use version 2019.0.ThxNathalie   

Dear FME's specialists,I try to validate the geometry of a cityGML file generated with another software than FME. It's a data city Model - LOD2 standards...I use the geometry validator transformer + parameter for the issues detected= "Surface and Solid". I get some errors (non 2-manifold + invalid solid boudaries), but I can't find the issues in the data itself.I have the feeling that the points generated via the port IssueLocation are not located at the right place when errors are about a volume? Somebody has similar observation?Geoffrey

I am loading a shapefile into smallworld and am struggling getting the values to populate in the smallworld object. The data type on the shapefile (reader) is a "number" and the data type on the smallworld object (writer) is an INT..... is there a transformer I need to use to conver this "number" to an "int"?

I am very new to FME. I'm trying to understand how to format where data is placed within my CSV output. I'm reading specific elements in an XML file and writting it as a CSV. I almost have it working, however it is writting it in the below format. How to I fix the formatting so that the values fit on the same rows, eliminating the blank spaces?

Hi, I have Mapinfo projects and want to use them in QGIS.The .tab file is no problem to read. But I don´t get the style definition from the mapinfo file. Is there any possibility to transform mapinfo files to the sld format? Or is there another way to get the style informations from a mapinfo file? Thanks and best regards

Hello,We have incoming data from terrestial laser scanners in E57 format. My question is about reading/keeping point coordinates in spherical format as we write data back to E57. Problem is, that E57 reader seems not to read spherical coordinates in the first place.In FME I'd be only renaming geometry names. The only reason why we want to keep spherical coordinates is use of Autodesk ReCap's RealView visualization mode.E57 reader only finds following components;Components (7)x Int32, Scale: 1e-5y Int32, Scale: 1e-5z Int32, Scale: 1e-5intensity Real32, Min: 0, Max: 1rowIndex Int16, Min: 0, Max: 2366columnIndex Int16, Min: 0, Max: 10119cartesianInvalidState Int8 Reader does not show more components to be available.Inspector view: The same cloud is recognized to have spherical coordinates in ReCap. I've tried with two different scanner data on FME 2019.0 19238 with same results.iHow could I debug this data with FME to read spherical coordinates?

I am using SQL creator to initially query a Oracle dB.I am using a few transformers and writing my results in a PostGIS db.I however notice that the accents (french) don't survive this transformation.Is there a way I can pass the encoding along?

Hello,I have a table with many columns stored in a postGIS dB.These include:-transformed data-data extracted from an oracle dBThe columns have been renamed and transformed in the PostGIS table.There are a certain amount of columns I wish to update with data contained in a Oracle dB.What is the best way to drop data in certain columns of my PostGIS table and repopulate it with data from the oracle dB?Thank you

I have an oracle table which is supposed to be type 3003 but has a type 3007 in it somewhere.  How can I test for type 3007, multi-polygon? I'm running 2012 SP 2 build 12238 64 and 2013 SP4 build 13547.   Cheers,

I wrote a (Dutch) blog post to explain how you can download data using the ArcGIS REST API, in particular how to do multiple requests when the number of features you want exceeds the server limit.@arnovananrooij pointed out to me that the Esri ArcGIS Server Feature Service reader does the job very efficiently. As I wrote the post also for readers that do not use FME Desktop, I wondered which requests FME does 'under the hood'.As it turns out, FME first does one POST request to get all objectIds (the server limit is not a problem for this request):Endpoint:https://www.gdngeoservices.nl/arcgis/rest/services/blk/lks_blk_rd/MapServer/1/query?f=jsonBody:where=1=1&outSR=28992&returnIdsOnly=TrueNext, FME does multiple POST requests to get all the data. For every new request the objectIds in the `where` query parameter are updated in order to get the next batch of 1.000 features:Endpoint:https://www.gdngeoservices.nl/arcgis/rest/services/blk/lks_blk_rd/MapServer/1/query?f=jsonBody:obje

Is there a way to autoscan for new excel files in a folder and then load them into SQL Server tables depending on the name.

Hi,I am running on Windows 10, FME Desktop 2018.1 writing from ArcSDE Environment to a File Geodatabase.If i write directly over I find the SDE Editor (NCGIS_GIS) is written into the name of the dataset (Roads), if I change the dataset (Roads-->Road) than the SDE parent prefix is not written out. I am unable to determine how to remove the Parent SDE naming from the dataset and I have 550 feature classes to migrate over that I do not want to manually (via user parameter) set.Thanks!

Hi,I have a strange issue when writing data using the FeatureWriter (Build 19238 - WIN64). This is possibly something stupid I'm missing.I am reading from various PostGIS tables, performing a clip and then writing out to other new PostGIS tables in a different schema. This part is fine.Later in the process I read these newly created PostGIS tables, perform some Geomertry validations on the data and then overwrite the tables I've just read from. For every dataset I am losing one or two features per table when rewriting, whether that is two features going down to one, or 11,050 going down to 11,048! I have skipped the geometry validation step so I'm just reading in and writing out again and still have the same issue. I have also changed the writer to FileGDB with the same result. Just as the data goes into the FeatureWriter the correct number of features (e.g. 11,050) are going in just not all being saved.Thanks

I'm a total FME novice trying to convert an ecw (Generated from a tif) to a jpg, but it keeps failing because the jpg writer cannot support more than 3 bands.... What are these bands and how do i get around this problem? I just need a straight forward jpg.. no coordinates. Thanks in advance for your help..

I am able to write inspire GML (it validates, too). I do it in FME. Now I would like to write that gml directly to the postgresql database (add postgresql writer), so that i have the entire data flow in one workspace, but i cannot join two writers (inspire gml writer and postgresql writer) together... I am very new to FME.

Hi, we are coming up against an issue now that is now a real blocker to our workflow. We are running a workbench attached on FME cloud which picks up content in postgis and writes to fgdb. The problem is at random - (honestly) it will fail with the error:Geodatabase Error (-2147220987): The user does not have permission to execute the operation.If you run the task again specifically running on the feature it failed on, it will run no problem.I know there are other cases of this reported, however when we run locally there is no issue.https://knowledge.safe.com/questions/45200/writing-esri-file-geodatabase-issue.html https://knowledge.safe.com/articles/362/workspace-fails-on-fme-server-when-using-unc-paths.html @brianatsafe @david_r @mark2atsafe have all commented on this error before, reading through I can't see any issues that relate - as we are running as superuser and also have tested locally.The two logs attached outline the error, the larger log, is for running a very big task

Hello! I have to transform a PointCloud Dataset (LAS) from EPSG 31256 to EPSG 4326. Therefore I used the transformer CSMapReprojector. My output PointCloud always looks like this: This was the Input dataset:  Thanks for your suggestions.    

I am trying to connect to a hosted feature service in our GIS Portal. I am receiving the following error:..."Check your credentials and try again. The error code from the server was '400' and the message was: 'Unable to generate token.' A fatal error has occurred. Check the logfile above for details"...I am using our fully qualified domain name with /sharing/rest/generateToken with our service account credentials.Ideas??Thanks,--gary

I Want to know More aboutWhat is a Point Cloud? What is LiDAR?  I Need Brief Clarification i have Seminar on this topic. your Answers would be appreciated.

@takashiHi I am using an SQLCreator to return all incidents reported in the last hour. I then want to use an XML file to define levels for each alarmtype, which determine whether an alert record is created depending on the type of incident and count e.g. <incidentype name="gasleak" level="1,5,10"/><incidenttype name="electricityinterruption" level="1,3,10"/> therefore for gasleak, an alarm record is created if count of incidents is as follows:count alarmcreated Level AlarmTime 2 Yes 14 No N/A7 Yes 511 Yes 10Note when count=4, no alarm is created as level 1 alarm has already been created.So far, I have added an XML reader and use FeaturePaths. I have also obtained the count of incidents for the last hour using SQLCreator. Any suggestion how FeaturePaths could be used in this case? Is pythonXML the b

I've just started using FME. We have a few feature-services in ArcGIS Online with a lot of features (+/- 150.00). We are creating replica's every night on our server by using a Python script from esri. In essence the script works fine. But the replica's fail at least half the time because of time-outs, or sudden server error's on esri's side. I want to know if we can replace some of our workflows by using FME. I've created a script that reads the AGOL feature service and checks for changes/new features. This gets written to our Postgres database. The script works fine, but again, I get the same errors.I've changed the batch size to 10 features, but no luck. There's an option in the reader to start reading from a certain feature. I thought this might be a solution, but it still starts from 0 (maybe it's not reading / downloading it, but it still runs every 10 features. The corresponding log is: "ArcGIS Online Feature Service Reader: Getting featu

Hi I'm loading data from an ESRI .gdb file geodatabase into an Oracle database. When I run the .fmw script from Windows, the date loads fine into an Oracle table 'date' field (e.g. 06/22/2019). But when i run the same .fmw script from Linux FME Desktop, the date in oracle (same oracle db) is messed up (e.g. 02/12/1937). Anyone know how to fix? NOTE: Windows is FME Desktop 2017.1.2.1 Win 32, Linux version = FME 2017.0.1.1 (linux-x64). The .fmw script used was created from the Windows FME Desktop. All other fields seem to load just fine.

Hello,  I want to write a dwg with several layer. In layer i can have block, points or Text. How can i do to order the objects in a systemaic way?  Bernard Dinon

I can not just copy the curl command from kibana and paste it into the FME transformer. Can you please provide me helpful sites, links, where i can learn how to tone it down to one liner query to use in FME transformers?For example, in kibana console, the following code gives me the documents that matches company_name=shell. But, if I need the same result in FME, i have to use FeatureReaders/httpcaller/elasticReader with the query: GET /prod_gffp_filings/_search?q=COMPANY_NAME:chevron  GET prod_gffp_filings/_search?pretty{ "query": { "match": { "COMPANY_NAME": "Shell" } } }