Using readers and writers to extract and load data.
Recently active
Hi,I have a multi-columns table with the first column contsing the Record Id and decription of the polygon. Each record can have one or more polygons in the description where each group is separated by blank lines as shown.N1139-26 PositionCentroid : 49° 24.230'N 064° 33.127'WPt 1: 49° 41.000'N 065° 00.000'WPt 2: 49° 20.000'N 065° 00.000'WPt 3: 49° 11.001'N 064° 00.005'WPt 4: 49° 22.002'N 064° 00.005'W Centroid : 49° 05.088'N 063° 29.568'WPt 1: 49° 22.000'N 064° 00.000'WPt 2: 49° 11.000'N 064° 00.000'WPt 3: 48° 48.002'N 063° 00.005'WPt 4: 49° 00.002'N 063° 00.005'WI am able to extract the coordinates and plot the points. However I am unable to group the points to form proper polygons. Without grouping properly, they form zigzag lines.The table consists of hundreds of similar records. Can anyone suggest how to plot these correctly.Thanks.
PDF reader only reads a portion of the input fie. Source DPF below. FME Reader result:
I noticed that my connections to my FME Cloud websocket timed out after 2 minutes if no data had been transmitted. I was able to remedy the problem by creating a heartbeat that sent a message at an interval less than 2 minutes. This was a little frustrating to have to work out though.Is 2 minutes the default timeout on FME Cloud? I had no such issues when using FME Server. I'm guessing this is to do with the settings applied to the NGINX server on the Cloud instances? Is there a way to alter the default timeout, or am I stuck with the heartbeat solution? If so, can you document the default timeout issue somewhere?
I have been getting the following error message while trying to run a workflow.-"Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147216028'. The error message from ArcObjects is: {No SDEHOME environment variable set}Please ensure the connection parameters are correct (server=`sde', user=`***', password=`***', database=`', version=`')A fatal error has occurred. Check the logfile above for details."-Has anyone else come across this error message before?Thanks in advance.
Hi Folks I have a question of a customer. He tried a very simple manipulation : Updating a data in a Oracle Non spatial writer, by adding a column, but do not succeed. In the writer, there is the column information, that has to contain fiels to be updated. But we don't find where encoding the key field ... In old versions, there was a line indicating clearly, the key field of the table, to match. ANy idea or truck ?
Hi,Every time I try to remove a reader, my workbench crashes. Are there users with the same problem who has a solution?I use version 2019.0.ThxNathalie
Dear FME's specialists,I try to validate the geometry of a cityGML file generated with another software than FME. It's a data city Model - LOD2 standards...I use the geometry validator transformer + parameter for the issues detected= "Surface and Solid". I get some errors (non 2-manifold + invalid solid boudaries), but I can't find the issues in the data itself.I have the feeling that the points generated via the port IssueLocation are not located at the right place when errors are about a volume? Somebody has similar observation?Geoffrey
I am loading a shapefile into smallworld and am struggling getting the values to populate in the smallworld object. The data type on the shapefile (reader) is a "number" and the data type on the smallworld object (writer) is an INT..... is there a transformer I need to use to conver this "number" to an "int"?
I am very new to FME. I'm trying to understand how to format where data is placed within my CSV output. I'm reading specific elements in an XML file and writting it as a CSV. I almost have it working, however it is writting it in the below format. How to I fix the formatting so that the values fit on the same rows, eliminating the blank spaces?
Hi, I have Mapinfo projects and want to use them in QGIS.The .tab file is no problem to read. But I don´t get the style definition from the mapinfo file. Is there any possibility to transform mapinfo files to the sld format? Or is there another way to get the style informations from a mapinfo file? Thanks and best regards
Hello,We have incoming data from terrestial laser scanners in E57 format. My question is about reading/keeping point coordinates in spherical format as we write data back to E57. Problem is, that E57 reader seems not to read spherical coordinates in the first place.In FME I'd be only renaming geometry names. The only reason why we want to keep spherical coordinates is use of Autodesk ReCap's RealView visualization mode.E57 reader only finds following components;Components (7)x Int32, Scale: 1e-5y Int32, Scale: 1e-5z Int32, Scale: 1e-5intensity Real32, Min: 0, Max: 1rowIndex Int16, Min: 0, Max: 2366columnIndex Int16, Min: 0, Max: 10119cartesianInvalidState Int8 Reader does not show more components to be available.Inspector view: The same cloud is recognized to have spherical coordinates in ReCap. I've tried with two different scanner data on FME 2019.0 19238 with same results.iHow could I debug this data with FME to read spherical coordinates?
I am using SQL creator to initially query a Oracle dB.I am using a few transformers and writing my results in a PostGIS db.I however notice that the accents (french) don't survive this transformation.Is there a way I can pass the encoding along?
Hello,I have a table with many columns stored in a postGIS dB.These include:-transformed data-data extracted from an oracle dBThe columns have been renamed and transformed in the PostGIS table.There are a certain amount of columns I wish to update with data contained in a Oracle dB.What is the best way to drop data in certain columns of my PostGIS table and repopulate it with data from the oracle dB?Thank you
I have an oracle table which is supposed to be type 3003 but has a type 3007 in it somewhere. How can I test for type 3007, multi-polygon? I'm running 2012 SP 2 build 12238 64 and 2013 SP4 build 13547. Cheers,
I wrote a (Dutch) blog post to explain how you can download data using the ArcGIS REST API, in particular how to do multiple requests when the number of features you want exceeds the server limit.@arnovananrooij pointed out to me that the Esri ArcGIS Server Feature Service reader does the job very efficiently. As I wrote the post also for readers that do not use FME Desktop, I wondered which requests FME does 'under the hood'.As it turns out, FME first does one POST request to get all objectIds (the server limit is not a problem for this request):Endpoint:https://www.gdngeoservices.nl/arcgis/rest/services/blk/lks_blk_rd/MapServer/1/query?f=jsonBody:where=1=1&outSR=28992&returnIdsOnly=TrueNext, FME does multiple POST requests to get all the data. For every new request the objectIds in the `where` query parameter are updated in order to get the next batch of 1.000 features:Endpoint:https://www.gdngeoservices.nl/arcgis/rest/services/blk/lks_blk_rd/MapServer/1/query?f=jsonBody:obje
Is there a way to autoscan for new excel files in a folder and then load them into SQL Server tables depending on the name.
Hi,I am running on Windows 10, FME Desktop 2018.1 writing from ArcSDE Environment to a File Geodatabase.If i write directly over I find the SDE Editor (NCGIS_GIS) is written into the name of the dataset (Roads), if I change the dataset (Roads-->Road) than the SDE parent prefix is not written out. I am unable to determine how to remove the Parent SDE naming from the dataset and I have 550 feature classes to migrate over that I do not want to manually (via user parameter) set.Thanks!
Hi,I have a strange issue when writing data using the FeatureWriter (Build 19238 - WIN64). This is possibly something stupid I'm missing.I am reading from various PostGIS tables, performing a clip and then writing out to other new PostGIS tables in a different schema. This part is fine.Later in the process I read these newly created PostGIS tables, perform some Geomertry validations on the data and then overwrite the tables I've just read from. For every dataset I am losing one or two features per table when rewriting, whether that is two features going down to one, or 11,050 going down to 11,048! I have skipped the geometry validation step so I'm just reading in and writing out again and still have the same issue. I have also changed the writer to FileGDB with the same result. Just as the data goes into the FeatureWriter the correct number of features (e.g. 11,050) are going in just not all being saved.Thanks
I'm a total FME novice trying to convert an ecw (Generated from a tif) to a jpg, but it keeps failing because the jpg writer cannot support more than 3 bands.... What are these bands and how do i get around this problem? I just need a straight forward jpg.. no coordinates. Thanks in advance for your help..
I am able to write inspire GML (it validates, too). I do it in FME. Now I would like to write that gml directly to the postgresql database (add postgresql writer), so that i have the entire data flow in one workspace, but i cannot join two writers (inspire gml writer and postgresql writer) together... I am very new to FME.
Hi, we are coming up against an issue now that is now a real blocker to our workflow. We are running a workbench attached on FME cloud which picks up content in postgis and writes to fgdb. The problem is at random - (honestly) it will fail with the error:Geodatabase Error (-2147220987): The user does not have permission to execute the operation.If you run the task again specifically running on the feature it failed on, it will run no problem.I know there are other cases of this reported, however when we run locally there is no issue.https://knowledge.safe.com/questions/45200/writing-esri-file-geodatabase-issue.html https://knowledge.safe.com/articles/362/workspace-fails-on-fme-server-when-using-unc-paths.html @brianatsafe @david_r @mark2atsafe have all commented on this error before, reading through I can't see any issues that relate - as we are running as superuser and also have tested locally.The two logs attached outline the error, the larger log, is for running a very big task
Hello! I have to transform a PointCloud Dataset (LAS) from EPSG 31256 to EPSG 4326. Therefore I used the transformer CSMapReprojector. My output PointCloud always looks like this: This was the Input dataset: Thanks for your suggestions.
I am trying to connect to a hosted feature service in our GIS Portal. I am receiving the following error:..."Check your credentials and try again. The error code from the server was '400' and the message was: 'Unable to generate token.' A fatal error has occurred. Check the logfile above for details"...I am using our fully qualified domain name with /sharing/rest/generateToken with our service account credentials.Ideas??Thanks,--gary
I Want to know More aboutWhat is a Point Cloud? What is LiDAR? I Need Brief Clarification i have Seminar on this topic. your Answers would be appreciated.
@takashiHi I am using an SQLCreator to return all incidents reported in the last hour. I then want to use an XML file to define levels for each alarmtype, which determine whether an alert record is created depending on the type of incident and count e.g. <incidentype name="gasleak" level="1,5,10"/><incidenttype name="electricityinterruption" level="1,3,10"/> therefore for gasleak, an alarm record is created if count of incidents is as follows:count alarmcreated Level AlarmTime 2 Yes 14 No N/A7 Yes 511 Yes 10Note when count=4, no alarm is created as level 1 alarm has already been created.So far, I have added an XML reader and use FeaturePaths. I have also obtained the count of incidents for the last hour using SQLCreator. Any suggestion how FeaturePaths could be used in this case? Is pythonXML the b