Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 7,082 Posts
  • 26,077 Replies
7082 Posts
dmerrick
Contributor
dmerrickContributor
asked in Data
SDE to KML Issue

Hi,I am having an issue converting data from an ESRI SDE connection to KML file in FME due to 1.3m shift from the same conversion in ArcMap.My SDE data is NAD 83, UTM Zone 10N (WKID: 26910). I have no issues connecting to the SDE, I get the same 1.3m shift using a Writer or a FeatureWriter. I do get a warning of:NOT changing coordinate system of reader identified by keyword `GEODATABASE_SDE_1' from `EPSG:26910' to `_UTM83-10_0' -- mapping file setting of `EPSG:26910' overrides coordinate system `_UTM83-10_0' read from fileIf I put the SDE coordinate system of "UTM83-10", I still get the same error. Once exported, regardless of which coordinate system i use, the 1.3m shift is still present in the kml. I have exported from the SDE into both a file geodatabase and shapefiles and repeated the same process and I get the same results. If I re-import the KML into FME to a shapefile and compare to the original in ArcMap, there is no shift. If I import the same kml

210
dmerrick
Contributor
K
kstckillian
asked in Data
Does FME have a AIG format raster reader?

Does FME have a reader for AIG format rasters?

50
debbiatsafe
Safer
M
michael_pieters
asked in Data
Layers from spatialite database not visible in QGIS.

I've created a spatialite database using FME. It includes layers with polygons, lines, points and tables (no geometry). However, FME 2017 does not seem to offer an option to indicate geometry type. Therefore, the geometry_type table and column is not filled correctly thus layers are not visible in QGIS. After adjusting the table manually the layers become visible. Does anyone know how to solve the problem within FME?

470
debbiatsafe
Safer
A
azajarc
asked in Data
Request timed out in ArcGIS Online

Anyone who knows the solution to this? We are doing a refresh from ESRI ArcGIS SDE to ArcGIS Online and this is the error that was encountered. How to avoid this? Most of the time I encounter this error, only sometimes that the process becomes successful. ArcGIS Online Feature Service Writer: Encountered an unexpected error. The error code from the server was '504' and the message was: 'Your request has timed out

1450
J
S
skhanaba
asked in Data
FMEServerJobSubmitter - Could not initialize connection to server

Hello I am getting error: FMEServerJobSubmitter(ServerJobSubmissionFactory): Could not initialize connection to server "<server/LoadBalancer name>". FME Server error: `Communication Error: Failover node detected client request. Request rejected to redirect to active node.' , Please advise.

70
redgeographics
Celebrity
K
kouri1986
asked in Data
Can I use a postgres writer over a sqlexecutor to write to a postgres hstore column?

I am looking to write to a postgres hstore column and seeing if their is a way to use a postgres writer with its 1000 transactions at a time to write to postgres table with a hstore column over using a 1 at a time sql-executor? I have 5 attributes to go into the hstore.

300
takashi
Celebrity
J
jkubacka
asked in Data
Workflow from point cloud to 3D model in GIS

I need to create a workflow in FME Workbench. It should contain following steps:1. Given Point Cloud (.las-format)2. Export as a 3D Model in IFC3. Create a GeodatabaseSo in the end I want my point cloud to be a model that I can import to ArcGIS Pro. Is that possible or is there any other/better solution solving my problem? I am thankful for any comment.

1630
daveatsafe
Safer
H
hadhafang
asked in Data
WRITER_TYPE Error Ifc to CityGML

I am am trying to convert a IFC-file into a CityGML-file. For inspiration I am relying heavily on the intermediate guide for BIM to gis. Now when I am trying to convert the IFCDoors entities into CityGML doors i get the following error:Type of writer to use was not specified (WRITER_TYPE was not found)I have to the best of my knowledge not changed the writer in any way except for the output-file path and the projection system. Every other geometry I am using seems to konvert nicely.So my questions are as follow:What does the error mean?How can I solve it?Thanks in advance :D

410
daveatsafe
Safer
jatoxa
Contributor
jatoxaContributor
asked in Data
BADNEWS autocadCorrTemplate.fmi could not be opened

Hi,   When running a workspace on Cloud I get the following error "BADNEWS: File /opt/fme-engine-2018/metafile/autocadCorrTemplate.fmi could not be opened (foundation/framework/engine/tabrdr_classic.cpp:2756 - open) - (foundation/framework/engine/tabrdr_classic.cpp:1460 - getRow)"  The same workspace works fine in Workbench and even worked on Cloud in an earlier iteration. I have recently updated the workspace and it does contain a DWG reader but I have made no changes to that part of the workflow.  

60
G
J
joaarmst
asked in Data
Error running translation

I keep getting this very vague error message when running my FME. My workspace is simple. I'm pulling down my data from ArcGIS online, I have a joiner to join to other data to get a few attributes, I'm re projecting my data then writing it out to SDE. When I run it all I get returned is Error running translation. I have sent it to inspector and I can see what I want so it appears to be having trouble when it gets to SDE. Any ideas?

5640
J
M
markfrater
asked in Data
3D spatial relator for creating minecraft rails

@dmitribagh and @mark2catsafe created a railway in minecraft using a spatial relator to examine adjacent points to determine the orientation for the rails. See https://knowledge.safe.com/articles/1064/how-to-make-minecraft-worlds.html. However the "complicated" condition definition for adding the block attributes only works in 2D and does not incorporate in z data for elevation or slope of the rails. Does anyone have some thoughts/ideas about how to expand on the condition definition to add the slope attributes? e.g. 2 Sloped rail ascending to the east. 3 Sloped rail ascending to the west. 4 Sloped rail ascending to the north. 5 Sloped rail ascending to the south.

90
M
ottadini
Supporter
ottadiniSupporter
asked in Data
recursively concatenate json attributes

I have a response from Azure's OCR service, which looks like this (full response attached):{    "language": "en",    "orientation": "Up",    "textAngle": 0,    "regions": [        {            "boundingBox": "316,555,1597,123",            "lines": [                {                    "boundingBox": "1515,555,398,29",                    "words": [                        {                            "boundingBox": "1515,555,82,23",                            "text": "CRMA"                        },                        {                            "boundingBox": "1608,555,154,29",                            "text": "Completion"                        },                        {                            "boundingBox": "1775,555,138,23",                            "text": "Document"                        }                    ]                },                {                    "boundingBox": "316,632,556,46",                    "words": [                        {                  

1884
ottadini
Supporter
L
lundse
asked in Data
adding suffix to list attributes in json-file

Hi, I want to add different suffix to different attributes, 'Filename' in a jason-file. FilenameSuffixABC_123DEF_456GHI_789JKL_102MNO_103PQR_104I have managed building a list with the added suffix, and tried unsuccesfullty to replace the array value using JSONUpdater.  Another approach I tried was to merge the generated list using Featuremerger. I get the correct lists, but are unable to write them as a JSON-file. Any suggestions? {"name":"MAP_SUFFIX","type":"FeatureCollection" ,"crs":{"type":"name","properties":{"name":"EPSG:25832"}} ,"features":[ {"type":"Feature","geometry":{"type":"Polygon","coordinates":[[[1,5],[1,2],[1,2],[1,2],[1,2]]]},"properties":{"filename":"ABC"}} ,{"type":"Feature","geometry":{"type":"Polygon","coor

391
takashi
Celebrity
G
geob
asked in Data
Is there any way to convert light-weight Polylines to 3D Polylines?

Hello, I have a 2D City Map .*dxf file. I draped my city map on digital terrain model to obtain a 3D city map. It works fine but when I try to use .*dxf/.*dwg writer, ? see this problem. "AutoCAD Writer: Encountered a feature with inconsistent Z values, and type 'autocad_lwpolyline'. For this type, only geometry with constant Z values, or 2D geometry are supported. Dropping Z values"In my output, the geometry which consist of 'autocad_lwpolyline' does not have Z values. Is there any way to solve this problem?

1090
G
rajibtechlabs
Contributor
rajibtechlabsContributor
asked in Data
How to download Google Map in KML .

How to download Google Map in KML .

180
david_r
Celebrity
jatoxa
Contributor
jatoxaContributor
asked in Data
Directory reader on Cloud

Hi, I have a wokflow that reads PDF files and validates them. The workflow works great on Cloud as well. However the PDF reader doesn't read all PDF files and seems to be dependent on what software they were published in. So if I try to read invalid PDF's there's simply no output. This is a problem if you want to at least get a list of what files are invalid.   The problem was solved by using a directory reader instead along with a feature reader that reads a list of PDF's. The problem is now that it doesn't work to upload a folder to Cloud in the same drag n drop manner I used before.  Is there an alternative way to know what you can't read?

100
G
boubcher
Contributor
boubcherContributor
asked in Data
write to PDF

How can I write attribute MSG to a PDF as text ID MSG1inside the polygon2outside the area3close to the event area4comment

860
gio
Contributor
S
sebastianblock
asked in Data
OSM PBF Reader: Get nodes in a way

I'm using the OSM PBF reader in FME 2018 to extract highways. I want to split the highway lines into segements, so that each line only contains 2 vertices (the "from node id" and "to node id"). What I am interested in are the underlying node ids.I've tried reading the PBF, both as OSM feature types and primitive types, but neither seems to expose the underlying node ids.I can get to the node ids using the OSM XML Reader, but the XML file is far larger and I will need to process the whole road network for Europe, hence the use of PBF.Looking at the forum seems to suggest that either it's not currently supported or to use Python.Is there a simple way to expose the underlying node ids using the PBF reader?

1360
S
G
grahamkeencadba
asked in Data
Connecting to ArcGIS Online via FME Server

I'm unable to run a Workbench on FME Server 2017.0.1.1 that reads and writes to a feature service at ArcGIS Online. I've read the other streams related to this but can't work out the correct workflow, or if we have some problem with the server accessing the online resources for OAUTH2 from inside the corporate network. The workbench works from FME Desktop 2017.0.1.1 with no a problem.I've created an app at ArcGIS Online to obtain a Client ID and Client Secret with the redirect Uri of urn:ietf:wg:oauth:2.0:oob and this all works in Desktop. These same elements were entered into the "Client Information panel" of the Web Service page in FME Server for service "Esri ArcGIS Online". I then created a new Web Connection "g9k Esri ArcGIS Online02" using the  "Esri ArcGIS Online" Web Service defined above. I can then use the "Authorize" button and enter the AGSOL credentials...After clickiong on Sign In", we get a code string back from OAuth2 Approval with "Please copy this code, switch to your

1459
N
eric_armitage
Contributor
eric_armitageContributor
asked in Data
Feature reader WFS where clause greyed out

Hi. I'm trying to read features from a WFS service. I can read the features ok based on a spatial filter but the option to use a WHERE clause on an attribute does not seem to be available. Any idea how to fix this?

1270
danilo_fme
Evangelist
gazza
Contributor
gazzaContributor
asked in Data
ArcGIS Online Reader Feature Service name

With the ArcGIS Online reader I can get the layer name from fme_feature_type but is there any way to get the name of the feature service that contains that layer?

80
lars_de_vries
jdh
Contributor
jdhContributor
asked in Data
HTML ancestors

I have some html data that's in the structure  <h2>Status</h2><h3>Place</h3><p><a name="1">Name</a></p> <p><a name="2">Name<blockquote><p>Description</p></blockquote></a></p> <h3>Place2</h3><p><a name="3">Name<blockquote><p>Description</p></blockquote></a></p>but the Line Feeds are entirely erratic.  I need to have one feature per name anchor (which is easily enough done with the HTMLExtractor) but I also need to have the corresponding contents of the h2|h3 tags stored as attributes. Normally I would read in the data line by line and use a TestFilter and variables to do so, but since the lines breaks don't match the data structure in any way, I'm not sure as to the best way to proceed.

82
jdh
Contributor
A
alicepalmer
asked in Data
gz to shp problems

I am struggling to get 113.gz os mastermap files to convert over to .shp. I am not that experienced with FME but am finding that the workbench keeps crashing when its reading the files.Does anyone have any tips? I have found previous docs regarding a translator called Fanout - but doesn't seem to exist in my software.I would be grateful for any tips as would like to start moving all of our processes over to FME.Thanks,Alice

670
M
F
florianbenoit
asked in Data
Convert AutoCAD text to SHP attribut

Hello,I have a DWG file with two layers. In the first one I have lines representing a nework of pipes. In the second one I have autoCAD text describing the pipes diameters. I would like to create a shape file representing the pipes with their diameter as an attribute. I linked a DWG reader containing the first layer to a SHP writer to create the shape file representing the network of pipe. How can I extract the text (diameter information) from the second layer of my DWG file and how can I link the diameter to the right pipe in the SHP file ?Thank you for your help,

2610
C
F
firsttube
asked in Data
Write DWG with coordinate system and units

Using FME Professional Desktop 2012 SP3, Windows 7 Pro, 64-bit.  I have a workbench that I created to extract geometries in WKB format from SQL Server and write them into an AutoCAD Map DWG file.  I noticed the resulting DWG file has no coordinate system assigned, and the units are set to "unitless".  Although the objects are correctly positioned and the coordinates are correct, the coordinate system is not set.  Is there any way to write the AutoCAD Map DWG file with the coordinate system and the units set?  I have posted this question in the Google group FME Talk.  I am just trying to increase exposure to my question.  Thanks,

2760
jneujens

Badge Winners

  • English Speaker
    jamatsafehas earned the badge English Speaker
  • Student (Grey)
    hdnguyenhas earned the badge Student (Grey)
  • Teacher (Grey)
    hdnguyenhas earned the badge Teacher (Grey)
  • FME Certified Professional
    rune.van.sevrenhas earned the badge FME Certified Professional
  • English Speaker
    nasirhas earned the badge English Speaker
Show all badges

Community Stats

31,788
Posts
120,757
Replies
39,405
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.