- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,779 Posts
24,925 Replies

When you subscribe we will email you when there is a new topic in this category

6779 Posts

Recently active

Most replies Most views Newest first

jkubacka

asked in Data

Workflow from point cloud to 3D model in GIS

I need to create a workflow in FME Workbench. It should contain following steps:1. Given Point Cloud (.las-format)2. Export as a 3D Model in IFC3. Create a GeodatabaseSo in the end I want my point cloud to be a model that I can import to ArcGIS Pro. Is that possible or is there any other/better solution solving my problem? I am thankful for any comment.

WRITER_TYPE Error Ifc to CityGML

I am am trying to convert a IFC-file into a CityGML-file. For inspiration I am relying heavily on the intermediate guide for BIM to gis. Now when I am trying to convert the IFCDoors entities into CityGML doors i get the following error:Type of writer to use was not specified (WRITER_TYPE was not found)I have to the best of my knowledge not changed the writer in any way except for the output-file path and the projection system. Every other geometry I am using seems to konvert nicely.So my questions are as follow:What does the error mean?How can I solve it?Thanks in advance :D

315

6 years ago

jatoxaContributor

asked in Data

BADNEWS autocadCorrTemplate.fmi could not be opened

Hi, When running a workspace on Cloud I get the following error "BADNEWS: File /opt/fme-engine-2018/metafile/autocadCorrTemplate.fmi could not be opened (foundation/framework/engine/tabrdr_classic.cpp:2756 - open) - (foundation/framework/engine/tabrdr_classic.cpp:1460 - getRow)" The same workspace works fine in Workbench and even worked on Cloud in an earlier iteration. I have recently updated the workspace and it does contain a DWG reader but I have made no changes to that part of the workflow.

6 years ago

joaarmst

asked in Data

Error running translation

I keep getting this very vague error message when running my FME. My workspace is simple. I'm pulling down my data from ArcGIS online, I have a joiner to join to other data to get a few attributes, I'm re projecting my data then writing it out to SDE. When I run it all I get returned is Error running translation. I have sent it to inspector and I can see what I want so it appears to be having trouble when it gets to SDE. Any ideas?

3D spatial relator for creating minecraft rails

@dmitribagh and @mark2catsafe created a railway in minecraft using a spatial relator to examine adjacent points to determine the orientation for the rails. See https://knowledge.safe.com/articles/1064/how-to-make-minecraft-worlds.html. However the "complicated" condition definition for adding the block attributes only works in 2D and does not incorporate in z data for elevation or slope of the rails. Does anyone have some thoughts/ideas about how to expand on the condition definition to add the slope attributes? e.g. 2 Sloped rail ascending to the east. 3 Sloped rail ascending to the west. 4 Sloped rail ascending to the north. 5 Sloped rail ascending to the south.

6 years ago

ottadini

asked in Data

recursively concatenate json attributes

I have a response from Azure's OCR service, which looks like this (full response attached):{ "language": "en", "orientation": "Up", "textAngle": 0, "regions": [ { "boundingBox": "316,555,1597,123", "lines": [ { "boundingBox": "1515,555,398,29", "words": [ { "boundingBox": "1515,555,82,23", "text": "CRMA" }, { "boundingBox": "1608,555,154,29", "text": "Completion" }, { "boundingBox": "1775,555,138,23", "text": "Document" } ] }, { "boundingBox": "316,632,556,46", "words": [ {

adding suffix to list attributes in json-file

Hi, I want to add different suffix to different attributes, 'Filename' in a jason-file. FilenameSuffixABC_123DEF_456GHI_789JKL_102MNO_103PQR_104I have managed building a list with the added suffix, and tried unsuccesfullty to replace the array value using JSONUpdater. Another approach I tried was to merge the generated list using Featuremerger. I get the correct lists, but are unable to write them as a JSON-file. Any suggestions? {"name":"MAP_SUFFIX","type":"FeatureCollection" ,"crs":{"type":"name","properties":{"name":"EPSG:25832"}} ,"features":[ {"type":"Feature","geometry":{"type":"Polygon","coordinates":[[[1,5],[1,2],[1,2],[1,2],[1,2]]]},"properties":{"filename":"ABC"}} ,{"type":"Feature","geometry":{"type":"Polygon","coor

Is there any way to convert light-weight Polylines to 3D Polylines?

Hello, I have a 2D City Map .*dxf file. I draped my city map on digital terrain model to obtain a 3D city map. It works fine but when I try to use .*dxf/.*dwg writer, ? see this problem. "AutoCAD Writer: Encountered a feature with inconsistent Z values, and type 'autocad_lwpolyline'. For this type, only geometry with constant Z values, or 2D geometry are supported. Dropping Z values"In my output, the geometry which consist of 'autocad_lwpolyline' does not have Z values. Is there any way to solve this problem?

How to download Google Map in KML .

155

6 years ago

jatoxaContributor

asked in Data

Directory reader on Cloud

Hi, I have a wokflow that reads PDF files and validates them. The workflow works great on Cloud as well. However the PDF reader doesn't read all PDF files and seems to be dependent on what software they were published in. So if I try to read invalid PDF's there's simply no output. This is a problem if you want to at least get a list of what files are invalid. The problem was solved by using a directory reader instead along with a feature reader that reads a list of PDF's. The problem is now that it doesn't work to upload a folder to Cloud in the same drag n drop manner I used before. Is there an alternative way to know what you can't read?

6 years ago

boubcherContributor

asked in Data

write to PDF

How can I write attribute MSG to a PDF as text ID MSG1inside the polygon2outside the area3close to the event area4comment

OSM PBF Reader: Get nodes in a way

I'm using the OSM PBF reader in FME 2018 to extract highways. I want to split the highway lines into segements, so that each line only contains 2 vertices (the "from node id" and "to node id"). What I am interested in are the underlying node ids.I've tried reading the PBF, both as OSM feature types and primitive types, but neither seems to expose the underlying node ids.I can get to the node ids using the OSM XML Reader, but the XML file is far larger and I will need to process the whole road network for Europe, hence the use of PBF.Looking at the forum seems to suggest that either it's not currently supported or to use Python.Is there a simple way to expose the underlying node ids using the PBF reader?

Connecting to ArcGIS Online via FME Server

I'm unable to run a Workbench on FME Server 2017.0.1.1 that reads and writes to a feature service at ArcGIS Online. I've read the other streams related to this but can't work out the correct workflow, or if we have some problem with the server accessing the online resources for OAUTH2 from inside the corporate network. The workbench works from FME Desktop 2017.0.1.1 with no a problem.I've created an app at ArcGIS Online to obtain a Client ID and Client Secret with the redirect Uri of urn:ietf:wg:oauth:2.0:oob and this all works in Desktop. These same elements were entered into the "Client Information panel" of the Web Service page in FME Server for service "Esri ArcGIS Online". I then created a new Web Connection "g9k Esri ArcGIS Online02" using the "Esri ArcGIS Online" Web Service defined above. I can then use the "Authorize" button and enter the AGSOL credentials...After clickiong on Sign In", we get a code string back from OAuth2 Approval with "Please copy this code, switch to your

1019

6 years ago

eric_armitageContributor

asked in Data

Feature reader WFS where clause greyed out

Hi. I'm trying to read features from a WFS service. I can read the features ok based on a spatial filter but the option to use a WHERE clause on an attribute does not seem to be available. Any idea how to fix this?

ArcGIS Online Reader Feature Service name

With the ArcGIS Online reader I can get the layer name from fme_feature_type but is there any way to get the name of the feature service that contains that layer?

6 years ago

jdhContributor

asked in Data

HTML ancestors

I have some html data that's in the structure <h2>Status</h2><h3>Place</h3><p><a name="1">Name</a></p> <p><a name="2">Name<blockquote><p>Description</p></blockquote></a></p> <h3>Place2</h3><p><a name="3">Name<blockquote><p>Description</p></blockquote></a></p>but the Line Feeds are entirely erratic. I need to have one feature per name anchor (which is easily enough done with the HTMLExtractor) but I also need to have the corresponding contents of the h2|h3 tags stored as attributes. Normally I would read in the data line by line and use a TestFilter and variables to do so, but since the lines breaks don't match the data structure in any way, I'm not sure as to the best way to proceed.

I am struggling to get 113.gz os mastermap files to convert over to .shp. I am not that experienced with FME but am finding that the workbench keeps crashing when its reading the files.Does anyone have any tips? I have found previous docs regarding a translator called Fanout - but doesn't seem to exist in my software.I would be grateful for any tips as would like to start moving all of our processes over to FME.Thanks,Alice

Convert AutoCAD text to SHP attribut

Hello,I have a DWG file with two layers. In the first one I have lines representing a nework of pipes. In the second one I have autoCAD text describing the pipes diameters. I would like to create a shape file representing the pipes with their diameter as an attribute. I linked a DWG reader containing the first layer to a SHP writer to create the shape file representing the network of pipe. How can I extract the text (diameter information) from the second layer of my DWG file and how can I link the diameter to the right pipe in the SHP file ?Thank you for your help,

Write DWG with coordinate system and units

Using FME Professional Desktop 2012 SP3, Windows 7 Pro, 64-bit. I have a workbench that I created to extract geometries in WKB format from SQL Server and write them into an AutoCAD Map DWG file. I noticed the resulting DWG file has no coordinate system assigned, and the units are set to "unitless". Although the objects are correctly positioned and the coordinates are correct, the coordinate system is not set. Is there any way to write the AutoCAD Map DWG file with the coordinate system and the units set? I have posted this question in the Google group FME Talk. I am just trying to increase exposure to my question. Thanks,

How to convert ZFS directory to LAS?

I'm trying to convert ZFS directory to LAS but it's not working. There's an error warning: 'Data type of the file not supported, please update library'. What went wrong?

Oracle Spatial to PostGIS conversion speed issue

We are attempting to convert Oracle Spatial databases to PostGIS, and find it is taking a very long time to convert large 4269 SRID lines and polygons at roughly 1-2 per second, with smaller ones at around 10-20 a second. I am also very puzzled while for very long periods it will seemlingly do nothing but burn CPU (no new rows). I've tried both 9.6/2.3 (Azure for PostgreSQL PaaS) and 10.3/2.4 (on-prem) with the same results.For instance, it took 2 hours 54 minutes to convert 2136 rows, or about 12.3 a second.Is the overhead for converting the SDO_GEOMETRY number based geometries to the geography binary type really that high? Any suggestions for getting better conversion speed? Currently using 2017.1 - will a newer version run significantly quicker?

306

6 years ago

soothsayersContributor

asked in Data

When data is missing, I want to output an empty feature class anyway

Hi, I have an issue which could potentially be solved in different ways, and I want to put this out to see if people have better solutions. It is probably best explained with a simple example:A user requests output of a collection of data - X-points, X-polylines, X-polygonsSo we have a list of what they want. The data will be read from three Postgis tables and output dynamically using the Postgis schema to a FGDB. The user will then be sent the FGDB along with one layer file showing the three datasets.However the geographic area the user has requested data for contains no X-points data, so currently all that is exported is the X-polylines and X-polygons and the layer file contains a broken link for X-points. I am looking for the best way to write an empty X-points feature class to the FGDB so this link remains but isn't broken.My initial thought is too look at the list the user has requested, then compare it to what is read from Postgis. Then I'd have to create a dummy feature

1184

6 years ago

philipwhittenContributor

asked in Data

How do you get the fme_basename parameter to update for each filename opened in a workspace runner?

I need to copy all of the features in a folder containing many zipped shapefiles to tables in a SQL Server. The table names in the SQL Server need to reflect the shapefile names. Currently I am using the Table Name Expression: NatTitl_@Value(fme_basename)When I run the workspace runner that I created, the same table name is applied to every shape file. Hence, the fme_basename parameter is not updating when a subsequent shapefile is opened.

6 years ago

ravioli

asked in Data

"directory and file path names" - source folder

Hello,I am at very early stages of incorporating FME into my work, and I am trying to figure out how to unzip all zip files in a folder (and all zip files in subfolders).I was able to unzip files with the "directory and file path names" transformer (**/*.zip) by passing folder and file locations to ZipExtractor. However, That transformer asks me to provide a "source folder" before it can start running. Is there a way to define the source folder to the folder of my .fmw file?I plan to use this same file with different folders and I would like users to be able to copy the .fmw file into another folder and run it there without providing a source folder location everytime.Thanks!

The Transformer Emailer causes error message on our mail server

The Transformer Emailer causes the following error message on our mail server: 2018-05-17T22:22:23.651384+02:00 warning: Illegal address syntax from xxx.xxx.de[xxx.xxx.xxx.xxx] in RCPT command: <> Unfortunately I do not have any further information about our mail server. I don't care about the error message, but the guys from the central IT pressure for this error message to disappear. Is it possible to make changes to the email settings and if so, where? With REST?

6 years ago

Page 154 / 272

Badge winners

rzickuhrhas earned the badge Welcome Back
willydeverahas earned the badge Teacher (Bronze)
vertiroyhas earned the badge FME Form Basic Training
marta_podsiadhas earned the badge Welcome Back
buraskyhas earned the badge English Speaker

Show all badges

30,108: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.