Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 7,083 Posts
  • 26,087 Replies
7083 Posts
J
jackpkwong
asked in Data
can anyone tell me if FME can convert Revit file to IFC file?

can anyone tell me if FME can convert Revit file to IFC file?

490
rudewi
Participant
P
petermortier
asked in Data
Is it possible to write non-spatial data using SDF writer

Hello,I'm using FME SDF Writer, but I also need to write some non-spatial data to my SDF file.However in the SDF writer I seem to be forced to always specify a Geometry column name in the Format Parameters section of the writer.If I specify the default: "Geometry" Autocad still recognizes the feature as a spatial feature but without a geometry and it complains about this, if we want to edit such features.In the "Feature Type Properties" section of the Writer, I have used "fdo_null" for the geometry.The difference between an original SDF (with a non-spatial feature) and one generated by FME SDF writer can also be seen in the FME inspector.The features written by FME have an extra attribute: fme_geometry with value fme_undefinedExample of non-spatial feature generated by FME SDF writer:Can somebody tell me how, if possible to write a non-spatial feature to an SDF file?Thanks

220
rudewi
Participant
J
jatjat
asked in Data
Extracting only the Shell / exterior of a building model IFC

Hi, Just throwing this out there because I'm quite new to this area. Thanks for your time and help! TLDR /questionHow can I use FME to extract only the exterior / shell of a 3D model when you cannot rely on the models structure? Background, infoI'm reciving quite a bit of complex IFC models which doesn't always follow the same structure, because they are made up of different models put together, so all the windows might not be in IFCwindows for example, it's best to assume it's scrambled. I want to transform these models to GIS and use in 3D maps. (SHP, GLTF, GLB etc)When I don't need a lot of the interior details like piping, doors inside the building, chairs, some walls etc I find myself doing a lot of manual cleaning/trimming in SimpleBIM.I'm wondering if there is a more automated way to use FME to extract only the shell of a building, and perserving the outer detail ofcourse. Sort of if I could drape a plastic bag over the model and suck the air out, ma

2700
T
R
rohitramlakhan
asked in Data
Cannot convert IFC file to 3D Tiles

I have tried to convert an IFC file to Cesium 3D Tiles with the Cesium 3D Tiles writer.This results in one JSON file and one or more B3DM files (depending on the IFC file structure).When I try to add the JSON and B3DM file(s) to Cesium ion, the model does not appear. How can I fix this?Is there another method to convert IFC files to 3D Tiles with FME?

38812
R
J
jonathan
asked in Data
Pointclouds from postgis / PostgreSQL

Hi All, Does anyone have any experience getting a pointcloud out of PostGIS? We're using the PostgreSQL extension "Pointcloud" - https://github.com/pgpointcloud/pointcloud  Currently the data is stored in pcpatch data types and we extract it with pc_explode(column)::geometry. This returns to FME all of the individual points which if desired we can then recombine into a pointcloud.  But is there a way to get a pointcloud out *as* a pointcloud? I've tried PC_AsText, but the JSON it returns isn't GeoJSON so I can't just feed it straight into a GeometryReplacer. And there's no PC_AsBinary for the pcpatch datatype.  Anyone have any thoughts or experiences with this? Thanks, Jonathan

1111
ronan
Contributor
brandonguo
Contributor
brandonguoContributor
asked in Data
Shp number field's decimal place is not reading properly

I have a shp file generated by QGIS with three decimal places. In FME, the feature reader seems to auto round the field. I tried to change the "Numeric attribute type handling" to "explicit width and precision", still doesn't work.  Is there any way to let FME read the data as same as QGIS? ​

1280
brandonguo
Contributor
J
johng
asked in Data
KML to CSV

Hello, I am trying a simple conversion from KML to csv. I need to write all data from ExtendedData element, it may be SimpleData or Data key/value. All I want is csv file with custom data from kml.  In a workbench I have  Generic reader which reads KML ( GENERIC Reader is requirement)  CSV Writer to write to csv  I have connected reader to writer directly no transformer and I expecting csv file. I yet to put CoordinateExtractor to get coords from file. So I am expexting only data to be written to csv. But when I run the workspace all I get is blank csv.  Here is a sample KML.  <kml xmlns="http://www.opengis.net/kml/2.2"> <Document>   <name>My Golf Course Example</name>   <Placemark>     <name>Club house</name>     <ExtendedData>       <Data name="holeNumber">         <value>1</value>       </Data>       <Data name="holeYardage">         <value>234</value>       </D

1268
salvaleonrp
Enthusiast
B
brendan_neal
asked in Data
CSAR Point Cloud fails when loaded through Reader

Hi,I'm trying to read in various Caris CSARPC files and some fail with the following errors: (Had to sanitises paths)I've moved the FME temporary file location to a network share that has plenty of space as I thought it was running out on the C: drive, and it is writing the temp files in the correct location.It also is not consistent, I can run other CSARPC files through reader and it works fine, some a lot big then others, not sure what is going on?? Output"FME Configuration: Source coordinate system for reader CSARPC_1[CSARPC] set to `_FME_0' as read from input dataCoordinate System `_FME_0' parameters: CS_NAME=`_FME_0' DT_NAME=`WGS84' PROJ=`MRCATK' QUAD=`1' SCL_RED=`1.0000000000' UNIT=`METER' Storing feature(s) to FME feature store file `\\\\XXXXX-share4\\XXX_GIS_Warehouse_Scratch\\temp\\wb-cache--zD5304\\Main_CSARPC -1 2 -1 0 7d1dc4d5b02aac6f53ce8974ab35efb9a70c671b.ffsupdating'FFS writer: Writing point cloud with 10028592 point(s)

368
brendanneal
Contributor
N
nsulzberger
asked in Data
Why throws my Interlis Writer a n error: class 'COM/safe/fmeobjects/FMEObjects" could not be located

I have an issue with my workspace using an Interlis Writer (ili2fme).It is running fine on my local machine, but not on a server where FME Server and ArcGIS Server is installed. Following error is listed in the logs: Writer `ch.ehi.fme.Main_1_FANOUT' of type `MULTI_WRITER' using group definition keyword `MULTI_WRITER_DEF'Creating writer for format: Swiss INTERLIS (ili2fme)Trying to find a JAVA plugin for writer named `ch.ehi.fme.Main'The class 'COM/safe/fmeobjects/FMEObjects" could not be located. Check your classpath and later in the logs: Translation FAILED.## A fatal error has been detected by the Java Runtime Environment:## EXCEPTION_ACCESS_VIOLATION(0xc0000005)at pc=0x00007ffd43921c11, pid=29404, tid=16240## JRE version: OpenJDK Runtime Environment (11.0.6+10) (build 11.0.6+10)# Java VM: OpenJDK 64-Bit Server VM (11.0.6+10, interpreted mode, compressed oops, g1 gc, windows-amd64)# Problematic frame:# C 0x00007ffd43921c11  FME Desktop Version:FME Desktop ES

830
N
D
debbiewly
asked in Data
How to fix the coordinates in a CSV file?

Hi, does anyone know how to fix the "Geom" field and turn it into appropriate coordinates? I downloaded the CSV file from the city of Vancouver open portal and ran it in the FEM workspace without changing any parameters, but I couldn't see any point features after. I was wondering if I should fix the attributes as the coordinates are within the same field? Thank you!

190
S
D
dona
asked in Data
Reading additional attribute LAS file in FME

Is it possible to get an additional attribute from a las file in FME. Indeed I have an input point cloud in las format with a vertical distance attribute on each point.I need this attribute to make statistics.How to get this attribute directly when reading the las file (or other) without passing "PointCloudCoercer"?

670
D
3d_ff
Contributor
3d_ffContributor
asked in Data
Is there a work around to be able to import Datamine, gOcad and Leapfrog 3D objects within FME to be able to automate queries and manipulations on these objects?

Is there a work around to be able to import Datamine, gOcad and Leapfrog 3D objects within FME to be able to automate queries and manipulations on these objects?

710
nampreetatsafe
Safer
K
kaz
asked in Data
Convert LAS to Esri SLPK

Hi there,  I have a 3D object in .las format which contains RGB values for each point in the point cloud. The goal is to get this object into an Esri .slpk format and keep the RGB values so the final object is colored correctly.  The .las file doesn't have a coordinate system but has relative xyz values; seems like the object is centered at 0,0. When using the CoordinateSystemSetter, it doesn't seem to change the XY values at all. This is just part of the problem.  The other problem is when I try to write out to .slpk using the Esri SLPK writer, I get this error: The layer requires triangular mesh geometries. Features whose geometries cannot be triangulated will not be written How do I convert the .las file into a triangular mesh so that it can be written to SLPK? Is this possible? Do I need a different input format? Other options could be .xyz or .pcd for the input file.  I haven't really worked in this space before so any guidance for working with 3D would be helpful. Tha

3640
kailinatsafe
Safer
karnil
Contributor
karnilContributor
asked in Data
How do I generate instantiated 3D geometry on a set of points?

Hello!I have a set of points representing the location of the tree trunks. I also have a 3D model of a tree that i want to be copied to each of the points locations. And here is the tricky part, I need them to be instanced geometries, so they do not require to much space (and rendering power) when I export to fbx, skp and dwg.I tried to read up on the GeometryInstantiator-node but I must admit, I don't quite follow what it is supposed to do. Is there an example for this availible anywhere or do anyone have a clue?Here is a screendump of my script, but it only manages to place the trees as individual models which creates a 30MB file from copies of a mere 15KB geometry-asset.:Sincerely,Robin Nilsson

1490
N
roberto
Contributor
robertoContributor
asked in Data
FME Server and SAML SSO

Hello,question about SSO for FME Server 2020. Is the SAML protocol supported?ThanksRoberto

260
roberto
Contributor
datablue
Contributor
datablueContributor
asked in Data
How to have a daily back up of an ArcGIS feature layer?

I have an ArcGIS feature layer with two tables that I'd like to backup daily. I've created workspace with two readers and two writers. The Esri ArcGIS Online (AGOL) Feature Service Readers read from the two tables. The Esri Geodatabase (File Geodb) Writers write to the same geodatabase (.gdb) folder.  This works great. For the GeoDB writer I'm using Insert for the feature operation to append rows onto the destination table. Since I'm writing to the same GeoDB folder, over time I don't think that this is not the same as creating a copy. I'd like to try to append the date to the file name such as fileName_220503 for today so that I have a new gdb folder. I'm not sure how to do that. Ideally, storing no more than 30 or 60 days of backups would be best. So, maybe appending a number (instead of a date) would be better. I plan to run this from the Windows Task Scheduler (which I have not used before). I'm not sure how to limit the number of backups to 30 or

2541
R
C
cooper
asked in Data
I want to add a feature service to my workbench, but I get a Python-related error (see image). How can I fix this?

60
daraghatsafe
arthur_bazin
Contributor
arthur_bazinContributor
asked in Data
how to get the schema of two files with the same name in two different subdirectories ?

Hi, I'm creating a workbench to make some audit on GIS files. First my workbench list all files that are into a directory (including subdirectories).Then, I filter theses files to keep only the one I want to audit, for exemple every shapefiles.Finaly I get the schema of every shapefile with the <schema> output of a FeatureReader. It works really great but if I have two files with the same name in two different subdirectories my problem comes : only 1 schema is kept.That's how FME works, it unions feature types with the same name. But in my case, I need to analyse the schema of every layer even if they have the same name. This is an audit so these file can have different schema even if they have the same name. I want to have an automatic workbench and not having to create one FeatureReader for each directory. Is there anyone with an idea on how to get the schema of two files with the same name in two different subdirectories ? Thank you

120
arthur_bazin
Contributor
lazarlubomir
Contributor
lazarlubomirContributor
asked in Data
DWG layout - how to load raster?

Hello, please, I have met issue that I read DWG Layout in FME. But unfortunately FME is not able to load raster which should be in Layout. I use parameters "Read Paper space" as You can see in attachment. Is it bug? Or is there any workaround, how to read raster in DWG Layout? Its very uncomfortable, because I need to transform DWG Layourt to PDF. Thanks a lot!Lubo

270
kailinatsafe
Safer
rtreecare
Contributor
rtreecareContributor
asked in Data
AGOL Feature Service Writer: Change number of records updated at a time.

I have a workspace that is updating about 100,000 records online. It will do a couple groups of 1000 updates before the rest service returns an error:"The error code from the server was '1000' and the message was: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding." Is there a way to get around this error? I was thinking that reducing the number of records updated per rest call would help but I dont see a way to change the number from 1000. Thanks!

510
rtreecare
Contributor
datablue
Contributor
datablueContributor
asked in Data
How to generate a feature layer in ArcGIS Online?

I have a feature layer with two tables in ArcGIS Online. It constantly receives new records from Survey123 survey. I'd like to join the tables together in FME them regularly import data to a new ArcGIS Online feature layer (with one table). Is this possible? Are there examples on how to do this? What transformers should I look at? Thanks.

3880
datablue
Contributor
soothsayers
Contributor
soothsayersContributor
asked in Data
ZMap writers have headers and within that there is zmap_format_name which by default is set to "ZMAP DEFAULT " Is there any way of writing out a different value? Thanks, Glenn

ZMap writers have headers and within that there is zmap_format_name which by default is set to "ZMAP DEFAULT " Is there any way of writing out a different value? Thanks, Glenn

210
andreaatsafe
Safer
H
hendrik
asked in Data
Set cell width in dynamic Excel writer

Hello, is it possible to set the cell/column width in a dynamic Excel Writer. I can imagine to precalculate the width for each column or to use a auto mode. Hendrik

37810
oscarwillems
Contributor
asif.mehmood
Participant
asif.mehmoodParticipant
asked in Data
Hi. What type of Autocad drawing was used in training that showed road names and other information as attributes.

What type of Autocad drawing was used in training that showed road names and other information as attributes. Usually DWG does not have any attribute unless we use AutoCAD Civil 3D etc. I need to tell my AutoCAD staff to provide me CAD data in that same format so I could easily convert the DWG into feature classes with useful attributes directly coming from the source DWG.

150
ryanatsafe
Safer
lazarlubomir
Contributor
lazarlubomirContributor
asked in Data
DWG viewports - how to define frozen layers?

Hello, please, I wanna ask. If I wanna export many viewports of DWG in FME Desktop, is there any way how to define which layers will be frozen in each viewports? I need little bit different composition of layers for every viewport. Thanks a lot for tips!Lubo

580
lazarlubomir
Contributor

Badge Winners

  • FME Form Basic Training
    mmccoshamhas earned the badge FME Form Basic Training
  • FME Certified Professional
    michaelaphas earned the badge FME Certified Professional
  • Welcome Back
    andreashaeslerhas earned the badge Welcome Back
  • Integrate Spatial Data
    cfrenchhas earned the badge Integrate Spatial Data
  • Student (Grey)
    atdvfhas earned the badge Student (Grey)
Show all badges

Community Stats

31,796
Posts
120,781
Replies
39,410
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.