- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,808 Posts
25,078 Replies

When you subscribe we will email you when there is a new topic in this category

6808 Posts

jasperwisEnthusiast

DGN writer text: set font by name

Hi, Is there a way to set the font of a text in a DGN file by using the font name?With the DGNStyler you can only set the font by the font number. In this post, https://community.safe.com/s/article/microstation-text-styles-in-fme , there's a workflow described. Basically, in microstation you add a text object for every desired font in the seedfile. In this way, a font number for each desired font is stored in the seedfile. Next, you read this seedfile with FME, to inspect all igds_font values. Still, there is no "igds_font_name" kind of attribute. So you should use the font name as the text value in the seedfile, I think. Once you extracted this mapping (font name <> font number), you remove all these text objects again from the seedfile. But for the workspace I am working on, we want the seedfile as an input/ user parameter, so this file is not fixed. So everytime a new seedfile is used, the mapping should be prepared manually. I am hoping for a better and more dy

extract file name when using wild card search input

I have thousands of photos, under multiple sub folders, which i have been attempting to extract the photo date. I have used the jpeg reader together with option to search sub folders, however, none of the exif options allow me to append the original file details. I'm new to fme so it's probably something simple as if i pick a single file then the filepathextractor works a treat.

Dynamic schema reading

I am creating a FME server app that reads shapefiles, applies some spatial analysis and then writes the results out to shapefile and an excel. Input shapefiles however will have varying schemas/attributes. The source I have set as a user parameter, that will prompt the input shapefile path. How do I get my reader to process/read varying schemas? I have ticked 'Merge Feature Type' on the reader. I assumed this would adjust the user attributes dynamically based on the input, but the schema remains fixed to the shapefile I set the bench up with.

can anyone tell me if FME can convert Revit file to IFC file?

Is it possible to write non-spatial data using SDF writer

Hello,I'm using FME SDF Writer, but I also need to write some non-spatial data to my SDF file.However in the SDF writer I seem to be forced to always specify a Geometry column name in the Format Parameters section of the writer.If I specify the default: "Geometry" Autocad still recognizes the feature as a spatial feature but without a geometry and it complains about this, if we want to edit such features.In the "Feature Type Properties" section of the Writer, I have used "fdo_null" for the geometry.The difference between an original SDF (with a non-spatial feature) and one generated by FME SDF writer can also be seen in the FME inspector.The features written by FME have an extra attribute: fme_geometry with value fme_undefinedExample of non-spatial feature generated by FME SDF writer:Can somebody tell me how, if possible to write a non-spatial feature to an SDF file?Thanks

Extracting only the Shell / exterior of a building model IFC

Hi, Just throwing this out there because I'm quite new to this area. Thanks for your time and help! TLDR /questionHow can I use FME to extract only the exterior / shell of a 3D model when you cannot rely on the models structure? Background, infoI'm reciving quite a bit of complex IFC models which doesn't always follow the same structure, because they are made up of different models put together, so all the windows might not be in IFCwindows for example, it's best to assume it's scrambled. I want to transform these models to GIS and use in 3D maps. (SHP, GLTF, GLB etc)When I don't need a lot of the interior details like piping, doors inside the building, chairs, some walls etc I find myself doing a lot of manual cleaning/trimming in SimpleBIM.I'm wondering if there is a more automated way to use FME to extract only the shell of a building, and perserving the outer detail ofcourse. Sort of if I could drape a plastic bag over the model and suck the air out, ma

Cannot convert IFC file to 3D Tiles

I have tried to convert an IFC file to Cesium 3D Tiles with the Cesium 3D Tiles writer.This results in one JSON file and one or more B3DM files (depending on the IFC file structure).When I try to add the JSON and B3DM file(s) to Cesium ion, the model does not appear. How can I fix this?Is there another method to convert IFC files to 3D Tiles with FME?

Pointclouds from postgis / PostgreSQL

Hi All, Does anyone have any experience getting a pointcloud out of PostGIS? We're using the PostgreSQL extension "Pointcloud" - https://github.com/pgpointcloud/pointcloud Currently the data is stored in pcpatch data types and we extract it with pc_explode(column)::geometry. This returns to FME all of the individual points which if desired we can then recombine into a pointcloud. But is there a way to get a pointcloud out *as* a pointcloud? I've tried PC_AsText, but the JSON it returns isn't GeoJSON so I can't just feed it straight into a GeometryReplacer. And there's no PC_AsBinary for the pcpatch datatype. Anyone have any thoughts or experiences with this? Thanks, Jonathan

431

2 years ago

brandonguoContributor

asked in Data

Shp number field's decimal place is not reading properly

I have a shp file generated by QGIS with three decimal places. In FME, the feature reader seems to auto round the field. I tried to change the "Numeric attribute type handling" to "explicit width and precision", still doesn't work. Is there any way to let FME read the data as same as QGIS?

Hello, I am trying a simple conversion from KML to csv. I need to write all data from ExtendedData element, it may be SimpleData or Data key/value. All I want is csv file with custom data from kml. In a workbench I have Generic reader which reads KML ( GENERIC Reader is requirement) CSV Writer to write to csv I have connected reader to writer directly no transformer and I expecting csv file. I yet to put CoordinateExtractor to get coords from file. So I am expexting only data to be written to csv. But when I run the workspace all I get is blank csv. Here is a sample KML. <kml xmlns="http://www.opengis.net/kml/2.2"> <Document> <name>My Golf Course Example</name> <Placemark> <name>Club house</name> <ExtendedData> <Data name="holeNumber"> <value>1</value> </Data> <Data name="holeYardage"> <value>234</value> </D

CSAR Point Cloud fails when loaded through Reader

Hi,I'm trying to read in various Caris CSARPC files and some fail with the following errors: (Had to sanitises paths)I've moved the FME temporary file location to a network share that has plenty of space as I thought it was running out on the C: drive, and it is writing the temp files in the correct location.It also is not consistent, I can run other CSARPC files through reader and it works fine, some a lot big then others, not sure what is going on?? Output"FME Configuration: Source coordinate system for reader CSARPC_1[CSARPC] set to `_FME_0' as read from input dataCoordinate System `_FME_0' parameters: CS_NAME=`_FME_0' DT_NAME=`WGS84' PROJ=`MRCATK' QUAD=`1' SCL_RED=`1.0000000000' UNIT=`METER' Storing feature(s) to FME feature store file `\\\\XXXXX-share4\\XXX_GIS_Warehouse_Scratch\\temp\\wb-cache--zD5304\\Main_CSARPC -1 2 -1 0 7d1dc4d5b02aac6f53ce8974ab35efb9a70c671b.ffsupdating'FFS writer: Writing point cloud with 10028592 point(s)

Why throws my Interlis Writer a n error: class 'COM/safe/fmeobjects/FMEObjects" could not be located

I have an issue with my workspace using an Interlis Writer (ili2fme).It is running fine on my local machine, but not on a server where FME Server and ArcGIS Server is installed. Following error is listed in the logs: Writer `ch.ehi.fme.Main_1_FANOUT' of type `MULTI_WRITER' using group definition keyword `MULTI_WRITER_DEF'Creating writer for format: Swiss INTERLIS (ili2fme)Trying to find a JAVA plugin for writer named `ch.ehi.fme.Main'The class 'COM/safe/fmeobjects/FMEObjects" could not be located. Check your classpath and later in the logs: Translation FAILED.## A fatal error has been detected by the Java Runtime Environment:## EXCEPTION_ACCESS_VIOLATION(0xc0000005)at pc=0x00007ffd43921c11, pid=29404, tid=16240## JRE version: OpenJDK Runtime Environment (11.0.6+10) (build 11.0.6+10)# Java VM: OpenJDK 64-Bit Server VM (11.0.6+10, interpreted mode, compressed oops, g1 gc, windows-amd64)# Problematic frame:# C 0x00007ffd43921c11 FME Desktop Version:FME Desktop ES

How to fix the coordinates in a CSV file?

Hi, does anyone know how to fix the "Geom" field and turn it into appropriate coordinates? I downloaded the CSV file from the city of Vancouver open portal and ran it in the FEM workspace without changing any parameters, but I couldn't see any point features after. I was wondering if I should fix the attributes as the coordinates are within the same field? Thank you!

Reading additional attribute LAS file in FME

Is it possible to get an additional attribute from a las file in FME. Indeed I have an input point cloud in las format with a vertical distance attribute on each point.I need this attribute to make statistics.How to get this attribute directly when reading the las file (or other) without passing "PointCloudCoercer"?

360

2 years ago

3d_ffContributor

asked in Data

Is there a work around to be able to import Datamine, gOcad and Leapfrog 3D objects within FME to be able to automate queries and manipulations on these objects?

Convert LAS to Esri SLPK

Hi there, I have a 3D object in .las format which contains RGB values for each point in the point cloud. The goal is to get this object into an Esri .slpk format and keep the RGB values so the final object is colored correctly. The .las file doesn't have a coordinate system but has relative xyz values; seems like the object is centered at 0,0. When using the CoordinateSystemSetter, it doesn't seem to change the XY values at all. This is just part of the problem. The other problem is when I try to write out to .slpk using the Esri SLPK writer, I get this error: The layer requires triangular mesh geometries. Features whose geometries cannot be triangulated will not be written How do I convert the .las file into a triangular mesh so that it can be written to SLPK? Is this possible? Do I need a different input format? Other options could be .xyz or .pcd for the input file. I haven't really worked in this space before so any guidance for working with 3D would be helpful. Tha

2010

2 years ago

karnilContributor

asked in Data

How do I generate instantiated 3D geometry on a set of points?

Hello!I have a set of points representing the location of the tree trunks. I also have a 3D model of a tree that i want to be copied to each of the points locations. And here is the tricky part, I need them to be instanced geometries, so they do not require to much space (and rendering power) when I export to fbx, skp and dwg.I tried to read up on the GeometryInstantiator-node but I must admit, I don't quite follow what it is supposed to do. Is there an example for this availible anywhere or do anyone have a clue?Here is a screendump of my script, but it only manages to place the trees as individual models which creates a 30MB file from copies of a mere 15KB geometry-asset.:Sincerely,Robin Nilsson

740

2 years ago

robertoContributor

asked in Data

FME Server and SAML SSO

Hello,question about SSO for FME Server 2020. Is the SAML protocol supported?ThanksRoberto

180

2 years ago

datablueContributor

asked in Data

How to have a daily back up of an ArcGIS feature layer?

I have an ArcGIS feature layer with two tables that I'd like to backup daily. I've created workspace with two readers and two writers. The Esri ArcGIS Online (AGOL) Feature Service Readers read from the two tables. The Esri Geodatabase (File Geodb) Writers write to the same geodatabase (.gdb) folder. This works great. For the GeoDB writer I'm using Insert for the feature operation to append rows onto the destination table. Since I'm writing to the same GeoDB folder, over time I don't think that this is not the same as creating a copy. I'd like to try to append the date to the file name such as fileName_220503 for today so that I have a new gdb folder. I'm not sure how to do that. Ideally, storing no more than 30 or 60 days of backups would be best. So, maybe appending a number (instead of a date) would be better. I plan to run this from the Windows Task Scheduler (which I have not used before). I'm not sure how to limit the number of backups to 30 or

I want to add a feature service to my workbench, but I get a Python-related error (see image). How can I fix this?

2 years ago

arthur_bazinContributor

asked in Data

how to get the schema of two files with the same name in two different subdirectories ?

Hi, I'm creating a workbench to make some audit on GIS files. First my workbench list all files that are into a directory (including subdirectories).Then, I filter theses files to keep only the one I want to audit, for exemple every shapefiles.Finaly I get the schema of every shapefile with the <schema> output of a FeatureReader. It works really great but if I have two files with the same name in two different subdirectories my problem comes : only 1 schema is kept.That's how FME works, it unions feature types with the same name. But in my case, I need to analyse the schema of every layer even if they have the same name. This is an audit so these file can have different schema even if they have the same name. I want to have an automatic workbench and not having to create one FeatureReader for each directory. Is there anyone with an idea on how to get the schema of two files with the same name in two different subdirectories ? Thank you

2 years ago

lazarlubomirContributor

asked in Data

DWG layout - how to load raster?

Hello, please, I have met issue that I read DWG Layout in FME. But unfortunately FME is not able to load raster which should be in Layout. I use parameters "Read Paper space" as You can see in attachment. Is it bug? Or is there any workaround, how to read raster in DWG Layout? Its very uncomfortable, because I need to transform DWG Layourt to PDF. Thanks a lot!Lubo

140

2 years ago

rtreecareContributor

asked in Data

AGOL Feature Service Writer: Change number of records updated at a time.

I have a workspace that is updating about 100,000 records online. It will do a couple groups of 1000 updates before the rest service returns an error:"The error code from the server was '1000' and the message was: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding." Is there a way to get around this error? I was thinking that reducing the number of records updated per rest call would help but I dont see a way to change the number from 1000. Thanks!

230

2 years ago

datablueContributor

asked in Data

How to generate a feature layer in ArcGIS Online?

I have a feature layer with two tables in ArcGIS Online. It constantly receives new records from Survey123 survey. I'd like to join the tables together in FME them regularly import data to a new ArcGIS Online feature layer (with one table). Is this possible? Are there examples on how to do this? What transformers should I look at? Thanks.

2140

2 years ago

soothsayersContributor

asked in Data

ZMap writers have headers and within that there is zmap_format_name which by default is set to "ZMAP DEFAULT " Is there any way of writing out a different value? Thanks, Glenn

110

2 years ago

Page 41 / 273

Badge winners

reyhas earned the badge Welcome Back
alc33has earned the badge Welcome Back
rishavsharmahas earned the badge FME Form Basic Training
emiliodepalmahas earned the badge Student (Grey)
emiliodepalmahas earned the badge Teacher (Grey)

Show all badges

30,353: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.