Using readers and writers to extract and load data.
Recently active
I'm trying to convert ArcSDE to DWG file. I use a DWG file as a template. In doing so, I have a column as autocad_layer and autocad_block_name. instead of autocad_layer being used as layer name in my result, autocad_block_name is used. For example, instead of just creating a layer called Wasser_hydranten here, layers (Endhydrant, Ueberflurhydrant_neben_Rohr, Ueberflurhydrant_trennend, . . .) were created.autocad_layer was also selected as the name of layer in Writer. autocad_block_name only gets symbol and is not written as a layer in the result.
Hi, Is there a way to set the font of a text in a DGN file by using the font name?With the DGNStyler you can only set the font by the font number. In this post, https://community.safe.com/s/article/microstation-text-styles-in-fme , there's a workflow described. Basically, in microstation you add a text object for every desired font in the seedfile. In this way, a font number for each desired font is stored in the seedfile. Next, you read this seedfile with FME, to inspect all igds_font values. Still, there is no "igds_font_name" kind of attribute. So you should use the font name as the text value in the seedfile, I think. Once you extracted this mapping (font name <> font number), you remove all these text objects again from the seedfile. But for the workspace I am working on, we want the seedfile as an input/ user parameter, so this file is not fixed. So everytime a new seedfile is used, the mapping should be prepared manually. I am hoping for a better and more dy
I have thousands of photos, under multiple sub folders, which i have been attempting to extract the photo date. I have used the jpeg reader together with option to search sub folders, however, none of the exif options allow me to append the original file details. I'm new to fme so it's probably something simple as if i pick a single file then the filepathextractor works a treat.
I am creating a FME server app that reads shapefiles, applies some spatial analysis and then writes the results out to shapefile and an excel. Input shapefiles however will have varying schemas/attributes. The source I have set as a user parameter, that will prompt the input shapefile path. How do I get my reader to process/read varying schemas? I have ticked 'Merge Feature Type' on the reader. I assumed this would adjust the user attributes dynamically based on the input, but the schema remains fixed to the shapefile I set the bench up with.
can anyone tell me if FME can convert Revit file to IFC file?
Hello,I'm using FME SDF Writer, but I also need to write some non-spatial data to my SDF file.However in the SDF writer I seem to be forced to always specify a Geometry column name in the Format Parameters section of the writer.If I specify the default: "Geometry" Autocad still recognizes the feature as a spatial feature but without a geometry and it complains about this, if we want to edit such features.In the "Feature Type Properties" section of the Writer, I have used "fdo_null" for the geometry.The difference between an original SDF (with a non-spatial feature) and one generated by FME SDF writer can also be seen in the FME inspector.The features written by FME have an extra attribute: fme_geometry with value fme_undefinedExample of non-spatial feature generated by FME SDF writer:Can somebody tell me how, if possible to write a non-spatial feature to an SDF file?Thanks
Hi, Just throwing this out there because I'm quite new to this area. Thanks for your time and help! TLDR /questionHow can I use FME to extract only the exterior / shell of a 3D model when you cannot rely on the models structure? Background, infoI'm reciving quite a bit of complex IFC models which doesn't always follow the same structure, because they are made up of different models put together, so all the windows might not be in IFCwindows for example, it's best to assume it's scrambled. I want to transform these models to GIS and use in 3D maps. (SHP, GLTF, GLB etc)When I don't need a lot of the interior details like piping, doors inside the building, chairs, some walls etc I find myself doing a lot of manual cleaning/trimming in SimpleBIM.I'm wondering if there is a more automated way to use FME to extract only the shell of a building, and perserving the outer detail ofcourse. Sort of if I could drape a plastic bag over the model and suck the air out, ma
I have tried to convert an IFC file to Cesium 3D Tiles with the Cesium 3D Tiles writer.This results in one JSON file and one or more B3DM files (depending on the IFC file structure).When I try to add the JSON and B3DM file(s) to Cesium ion, the model does not appear. How can I fix this?Is there another method to convert IFC files to 3D Tiles with FME?
Hi All, Does anyone have any experience getting a pointcloud out of PostGIS? We're using the PostgreSQL extension "Pointcloud" - https://github.com/pgpointcloud/pointcloud Currently the data is stored in pcpatch data types and we extract it with pc_explode(column)::geometry. This returns to FME all of the individual points which if desired we can then recombine into a pointcloud. But is there a way to get a pointcloud out *as* a pointcloud? I've tried PC_AsText, but the JSON it returns isn't GeoJSON so I can't just feed it straight into a GeometryReplacer. And there's no PC_AsBinary for the pcpatch datatype. Anyone have any thoughts or experiences with this? Thanks, Jonathan
I have a shp file generated by QGIS with three decimal places. In FME, the feature reader seems to auto round the field. I tried to change the "Numeric attribute type handling" to "explicit width and precision", still doesn't work. Is there any way to let FME read the data as same as QGIS?
Hello, I am trying a simple conversion from KML to csv. I need to write all data from ExtendedData element, it may be SimpleData or Data key/value. All I want is csv file with custom data from kml. In a workbench I have Generic reader which reads KML ( GENERIC Reader is requirement) CSV Writer to write to csv I have connected reader to writer directly no transformer and I expecting csv file. I yet to put CoordinateExtractor to get coords from file. So I am expexting only data to be written to csv. But when I run the workspace all I get is blank csv. Here is a sample KML. <kml xmlns="http://www.opengis.net/kml/2.2"> <Document> <name>My Golf Course Example</name> <Placemark> <name>Club house</name> <ExtendedData> <Data name="holeNumber"> <value>1</value> </Data> <Data name="holeYardage"> <value>234</value> </D
Hi,I'm trying to read in various Caris CSARPC files and some fail with the following errors: (Had to sanitises paths)I've moved the FME temporary file location to a network share that has plenty of space as I thought it was running out on the C: drive, and it is writing the temp files in the correct location.It also is not consistent, I can run other CSARPC files through reader and it works fine, some a lot big then others, not sure what is going on?? Output"FME Configuration: Source coordinate system for reader CSARPC_1[CSARPC] set to `_FME_0' as read from input dataCoordinate System `_FME_0' parameters: CS_NAME=`_FME_0' DT_NAME=`WGS84' PROJ=`MRCATK' QUAD=`1' SCL_RED=`1.0000000000' UNIT=`METER' Storing feature(s) to FME feature store file `\\\\XXXXX-share4\\XXX_GIS_Warehouse_Scratch\\temp\\wb-cache--zD5304\\Main_CSARPC -1 2 -1 0 7d1dc4d5b02aac6f53ce8974ab35efb9a70c671b.ffsupdating'FFS writer: Writing point cloud with 10028592 point(s)
I have an issue with my workspace using an Interlis Writer (ili2fme).It is running fine on my local machine, but not on a server where FME Server and ArcGIS Server is installed. Following error is listed in the logs: Writer `ch.ehi.fme.Main_1_FANOUT' of type `MULTI_WRITER' using group definition keyword `MULTI_WRITER_DEF'Creating writer for format: Swiss INTERLIS (ili2fme)Trying to find a JAVA plugin for writer named `ch.ehi.fme.Main'The class 'COM/safe/fmeobjects/FMEObjects" could not be located. Check your classpath and later in the logs: Translation FAILED.## A fatal error has been detected by the Java Runtime Environment:## EXCEPTION_ACCESS_VIOLATION(0xc0000005)at pc=0x00007ffd43921c11, pid=29404, tid=16240## JRE version: OpenJDK Runtime Environment (11.0.6+10) (build 11.0.6+10)# Java VM: OpenJDK 64-Bit Server VM (11.0.6+10, interpreted mode, compressed oops, g1 gc, windows-amd64)# Problematic frame:# C 0x00007ffd43921c11 FME Desktop Version:FME Desktop ES
Hi, does anyone know how to fix the "Geom" field and turn it into appropriate coordinates? I downloaded the CSV file from the city of Vancouver open portal and ran it in the FEM workspace without changing any parameters, but I couldn't see any point features after. I was wondering if I should fix the attributes as the coordinates are within the same field? Thank you!
Is it possible to get an additional attribute from a las file in FME. Indeed I have an input point cloud in las format with a vertical distance attribute on each point.I need this attribute to make statistics.How to get this attribute directly when reading the las file (or other) without passing "PointCloudCoercer"?
Is there a work around to be able to import Datamine, gOcad and Leapfrog 3D objects within FME to be able to automate queries and manipulations on these objects?
Hi there, I have a 3D object in .las format which contains RGB values for each point in the point cloud. The goal is to get this object into an Esri .slpk format and keep the RGB values so the final object is colored correctly. The .las file doesn't have a coordinate system but has relative xyz values; seems like the object is centered at 0,0. When using the CoordinateSystemSetter, it doesn't seem to change the XY values at all. This is just part of the problem. The other problem is when I try to write out to .slpk using the Esri SLPK writer, I get this error: The layer requires triangular mesh geometries. Features whose geometries cannot be triangulated will not be written How do I convert the .las file into a triangular mesh so that it can be written to SLPK? Is this possible? Do I need a different input format? Other options could be .xyz or .pcd for the input file. I haven't really worked in this space before so any guidance for working with 3D would be helpful. Tha
Hello!I have a set of points representing the location of the tree trunks. I also have a 3D model of a tree that i want to be copied to each of the points locations. And here is the tricky part, I need them to be instanced geometries, so they do not require to much space (and rendering power) when I export to fbx, skp and dwg.I tried to read up on the GeometryInstantiator-node but I must admit, I don't quite follow what it is supposed to do. Is there an example for this availible anywhere or do anyone have a clue?Here is a screendump of my script, but it only manages to place the trees as individual models which creates a 30MB file from copies of a mere 15KB geometry-asset.:Sincerely,Robin Nilsson
Hello,question about SSO for FME Server 2020. Is the SAML protocol supported?ThanksRoberto
I have an ArcGIS feature layer with two tables that I'd like to backup daily. I've created workspace with two readers and two writers. The Esri ArcGIS Online (AGOL) Feature Service Readers read from the two tables. The Esri Geodatabase (File Geodb) Writers write to the same geodatabase (.gdb) folder. This works great. For the GeoDB writer I'm using Insert for the feature operation to append rows onto the destination table. Since I'm writing to the same GeoDB folder, over time I don't think that this is not the same as creating a copy. I'd like to try to append the date to the file name such as fileName_220503 for today so that I have a new gdb folder. I'm not sure how to do that. Ideally, storing no more than 30 or 60 days of backups would be best. So, maybe appending a number (instead of a date) would be better. I plan to run this from the Windows Task Scheduler (which I have not used before). I'm not sure how to limit the number of backups to 30 or
Hi, I'm creating a workbench to make some audit on GIS files. First my workbench list all files that are into a directory (including subdirectories).Then, I filter theses files to keep only the one I want to audit, for exemple every shapefiles.Finaly I get the schema of every shapefile with the <schema> output of a FeatureReader. It works really great but if I have two files with the same name in two different subdirectories my problem comes : only 1 schema is kept.That's how FME works, it unions feature types with the same name. But in my case, I need to analyse the schema of every layer even if they have the same name. This is an audit so these file can have different schema even if they have the same name. I want to have an automatic workbench and not having to create one FeatureReader for each directory. Is there anyone with an idea on how to get the schema of two files with the same name in two different subdirectories ? Thank you
Hello, please, I have met issue that I read DWG Layout in FME. But unfortunately FME is not able to load raster which should be in Layout. I use parameters "Read Paper space" as You can see in attachment. Is it bug? Or is there any workaround, how to read raster in DWG Layout? Its very uncomfortable, because I need to transform DWG Layourt to PDF. Thanks a lot!Lubo
I have a workspace that is updating about 100,000 records online. It will do a couple groups of 1000 updates before the rest service returns an error:"The error code from the server was '1000' and the message was: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding." Is there a way to get around this error? I was thinking that reducing the number of records updated per rest call would help but I dont see a way to change the number from 1000. Thanks!
I have a feature layer with two tables in ArcGIS Online. It constantly receives new records from Survey123 survey. I'd like to join the tables together in FME them regularly import data to a new ArcGIS Online feature layer (with one table). Is this possible? Are there examples on how to do this? What transformers should I look at? Thanks.