Using readers and writers to extract and load data.
Recently active
I have a large number of text files of traffic count locations that contain both header information with necessary attribute fields and 2 fixed width sets of data that I also need to bring in as attributes. I am looking to ultimately create a table where the info from each text file is one row/feature in the table so I can join it to an existing point feature class with the Reference Number being the join field. I could do multiple tables if I have to also. I can't seem to figure out a good way to get both the Header attributes as well as the fixed width attributes. A sample of one of the text files:They are actually .tam, .tpm and .tms files (no idea what those file formats actually are and google was not really any help) but they can be read as .txt files. I have attached one that I saved as a .txt as a sample
Supports geolocation the new application for Android?
At first you get the warning: 2022-06-08 09:00:12| 1.4| 0.0|INFORM|Creating reader for format: Oracle Spatial Object2022-06-08 09:00:12| 1.5| 0.0|INFORM|Performing query against ORACLE_SPATIAL dataset ` ----'2022-06-08 09:00:12| 1.5| 0.0|INFORM|ORACLE Reader: Using Oracle Reader to read tables from database `', server type `ORACLE8i', server name `----', user name `----, password `***'2022-06-08 09:00:12| 1.5| 0.0|INFORM|ORACLE Reader: Using Rich geometry.2022-06-08 09:00:12| 1.5| 0.0|INFORM|Loaded module 'OCI' from file 'OCI.dll'2022-06-08 09:00:12| 1.6| 0.1|INFORM|Environment variable ORACLE_HOME is not set.2022-06-08 09:00:12| 1.6| 0.0|INFORM|Connecting to ORACLE database `----' with user name of `----' and password of `***'2022-06-08 09:00:13| 1.6| 0.1|WARN |Error connecting to Oracle database: message was `ORA-01017: invalid username/password; logon denied'. (serverType=`ORACLE8i', serverName=`----', userName=`---
Hello,I have a georeferenced dwg file with lines, polygons and text that I'd like to convert to kml for view in Google Earth complete with the AutoCAD layers. I have been successful with creating a KML file that opens in Google Earth but still some problems. when viewing in FME Inspector everything except the text shows and the layers are missing. When I open the file in Google Earth only the points show and on the Places bar each object is shown on a long list, I want to see the layers like in Autocad and do not want to see the individual objetcsLooks very promising otherwise.Thanks
I have been trying to change a file extension from .bil into .flt based off this link https://community.safe.com/s/question/0D54Q000080hEslSAE/how-to-change-filename-extension-via-fmeBut I cant get the FeatureMerged to merge what am doing wrong?There will be other files and different file types in the same Folder so not sure yet, if this process/workflow will change the other files as this would not be desired.But for now I'm just trying to get the FeatureMerger to work.
80192022-6-6 16:37:01 | Unable to flush the cursor for the feature class 'BCNCAR' because the spatial index is too small. Increase the spatial index on 'BCNCAR' and retry80202022-6-6 16:37:01 | GEODATABASE_SDE writer: A fatal error has occurred. Check the logfile above for details Weekly we download all .000 Electronic Charts, run them through a workbench which writes to Oracle. The workbench runs but throws this errors, so were not getting as many records as we should. Attached is the workbench. FME Server 2021.2.5Build 21816 - win64Oracle 19CArcmap 10.8.1 with 64 geoprocessing extension
Recently updated to 2022 and can no longer see a table through a portal connection.I can still see the other three feature classes but not the table. Is this a bug in the new version of SDE or did something change?
*** Will be cross-posting here and on ESRI community/geonet.*** I have an FME process that uses the SPROC's for versioned editing with the .evw views inside an FME SQL Executor...-- Change to the FME version EXEC sde.set_current_version 'myFMEversion';EXEC sde.edit_version 'myFMEversion', 1; -- DO MY THING HEREEXEC sde.edit_version 'myFMEversion', 2; This has been working great in one database and running in FME Server under a service account. Now, when I try and use it in another database, after creating a 'Public' version called 'myFMEversion', I can run it in FME Desktop successfully where I'm Admin on that DB. But when I run it in server which uses the service account, it fails with this error:360 | Microsoft SQL Server Non-Spatial Reader: Query failed, possibly due to a malformed statement. Query Text `-- Change to the FME version 361 | EXEC dbo.set_current_version 'myFMEversion''. Provider error `(-2147217900) Version myFMEversion not found.' 362 | A fatal error has occurred. C
Hi,I have tried several parameters with the "Landsat-8 on AWS" reader, but every time, it returns nothing. I have included on screenshot of the reader. Would you have any idea why it doesn't work? Thanks!
When I try, it throws an error. Indeed, there's no button in the editor that seems to offer user parameters as an option. I'm currently on FME 2021.0. Thanks.
I am trying to export an Esri geodatabase as ifc using some of the transformers provided in a tutorial for DWG to ifc but I end up with ifc file that has no geometry stored.
I have read multiple questions\\answers\\commentaries around this topic and I may be more confused than before.Here is the scenario:I have an excel workbookThe sheet names are always the sameSome of the columns are static Some of the column names change-- and sometimes there are more or less columnsI need to capture the column names and row values then process the infoThe only way I have seen to update columns is to manually refresh the reader with 'Update Feature Types'Is there a way to dynamically read in new or changed excel column names without manual intervention? FME 2021.2Thanks!
I'm trying to convert ArcSDE to DWG file. I use a DWG file as a template. In doing so, I have a column as autocad_layer and autocad_block_name. instead of autocad_layer being used as layer name in my result, autocad_block_name is used. For example, instead of just creating a layer called Wasser_hydranten here, layers (Endhydrant, Ueberflurhydrant_neben_Rohr, Ueberflurhydrant_trennend, . . .) were created.autocad_layer was also selected as the name of layer in Writer. autocad_block_name only gets symbol and is not written as a layer in the result.
Hi, Is there a way to set the font of a text in a DGN file by using the font name?With the DGNStyler you can only set the font by the font number. In this post, https://community.safe.com/s/article/microstation-text-styles-in-fme , there's a workflow described. Basically, in microstation you add a text object for every desired font in the seedfile. In this way, a font number for each desired font is stored in the seedfile. Next, you read this seedfile with FME, to inspect all igds_font values. Still, there is no "igds_font_name" kind of attribute. So you should use the font name as the text value in the seedfile, I think. Once you extracted this mapping (font name <> font number), you remove all these text objects again from the seedfile. But for the workspace I am working on, we want the seedfile as an input/ user parameter, so this file is not fixed. So everytime a new seedfile is used, the mapping should be prepared manually. I am hoping for a better and more dy
I have thousands of photos, under multiple sub folders, which i have been attempting to extract the photo date. I have used the jpeg reader together with option to search sub folders, however, none of the exif options allow me to append the original file details. I'm new to fme so it's probably something simple as if i pick a single file then the filepathextractor works a treat.
I am creating a FME server app that reads shapefiles, applies some spatial analysis and then writes the results out to shapefile and an excel. Input shapefiles however will have varying schemas/attributes. The source I have set as a user parameter, that will prompt the input shapefile path. How do I get my reader to process/read varying schemas? I have ticked 'Merge Feature Type' on the reader. I assumed this would adjust the user attributes dynamically based on the input, but the schema remains fixed to the shapefile I set the bench up with.
can anyone tell me if FME can convert Revit file to IFC file?
Hello,I'm using FME SDF Writer, but I also need to write some non-spatial data to my SDF file.However in the SDF writer I seem to be forced to always specify a Geometry column name in the Format Parameters section of the writer.If I specify the default: "Geometry" Autocad still recognizes the feature as a spatial feature but without a geometry and it complains about this, if we want to edit such features.In the "Feature Type Properties" section of the Writer, I have used "fdo_null" for the geometry.The difference between an original SDF (with a non-spatial feature) and one generated by FME SDF writer can also be seen in the FME inspector.The features written by FME have an extra attribute: fme_geometry with value fme_undefinedExample of non-spatial feature generated by FME SDF writer:Can somebody tell me how, if possible to write a non-spatial feature to an SDF file?Thanks
Hi, Just throwing this out there because I'm quite new to this area. Thanks for your time and help! TLDR /questionHow can I use FME to extract only the exterior / shell of a 3D model when you cannot rely on the models structure? Background, infoI'm reciving quite a bit of complex IFC models which doesn't always follow the same structure, because they are made up of different models put together, so all the windows might not be in IFCwindows for example, it's best to assume it's scrambled. I want to transform these models to GIS and use in 3D maps. (SHP, GLTF, GLB etc)When I don't need a lot of the interior details like piping, doors inside the building, chairs, some walls etc I find myself doing a lot of manual cleaning/trimming in SimpleBIM.I'm wondering if there is a more automated way to use FME to extract only the shell of a building, and perserving the outer detail ofcourse. Sort of if I could drape a plastic bag over the model and suck the air out, ma
I have tried to convert an IFC file to Cesium 3D Tiles with the Cesium 3D Tiles writer.This results in one JSON file and one or more B3DM files (depending on the IFC file structure).When I try to add the JSON and B3DM file(s) to Cesium ion, the model does not appear. How can I fix this?Is there another method to convert IFC files to 3D Tiles with FME?
Hi All, Does anyone have any experience getting a pointcloud out of PostGIS? We're using the PostgreSQL extension "Pointcloud" - https://github.com/pgpointcloud/pointcloud Currently the data is stored in pcpatch data types and we extract it with pc_explode(column)::geometry. This returns to FME all of the individual points which if desired we can then recombine into a pointcloud. But is there a way to get a pointcloud out *as* a pointcloud? I've tried PC_AsText, but the JSON it returns isn't GeoJSON so I can't just feed it straight into a GeometryReplacer. And there's no PC_AsBinary for the pcpatch datatype. Anyone have any thoughts or experiences with this? Thanks, Jonathan
I have a shp file generated by QGIS with three decimal places. In FME, the feature reader seems to auto round the field. I tried to change the "Numeric attribute type handling" to "explicit width and precision", still doesn't work. Is there any way to let FME read the data as same as QGIS?
Hello, I am trying a simple conversion from KML to csv. I need to write all data from ExtendedData element, it may be SimpleData or Data key/value. All I want is csv file with custom data from kml. In a workbench I have Generic reader which reads KML ( GENERIC Reader is requirement) CSV Writer to write to csv I have connected reader to writer directly no transformer and I expecting csv file. I yet to put CoordinateExtractor to get coords from file. So I am expexting only data to be written to csv. But when I run the workspace all I get is blank csv. Here is a sample KML. <kml xmlns="http://www.opengis.net/kml/2.2"> <Document> <name>My Golf Course Example</name> <Placemark> <name>Club house</name> <ExtendedData> <Data name="holeNumber"> <value>1</value> </Data> <Data name="holeYardage"> <value>234</value> </D
Hi,I'm trying to read in various Caris CSARPC files and some fail with the following errors: (Had to sanitises paths)I've moved the FME temporary file location to a network share that has plenty of space as I thought it was running out on the C: drive, and it is writing the temp files in the correct location.It also is not consistent, I can run other CSARPC files through reader and it works fine, some a lot big then others, not sure what is going on?? Output"FME Configuration: Source coordinate system for reader CSARPC_1[CSARPC] set to `_FME_0' as read from input dataCoordinate System `_FME_0' parameters: CS_NAME=`_FME_0' DT_NAME=`WGS84' PROJ=`MRCATK' QUAD=`1' SCL_RED=`1.0000000000' UNIT=`METER' Storing feature(s) to FME feature store file `\\\\XXXXX-share4\\XXX_GIS_Warehouse_Scratch\\temp\\wb-cache--zD5304\\Main_CSARPC -1 2 -1 0 7d1dc4d5b02aac6f53ce8974ab35efb9a70c671b.ffsupdating'FFS writer: Writing point cloud with 10028592 point(s)
I have an issue with my workspace using an Interlis Writer (ili2fme).It is running fine on my local machine, but not on a server where FME Server and ArcGIS Server is installed. Following error is listed in the logs: Writer `ch.ehi.fme.Main_1_FANOUT' of type `MULTI_WRITER' using group definition keyword `MULTI_WRITER_DEF'Creating writer for format: Swiss INTERLIS (ili2fme)Trying to find a JAVA plugin for writer named `ch.ehi.fme.Main'The class 'COM/safe/fmeobjects/FMEObjects" could not be located. Check your classpath and later in the logs: Translation FAILED.## A fatal error has been detected by the Java Runtime Environment:## EXCEPTION_ACCESS_VIOLATION(0xc0000005)at pc=0x00007ffd43921c11, pid=29404, tid=16240## JRE version: OpenJDK Runtime Environment (11.0.6+10) (build 11.0.6+10)# Java VM: OpenJDK 64-Bit Server VM (11.0.6+10, interpreted mode, compressed oops, g1 gc, windows-amd64)# Problematic frame:# C 0x00007ffd43921c11 FME Desktop Version:FME Desktop ES