- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,812 Posts
25,087 Replies

When you subscribe we will email you when there is a new topic in this category

6812 Posts

Extracting all coordinates/vertexes for a line (a street) in SHP

Hello, I have a shape file with few streets and I would like to extract all coordinates forming each line/street inside a new Attribute. Taking a look at picture attached, I would like to copy all sets of coordinates from IFMELine to a new attribute that I will be creating.Any ideas how to solve this issue? Thank you very much!

Issue reading data from a Oracle Synonym via database-link.

We use to be able to read data from an Oracle Synonym pointing to a table via a database link. But now we are getting a strange error and are unable to see the attributes any more. Warning: Unable to use schema obtained for Oracle Spatial layer 'schema.table' We are getting the same error from both "Oracle Autonomous Non-Spatial" and "Oracle Non-Spatial" that use to work before. I have looked into this article https://community.safe.com/s/article/working-with-synonyms-in-oracle and executed the command on a test synonym without any luck. Have somebody else seen this issue before and have any knowledge of how to get it working again. We are not sure what happened, suggestions are much welcome. The synonyms work just fine with normal SQL, it's just FME Desktop we see issues. We are running Oracle 12.0.1 on Windows in a test/developer environment. FME 2020.1.1.1 (20200817 - Build 20614 - WIN64)FME Desktop Professional Edition Oracle 12.0.1 Client 64-bit -

How to convert a building model in IFC format into .gdb in ArcGIS pro

Hi, I am very new to FME! I am using the data interoperability extension of ArcGIS pro. I want to convert an IFC file to geodatabase feature classes, any tips on where to start or what tutorials or transformers to use? thanks

ERROR READING DATABASE FEATURE LAYER: 2147154945

i have a model, that has been runned every day, and worked great. Now i am getting an error, while reading a feature layer from database. Can someone help me? Rebooting and ading new connections didnt work. The model stucked, nothing happenes

4 years ago

udo

asked in Data

Convert an individual cell from a netcdf wave model file to a time series table

I have a sample file from a gridded wave model for a small section on the South coast of England, ie it is a lat/long grid covering a few hours with 11 variables (wave height, wave period, that sort of thing) for each hour. I can view the file with Panoply.While the larger spatial overview is great, I would love to extract a time series for a couple of grid cells with all parameters so i can for example compare the data with measured wave buoy data.It should be quite easy as the the output should just be a table with the 11 variables as columns and each hour as a row (in a date/time format), but given the netcdf format this does not seem quite so straight forward - at least at my level of FME understanding :-) .Not urgent but any pointers would be very welcome.Thanks!

How to get data type of fields/attributes in a shp file

Looking to drop a shp file into workspace and extract the data type of each field. e.g. Address.shp may have fields StreetName (text) and StreetNumber (int). I would like to be able to extract the type for each field:StreetName - fme_char(254)StreetNumber - fme_int32 I understand that FME maps the Data Types from different files based on the reader being used to an equivalent FME Data Type https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Workbench/!FeatureTypeProperties/attribute_types.htm

How to import .dgn file into unreal engine using datasmith writer

Hello, I'm trying to get a workspace going to read in a .dgn of some modeled power lines and then write them to a datasmith package. The dgn is read in okay but no assets are written by the datasmith writer. The Udatasmith file is created but there is no info in it and the scene_assets folder is empty.I would also like to set-up a writer to bring a DEM into Unreal so any if you have any suggestions there it would be greatly appreciated. I know it's\\important to have Imagery/surfaces tiled properly for Unreal. Cheers,

Can't overwrite existing gdb file

Hi I have a problem with overwriting the existing gdb file.. Scenario: There is a new data that I need to insert/update into the gdb file without having to create a new gdb file... I have tried by using shp as reader and gdb as writer (It works) but when I uses gdb as reader and the same gdb as writer (Because I need the updated/new data to be in the same gdb file -FAILED).... I tried to look into the error but there is no clear explanation in the translation log.... Can anyone help me out on this?

FME server error with arcSDE Gdb

Hi FME server experts,When I am trying to run my workbench from FME server which read the data from arcSDE GDB i feced the below error :"Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147220952'. The error message from ArcObjects is: {The Product License has not been initialized}Please ensure the connection parameters are correct (server=`test', instance=`sde:oracle11g:test', user=`lb', password=`***', database=`', version=`SDE.DEFAULT')A fatal error has occurred. Check the logfile above for details I have installed ArcGIS pro software and configure the license configured to it "Advance".I had a test to run the workbench from fme desktop it worked probably but the issue is with FME server.anyone can assist me with this?

1300

4 years ago

jugoslaviaaSupporter

asked in Data

Reading dwg file and filtering per filename

I have over 30 dwg files. Is there any way I read all at once but I filter them based their file name (1.dwg, 2.dwg)? I need to create Convexthull per dwg file and find out whether they are overlapping. When I read all dwg file by choosing (Single Merged Feature type) it comes like this .

960

4 years ago

takashiContributor

asked in Data

Is it possible to set default color to CityGML buildings showing on Cesium ion?

I created a workspace that reads buildings from an existing CityGML dataset, sets appearance (color) to them with the AppearanceSetter, saves them as a new CityGML dataset, then uploads the dataset to Cesium ion with the CesiumIonConnector. Destination dataset has been successfully created and the buildings are shown with expected color with FME Data Inspector.Uploading to Cesium ion was also succeeded, but the buildings are shown with no color. Is there any way to set a color to CityGML buildings showing on Cesium ion, through FME workspace?

I am creating a new annotation class in FME(R) 2020.1.2.0 (20200902 - Build 20620 - WIN64) The new annotation class hasn't ArcGIS Pro-format but must be upgraded in Pro. How do I create an annotation class in ArcGIS Pro format?

I am using Esri Geodatabase Reader/Writer

Overwriting feature service with relationship class in AGOL using FME

Hi expert, I have a question about once publishing relationship classes and the related feature layers from ARCGIS, how to overwriting it from FME? Do I only need to overwrite the feature layers or also need to overwrite the relationship class from FME? Thanks!

Extracting transformation Matrix

Hi, Looking to extract the transformation matrix information from an E57 pointcloud file. Is there a way to do this? I know the information can be found in FME Data Inspector. Thanks

6413

4 years ago

stalknechtContributor

asked in Data

How to set top and bottom elevation for BuildingStoreys in IFC writer

I'am trying to set the top and bottom elevation for the BuildingStoreys.. The writer does not have the ifc_elevation attribute to set global and local elevations. Now the bottom elevation is always 0 and the top elevation is relative to ground zero and not the floor how it should be.

250

4 years ago

lazarlubomirContributor

asked in Data

Support for LERC format in FME?

Hello everyone, please, does FME support LERC format (https://github.com/Esri/lerc)? If not, are You thinking about it? :-) Thanks a lot!Lubo

150

4 years ago

stalknechtContributor

asked in Data

Cannot insert data into ArcSDE (postgres)

I have a sde writer. When I do an update or a delete the translation is succesfull. But when I do an insert I get the following error:An error occurred while attempting to create a feature using the feature class 'db.schema.table'. The error number from ArcObjects is: '-2147220655'. The error message from ArcObjects is: {DBMS table not found [db.schema.table]}The backend is postgres: PostgreSQL 10.5, 64-bitArcgis version 10.6.1FME 2019.0 64bit also tried 2020 beta.Writer mode: versioned edit session

Cannot write data to SDE (postgres)

I am trying to write a table to a postgres geodatabase and I am using an SDE writer. I am using FME 2020.0.1.0. I get the following error: An error occurred while attempting to create the table 'test2'. The error number from ArcObjects is: '-2147220655'. The error message from ArcObjects is: {DBMS table not found [ERROR: relation "gisowner.i23" does not existLINE 1: INSERT INTO gisowner.i23 (id_type, base_id, num_ids, last_id... ^::SQLSTATE=42P01] [dbtest.gisowner.test2]}A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for details There seem to be nothing wrong with the database, I can insert and create objects from ArcGIS Pro.

1180

4 years ago

fmelizardContributor

asked in Data

Can FME extend into ArcGIS Pro?

I have FME and ArcGIS Pro installed. Can I extend FME into ArcGIS Pro?

Why does the duration of a transaction increase in the initial phase of writing millions of point features to a file geodatabase?

Hello!Having to write millions of homogenous point features to a file geodatabase (default Esri File Geodatabase Writer 3D, Vector), I noticed that the duration for a completed writing transaction/commit increases as the writing to the FGDB progresses. While the first transaction takes 0.4 seconds for 1000 features, the duration increases up to 1.5 seconds per 1000 features where it seems to level until the end of the writing process (there are no other process running):0.0|INFORM|Transaction #1 was successfully committed0.4|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 10000.0|INFORM|Transaction #2 was successfully committed0.5|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 2000...0.0|INFORM|Transaction #328 was successfully committed1.0|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 328000...0.0|INFORM|Transaction #503 was successfully committed1.4|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 503000...0.0|INFORM|Transaction #2289 was suc

How can I output a list of fields/attributes that are in a shp file?

I'm just looking to be able to drop a .shp file into the workspace and extract a list of the fields/attributes contained within, into a .csv file

260

4 years ago

trevormContributor

asked in Data

SQLCreator help, SQL code to integrate the Initiator fields into WHERE clause doesn't seem to work.

How different is SQLCreator from SQL SMS when writing an update query?.Note: Not spatial data, just basic Feature to Feature compare to update and create my tblIriRut2020 table. This is our SQL SMS Code from last year, the 2020 will be a .csv reader in FMEUPDATE [Preservation].[dbo].[tblIriRut2019] SET AADT = tblAnnualTrafficSCD.AADT_Year1 FROM tblIriRut2019 tblIriRut2019 LEFT JOIN tblAnnualTrafficSCD tblAnnualTrafficSCD ON tblIriRut2019.RoadName = tblAnnualTrafficSCD.ROADNAME AND tblIriRut2019.FromKM >= tblAnnualTrafficSCD.FromKM AND tblIriRut2019.FromKM < tblAnnualTrafficSCD.ToKM Replace tblIriRut2019 with my Initiator (currently only 3050100MUA feature)I'm not sure how to share my SQL connection data in a .fme so you can have a real life sample. Another option:If the SQLCreator cannot handle this, how do I make a where clause in a transformer like FileMerger so I can have a multiple WHERE clause with Functions like Less than or equal to?

387

4 years ago

jakethepainterContributor

asked in Data

Error reading KML: Could not determine the root kml file of

I'm trying to read some USFS wildland fire data. There's a link to the kml on their website:http://www.wfas.net/google-earth/wfas_nfdr.kmzWhen I use the url in the kml reader, it downloads it to a temp file location successfully (I can see it there) and it's unzipped. It's got a folder structure about 5 deep.Then I get FATAL |KML: Could not determine the root kml file of `C:\\Users\\xxx\\AppData\\Local\\Temp\\FME_OGCKML_KMZ_1562607566639_14376' If I go to the temp file location and navigate down to the kml, I can read it in no problem.C:\\Users\\xxx\\AppData\\Local\\Temp\\FME_OGCKML_KMZ_1562607566639_14376\\fsfiles\\office\\wfas2\\dir-obs\\wfas_nfdr.kml

187

4 years ago

robertoContributor

asked in Data

MsWord Writer table - Error

Hi,I'm facing a strange situation with MsWordStyler and Word Writer. I need to add a table to create a report from a feature. If I don't use a template, I can chose different styles for a table with the styler. The output of the table is correct. Trying to use a template, the only option to use a template is to select "Normal Table" as table style. Any other style produce the following error:"Microsoft Word Writer: Rejecting Feature. The msword_type value 'msword_table' is invalid. Please use a MSWordStyler prior to this writer to set the msword_type attribute". Is there some hints or best practices to follow creating the template?Paragraph and image work fine with the same template.ThanksRoberto

370

4 years ago

ebygommSupporter

asked in Data

Cannot update Oracle table using Feature Operation in Oracle Non Spatial Writer, DatabaseUpdater works fine

Has anyone ever encountered an issue with applying updates to an Oracle Non Spatial database using the writer and fme_db_operation? Have a number of records exiting a ChangeDetector that are a mix of inserts and updates. If there are any updates, the workspace hangs and fails to complete. Applying the updates using the DatabaseUpdater works fine and the process completes in 20ish minutes. Is there anything in the Writer that I might be missing before I rejig the workspace? There are 6 match columns (there is a 6 part primary key that also references these columns) The process should be making a couple of hundred updates to a table of ~1.5 million records. If there are updates present, the logging stops as soon as the first feature hits the writer and never progresses (left 14+ hours) FME 2019.2.3.1

570

4 years ago

Page 60 / 273

Badge winners

to138312has earned the badge Teacher (Grey)
to138312has earned the badge Student (Grey)
ghvuvhas earned the badge Teacher (Bronze)
gdsvggxgegshfdbhas earned the badge Conversationalist
ghvuvhas earned the badge Expert (Grey)

Show all badges

30,664: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.