- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,704 Posts
24,707 Replies

When you subscribe we will email you when there is a new topic in this category

6704 Posts

Recently active

Most replies Most views Newest first

stalknechtContributor

asked in Data

Cannot insert data into ArcSDE (postgres)

I have a sde writer. When I do an update or a delete the translation is succesfull. But when I do an insert I get the following error:An error occurred while attempting to create a feature using the feature class 'db.schema.table'. The error number from ArcObjects is: '-2147220655'. The error message from ArcObjects is: {DBMS table not found [db.schema.table]}The backend is postgres: PostgreSQL 10.5, 64-bitArcgis version 10.6.1FME 2019.0 64bit also tried 2020 beta.Writer mode: versioned edit session

3 years ago

francescodb

asked in Data

Cannot write data to SDE (postgres)

I am trying to write a table to a postgres geodatabase and I am using an SDE writer. I am using FME 2020.0.1.0. I get the following error: An error occurred while attempting to create the table 'test2'. The error number from ArcObjects is: '-2147220655'. The error message from ArcObjects is: {DBMS table not found [ERROR: relation "gisowner.i23" does not existLINE 1: INSERT INTO gisowner.i23 (id_type, base_id, num_ids, last_id... ^::SQLSTATE=42P01] [dbtest.gisowner.test2]}A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for details There seem to be nothing wrong with the database, I can insert and create objects from ArcGIS Pro.

3 years ago

fmelizardContributor

asked in Data

Can FME extend into ArcGIS Pro?

I have FME and ArcGIS Pro installed. Can I extend FME into ArcGIS Pro?

3 years ago

schwerjo

asked in Data

Why does the duration of a transaction increase in the initial phase of writing millions of point features to a file geodatabase?

Hello!Having to write millions of homogenous point features to a file geodatabase (default Esri File Geodatabase Writer 3D, Vector), I noticed that the duration for a completed writing transaction/commit increases as the writing to the FGDB progresses. While the first transaction takes 0.4 seconds for 1000 features, the duration increases up to 1.5 seconds per 1000 features where it seems to level until the end of the writing process (there are no other process running):0.0|INFORM|Transaction #1 was successfully committed0.4|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 10000.0|INFORM|Transaction #2 was successfully committed0.5|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 2000...0.0|INFORM|Transaction #328 was successfully committed1.0|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 328000...0.0|INFORM|Transaction #503 was successfully committed1.4|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 503000...0.0|INFORM|Transaction #2289 was suc

3 years ago

timc

asked in Data

How can I output a list of fields/attributes that are in a shp file?

I'm just looking to be able to drop a .shp file into the workspace and extract a list of the fields/attributes contained within, into a .csv file

3 years ago

trevormContributor

asked in Data

SQLCreator help, SQL code to integrate the Initiator fields into WHERE clause doesn't seem to work.

How different is SQLCreator from SQL SMS when writing an update query?.Note: Not spatial data, just basic Feature to Feature compare to update and create my tblIriRut2020 table. This is our SQL SMS Code from last year, the 2020 will be a .csv reader in FMEUPDATE [Preservation].[dbo].[tblIriRut2019] SET AADT = tblAnnualTrafficSCD.AADT_Year1 FROM tblIriRut2019 tblIriRut2019 LEFT JOIN tblAnnualTrafficSCD tblAnnualTrafficSCD ON tblIriRut2019.RoadName = tblAnnualTrafficSCD.ROADNAME AND tblIriRut2019.FromKM >= tblAnnualTrafficSCD.FromKM AND tblIriRut2019.FromKM < tblAnnualTrafficSCD.ToKM Replace tblIriRut2019 with my Initiator (currently only 3050100MUA feature)I'm not sure how to share my SQL connection data in a .fme so you can have a real life sample. Another option:If the SQLCreator cannot handle this, how do I make a where clause in a transformer like FileMerger so I can have a multiple WHERE clause with Functions like Less than or equal to?

3 years ago

jakethepainterContributor

asked in Data

Error reading KML: Could not determine the root kml file of

I'm trying to read some USFS wildland fire data. There's a link to the kml on their website:http://www.wfas.net/google-earth/wfas_nfdr.kmzWhen I use the url in the kml reader, it downloads it to a temp file location successfully (I can see it there) and it's unzipped. It's got a folder structure about 5 deep.Then I get FATAL |KML: Could not determine the root kml file of `C:\\Users\\xxx\\AppData\\Local\\Temp\\FME_OGCKML_KMZ_1562607566639_14376' If I go to the temp file location and navigate down to the kml, I can read it in no problem.C:\\Users\\xxx\\AppData\\Local\\Temp\\FME_OGCKML_KMZ_1562607566639_14376\\fsfiles\\office\\wfas2\\dir-obs\\wfas_nfdr.kml

3 years ago

robertoContributor

asked in Data

MsWord Writer table - Error

Hi,I'm facing a strange situation with MsWordStyler and Word Writer. I need to add a table to create a report from a feature. If I don't use a template, I can chose different styles for a table with the styler. The output of the table is correct. Trying to use a template, the only option to use a template is to select "Normal Table" as table style. Any other style produce the following error:"Microsoft Word Writer: Rejecting Feature. The msword_type value 'msword_table' is invalid. Please use a MSWordStyler prior to this writer to set the msword_type attribute". Is there some hints or best practices to follow creating the template?Paragraph and image work fine with the same template.ThanksRoberto

3 years ago

ebygommContributor

asked in Data

Cannot update Oracle table using Feature Operation in Oracle Non Spatial Writer, DatabaseUpdater works fine

Has anyone ever encountered an issue with applying updates to an Oracle Non Spatial database using the writer and fme_db_operation? Have a number of records exiting a ChangeDetector that are a mix of inserts and updates. If there are any updates, the workspace hangs and fails to complete. Applying the updates using the DatabaseUpdater works fine and the process completes in 20ish minutes. Is there anything in the Writer that I might be missing before I rejig the workspace? There are 6 match columns (there is a 6 part primary key that also references these columns) The process should be making a couple of hundred updates to a table of ~1.5 million records. If there are updates present, the logging stops as soon as the first feature hits the writer and never progresses (left 14+ hours) FME 2019.2.3.1

3 years ago

bigapplerizzi19

asked in Data

Edit <core:CityModel.....> of CityGML writer

CityGML writer created the following line automatically. <core:CityModel xmlns:brid="http://www.opengis.net/citygml/bridge/2.0" ..... I would like to change the text after <core:CityModel to other text.Could you tell me the procedure?

3 years ago

davebarter

asked in Data

S3Connector - Upload dynamic filename

I am creating a CSV file in a Featurewriter with a filename created as follows:-litmap-@DateTimeFormat(@DateTimeNow(), %B-%d-%Y)This is dropped into a directory on a fixed pathHow can I pass this filename to the "File To Upload" parameter in the S3 uploader?

3 years ago

samocief

asked in Data

Extract attribute value type from ESRI shapefile

Hi there,I'm trying to read attributes from a shapefile and write them into a SQL database. I need to write also the data type for every attribute, exactly as written in shape (not based on their values). How can I extract data types from data source? Thank you for any help!

3 years ago

asked in Data

How to set feature color transforming from ESRI shapefile to DGN?

I transformed SHP to DGN, but all features are in one color. I need to apply features in color set by level. Even with seed file set or DGN file with right colored features as a color source, features from SHP data are in the right levels, but have no individual color by level. Seems like transformer is putting SHP feature in right DGN level (by attribute) but with default color, not color by level.

3 years ago

dms2Contributor

asked in Data

Best option for catching DB related errors when writing to Oracle spatial tables

My translation writes features to spatial and non spatial Oracle tables in a given order. The problem is that any eventual DB related error should be reported to a web service and also logged to an xls file.I'm using Featurewriters to control the writing order but the Featurewriter transformer has no Rejected port. How do I catch DB errors then?SQLExecutor is fine for non spatial tables but not for spatial tables with complex geometries (due to the character number limitation for sql statements).Should I keep the Featurewriter approach and use a shutdown python script to catch DB errors and do the Excel and web service part? Is there any other option?Thanks for the help.

3 years ago

angiejuvanshu

asked in Data

Hello, can someone help me with FME convert .GDB to ESRI Shape format much appreciated

3 years ago

mhabContributor

asked in Data

FME_TEMP size exploding with fts files

So I learned that *.fts files are part of the ongoing tuning efforts in FME and are written to FMETable subfolder in FME_TEMP directory.I was literally shocked yesterday when my FME_TEMP drive (256Gb SSD) suddenly ran full because FMETable seemingly "exploded" without limit from reading and processing 5Gb of ffs files.My impression is that this is a first in FME 2020 (maybe 2019 too ?) as the FME processing active at the time was little more than reading 5Gb (190 different ffs files) and writing them out as a single set of ffs. This process up to now never was in any way critical but now is a blocking point in my environment. Is it in any way explainable why 60 million features consume 250Gb+ as *.fts files - when they only need 5Gb as ffs files ?I expect not more than 40-50Gb in the FileGeoDB which will receive this whole dataset !B.T.W.: Memory use was next to nothing during this whole adventure ...I came across excessive disk space use when FME writes raster data to disk i

3 years ago

amber

asked in Data

Reading in Oracle Long Raw data

Hi all, I wondered whether anyone had come across any issues reading in data from an Oracle DB with type LONG RAW. It seems FME cannot read in data of this type and 'skips' that column when reading in an Oracle DB table. Does anyone have any pearls of wisdom on how I could load this data in to my FME workflow? Thanks all, Amber

3 years ago

tim_woodContributor

asked in Data

Can FME be launched from PowerShell?

I've been trying to run an FME Workspace using PowerShell but I'm getting errors. At the moment, it's just a test Workspace with a Creator and an Emailer.When the FMW is on a different server in a different domain, I get an error saying the FMW file could not be opened. I am mapping a drive to the other server in the PowerShell console before I try to run the Workspace.When the FMW is on the same server as the EXE and PowerShell window, I get "A fatal error has occurred. Check the logfile..." although the Workspace did seem to have completed.I've tried the same things in a Command Prompt window with no errors so I'm going to use a Batch File for now.

3 years ago

freddy17Contributor

asked in Data

Excel Multi language dictionary

Hi everyone I have an interesting question, and looking for some inspiration or advice to a problem I would like to solve. I thought I would ask the question before the FME Webinar on Excel that will be this Thursday (24.09.2020) There are a few workspaces that I need to adapt for multiple languages (English, German, French). The result is that all my outputs should be adapted for the language, meaning all texts and even the header in documents should be edited. My workflow is as follows: GoogleForms csv Input > FME Desktop Transformers > HTML Output As an exampleIn JSON one would build a multiple language dictionary like this: var arrLang = { "en-gb": { "HOME": "Home", "ABOUT": "About Us", "CONTACT": "Contact Us", }, "zh-tw": { "HOME": "首頁", "ABOUT": "關於我們", "CONTACT": "聯絡我們", }}; I am pondering what the best way to do this for my FME Workspaces. In my attached excel, I have used Lists to achieve a similar result, but how c

3 years ago

leuciriccardo

asked in Data

IMPORT KML AND/OR EDIT GOOGLE MY MAPS.

I tried with google fusion Table, but the service is down. if anyone has alternative to mymaps for creating an editable map on field, i am all ears

3 years ago

havmoejbvContributor

asked in Data

Reading LandXML CgPoints Feature info

I have some LandXML files containing points (CgPoints) and lines (PlanFeature) with some attributes. As per the LandXML schema, the <CgPoints> are defined with the coordinate geometry as a <CgPoint>, and the attribute information as <Feature> with properties: <CgPoints> <CgPoint name="TRAU201" code="" oID="TRAU201">1256922.890706 84309.502725 165.818283</CgPoint> <Feature code="Gemini attributes"> <Property label="S_OBJID" value="TRAU201"/> <Property label="S_FIELDCODE" value="41050"/> </Feature> </CgPoints>What I am struggling with is to read the Feature information. The LandXML reader gives me an option read both CgPoints and CgPoint, but not Feature. CgPoint will give me the name, code and oID above, but my Feature attributes are not there... I need to extract the "S_FIELDCODE" value along with the geometry, but how?

3 years ago

ghattas111

asked in Data

Autocad reader: get the version of a dwg file

Hello, I'm reading multi dwg files using dwg reader and need to get the version chossed when the user saved dwg file. i can see it in translation log when i run the reader but i couldn't get it as an attribute. any ideas or maybe transformator that i didn't find ´?

3 years ago

joshuadamron

asked in Data

REST to FGDB error - "GEODATABASE_FILE writer: An unknown exception occurred"

I am experiencing an error when reading AGOL feature services that are publicly available as REST services and writing them locally to a file geodatabase. I am using the Esri ArcGIS Server Feature Service reader and the Esri Geodatabase (File Geodb) writer. However, I am having an issue where the translation fails when writing to the file geodatabase.To clarify, I have no issues reading the data into FME however when writing to file geodatabase I get a single error message in the translation:2020-06-16 12:02:03| 4.0| 0.0|FATAL |GEODATABASE_FILE writer: An unknown exception occurred Attached is the workbench: Data source: the AGOL REST service URL I am reading is here: https://services1.arcgis.com/8CpMUd3fdw6aXef7/ArcGIS/rest/services/Parcel_Service/FeatureServer Trouble shooting this issue found:I am able to write to shape file with success for the most partHowever I've observed that when writing to shapefile in some cases some fields are written with no values and in small numb

3 years ago

olex25

asked in Data

How to convert AIXM 5.1 file to ESRI geodatabase or shapefile? What kind of Transformers I should use?

I need to get geometry and attributes out of AIXM 5.1 into ESRI geodatabase.

4 years ago

lifalin2016Contributor

asked in Data

Paging in WFS 2.0.0 ?

Hi list.Does the FeatureReader reading WFS 2.0.0 data handle paging ?If a service is known to be limited to return a maximum number of features per call, paging, i.e. fetching the complete dataset in chunks, is a way to handle this.However, the only options I see are "Max Features" and "Count", but they don't incur paging, as far as I can tell.So how does FME handle WFS 2.0.0 paging ?CheersLars I

4 years ago

Page 56 / 269

Badge winners

farfarhas earned the badge FME Form Advanced Training
joschhas earned the badge Student (Grey)
hkingsburyhas earned the badge FME Certified Trainer
yamanakahas earned the badge Spanish Speaker
yamanakahas earned the badge English Speaker

Show all badges

29,738: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.