- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,780 Posts
24,925 Replies

When you subscribe we will email you when there is a new topic in this category

6780 Posts

Recently active

Most replies Most views Newest first

brigousse

asked in Data

i convert some closed line (from dgn exploded cell) in area and those aeras would be normaly written into a shape

But i have Always the same message :Polygon feature must have at least 4 coordinates to be valid for the shape file. The feature will be skippedREJECTING BELOW FEATURE:And i dont understand what is really the problemCan you help me pleasethanks

5 years ago

ireenContributor

asked in Data

MSACCESS_JDBC Reader fails to obtain table schema's in FME Desktop 2019

The MS Access (JDBC) Reader gives an error reading table schema's in FME 2019. The workspace still works fine in FME 2018.1, but generates the following log in version 2019.0: MS Access (JDBC) Reader: Connected to 'UCanAccess driver for Microsoft Access databases using HSQLDB' version 'V2007 [VERSION_12]' using driver 'Ucanaccess' version '4.0.4' built against JDBC version '4.0'MS Access (JDBC) Reader: Error reading schema for table 'qry02_Energiesnoeiers'. Error: <null>java.lang.NullPointerException at COM.safe.fme.jdbc.msaccess.MsAccessBackendHelper.createColumnMetadata(MsAccessBackendHelper.java:343) at COM.safe.fme.jdbc.JdbcBackendHelper.getTableSchema(JdbcBackendHelper.java:129) at COM.safe.fme.jdbc.JdbcReader.readSchema(JdbcReader.java:948) at COM.safe.fme.jdbc.JdbcReader.readSchemaHelper(JdbcReader.java:872) at COM.safe.fme.jdbc.JdbcReader.readSchema(JdbcReader.java:830)java.lang.NullPointerExceptionFailed to obtain any schemas from reader 'MSACCESS_JDBC' f

FME Server SQL Server Compatibility

We are trying to upgrade our SQL Server to 2016, does the latest version of FME Workspace compatible with SQL Server 2016?

kimoContributor

I am suddenly receiving a pipe separated text file with imbedded pseudo-unicode characters that are supposed to be a macronated 'o'. Unfortunately it translates to a ^Z in the ASCII file.All the vowels can have macrons in Maori and there is a new policy that all government departments must add macrons. If all software was unicode aware then this might work.Some programs will handle this, reading the whole file regardless of the ^Z but many stop. The FME CSV2 reader stops. Oddly the FME Textfile reader does handle them with encoding set to DOS-Latin-1 (ibm-850)What can I do?The simplest idea is to translate the pair of characters ^Zo back to a plain ascii o.Surely tr could just strip the ^Z...nope.I have tried to use utf-8 encoding parameter on the CSV reader and other tricks with tr without success.I have attached a test sample.asc of two records.Unix wc -l returns a count of 1, not a good start since I can cat two records.

142

5 years ago

pushpaContributor

asked in Data

How to extract Geometry from Oracle Spatial Database for a list of grid tiles

Hi I have a list of grid tiles on Esri shape format. Those tiles are not clustered, tiles can be anywhere in the country. I need to extract geometry within those Tiles, from an Oracle spatial DatabaseHow do I go by without reading all the features on the entire Database?thanks

5 years ago

jacklonsdaleContributor

asked in Data

Write New Geodatabase every x features

Hi all,I have a set of 8000+ GML files that i wish to batch process into a geodatabase, i have found that putting them a workspace runner is effective but slows down massively past 50 GML files. Therefore, i want a way to write a new geodatabase file every 50 features, to reduce the 8000 GML files to 160 geodatabases to then combine afterwards.Has anyone any ideas? Apart from a huge conditional value in attribute manager!CheersJack

Writing extended data to DWG

I am having some problems writing extended attributes to a dwg, I have attached the source dwg and my workflow.The source dwg contains a polyline that has several fields of extended data, my aim is to be able to change a few of the fields with a string replacer, for example in this case change “JSY” to “CWG”.I am able to inspect the extended data list in the reader and change the values, however when it comes to writing to dwg the attributes don’t come through. Running the command XDLIST, shows no extended entity data on the entity.Any help would be appreciated.

'Drop and Create' on SDE Feature Class with Attachments deletes the attachments

Hi there - I'm trying to make schema changes to an SDE feature class as well as an SDE table.... both have attachments and the obligatory relationship class. When I try and output to the writer using "Drop and create", the attachments (and relationship class) are deleted. But when I output using another option (e.g. truncate), they are not deleted. I'd like to use "drop and create" because we need to reorder fields and add new ones. Wondering if I'm doing something wrong, or not understanding the process, or not using a much better alternative. Or possibly all 3!

642

5 years ago

fmelizardContributor

asked in Data

SQL Server Reader locking table

I have multiple FME workbenches that read from a single SQL Server Spatial Database. This is a global database so I often have more than one workbench trying to access the database. However, it seems like the first workbench is locking the table preventing others from reading from it. This seems more likely to be an issue if the SQL table has triggers enabled. Is there away to get around this problem?

creating kml file with 3D SketchUp models

Hello everybody, I need to create a kml file with 3D geometry in .dae format (SketchUp). The links are in the table of my source file with point geometry. I need to obtain this: Is there anybody who knows how to do?Thank you!

No commit or update with a postgresql writer

HiI juste use an AttributeManager after a reader which works fine. My value is changed.but the writer doesn't update my record in the table.I tried all options in the writer to match the row selection ... nothing works.Do you have an idea about this issue ?Thanks

5 years ago

nick-j

asked in Data

Create sharepoint List if not exist

Hello, I would like to write some data from my statisticscalculator to a sharepoint list. If the list with the autocad input name does not exist, it should create a new list with the same name as the autocad input. After Running my current workspace it tells me the following:Cannot find a matching schema named 'C:\Cloud\Sync\_Projecten\FME\Inwerken Progress Checker/Input\Fme Generated\Karteringen&Areas.dwg' in the known set of schemas: ''. Known schema sources are: 'SHAREPOINT_2'. Please verify writer feature type configuration.Python Exception <KeyError>: 'C:\\Cloud\\Sync\\_Projecten\\FME\\Inwerken Progress Checker/Input\\Fme Generated\\Karteringen&Areas.dwg'A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for details I am confused as to why it it wont create a new one. My writer has been set up like this: my Current workspace looks like this T

Dynamically Create FileGeodatabase output?

I have a input file geodatabase that just has points. The workbench first uses the file name extractor transformer to get info on the input file. I use the results from the file name extractor to build out the output file path because I want it to be dynamic. For ExampleInput: C:/Temp/Input.gdbOutput: C:/Temp/Output.gdb (Dynamically created based on the file dir of the Input, name would also be generated)On the output file geodatabase destination fanout directory I put in the user param "OutputDir" that is blank to start but filled out by an attributeCreator that overwrites the value after the file name extractor transformer runs, same for the output filename but it does not seem to work dynamically and the value must be hardcored in the writer to work?

Trying to use the UpdateDetector to download new Attachments in AGOL

Hi all,I am trying to find a solution that will allow me to query a record in AGOL and compare the attachment globalID to the local attachment globalID. Ideally, I want to either keep the existing photo in our system as it is the same as online or download a replaced photo or download only any added images to the record.Using the updatedetector is the obvious way. I have tried to explode the attachment list etc. and even make the globalID populate another field for comparison but I get nowhere.A few things about the jobs being audited via collector.the file name isn't processed until fme brings inhouse so I cannot compare via filename only.The user may add additional photos at a later date or may delete the existing attachment only to replace with a new one. In that case, they have the same name.Any help and suggestions would be appreciated,Thanks all.

5 years ago

dlindner01

asked in Data

looking for a way to write csv to wlas format

FME has a WLAS reader, but i do not see a WLAS writer. Will FME be developing this in the near future? and if not, can you suggest a workflow for transforming a csv file to a wlas file format? thank you!Dan

I am having massive problem in the time taken for a workbench to read an FGDB.Is there a way (or a different reader) which can speed this up? It's laughably slow at the moment and completely unusable and this is before I've even done anything with a clipper transformer.

5 years ago

zubairsm

asked in Data

Georeference tif raster using sup file

Hello friends,I am stuck at as to how to determine parameters to do a georeference using transformer Rastergeoreference.Please see attach sup file (renamed it to .txt). What I understood (I maybe wrong) is the parameter LSR_CAMERA is the center point and OPK_LSR is the rotation (3 values in radians ) but I dont know how to convert into degrees ( 1 value). Basically what I need is the following parameter to do a georeferenceBy Point and AngleXY Upper Left CoordinateXY cell spacingRotation (Degrees) Appreciate your help

131

5 years ago

mhabContributor

asked in Data

Esri SDE writer: How to use it compatible for SDE/Oracle and SDE/Postgresql

I have a workflow which writes data to Esri SDE (Enterprise Geodatabase) via the Geodatabase Writer.It is dynamic and reads schema definition from a CSV file. In the Geodatabase the target schema is already defined at FME write time. It is created beforehand in ArcCatalog by importing an XML workspace document.This workflow produces compatible results for Personal GeoDB, FileGDB and SDE with identically configured writers for MDB, FileGDB and SDE.Up to now I used SDE based on SQL Server or ORACLE. So far so good. Now my problems start when I try the same workflow on an SDE based on Postgresql.The symptoms I notice are:1) In ArcCatalog: After Import of the XML workspace document all Table names are as expected (mixed case) but all column names are converted to lower case in contradiction to what happens on ORACLE or other environments.2) Writing data gives No WARNING, NO ERROR not any hint something went wrong but all columns are empty After studying Esri SDE Postgresql docu this is no

232

5 years ago

jhu_20Contributor

asked in Data

Possible file path or filename problems for FME Server

I received the following error message when running the job on FME server (2018.1). But this problem does not happen when running on FME desktop (2018.1). Any suggestions ? I suspect that the problem may be the path reading issue for FME Server. The filename and path works when checking in window explorer. Thank in advance for all help.Error in the Kingdom Well Reader engine: The file could not be found.: G:\\SMT\\1 Production Projects\\Barnett (SQL Server)\\SMT_Barnett\\SMT_Barnett.tks

Merging text Files Many to One with one header

I have some text files, same schema, to merge into one text. How can I accomplish this without connecting each file one by one to the single output text file and keeping only the header from the first one? e.g. header_1 header_2 header_3 header_4 text_1 text_1 text_1 header_1 header_2 header_3 header_4 text_2 text_2 text_2 I want to exclude the headers from 2,3,4...files, so that i get: header_1 header_2 header_3 header_4 text_1 text_1 text_1 text_2 text_2 text_2 Thanks.

OBJ to Cesium Problems

Hi. I'm trying to convert a mesh model from OBJ to Cesium, there are some problems occurred. 1. The SRS of OBJ is EPSG 2326, but FME shows error when reprojecting model to EPSG 4978 for Cesium model. I tried enable and disable Reprojector, but it still return error "could not create reprojection engine". 2. So I re-create the OBJ mesh in SRS 4978 for conversion. Then I added the result (in Cesium) to web page, my model cannot be shown. Did anyone successfully convert OBJ to Cesium using FME? Where can I find some resources or sample workbench file of this conversion?

OBJ to Cesium Texture Problem

Hi, I found some problems after the conversion from OBJ to Cesium using FME. The original OBJ model like this: But after the conversion, the model in Cesium like this: The geometry is checked and it is matched to original. But the color tone of texture seems to be edited. How can I solve this problem?

HiI am trying to convert a DWG file (AutoCAD 2010) format into AutoDesk DWF file format. The DWG file is an architectural drawing file and include various blocks, hatches, mtext and even XREF. When I convert DWG to DWF from AuoCAD environment the output is very clear without any loss of objects as shown belowBut when I convert DWG to DWF using FME Desktop 2015.1.3.0 the output is not at clear, looks distorted and has missing objects as shown below. I tried various settings but still no success. Please let me know if you have any ideas or solutions

Error occurer in function AutoCAD2004writer:WriteInsertAttribute, exception thrown: 'invalid input'

Hi, I´m trying to convert data from a ArcGIS filegeodb to AutoCAD DWG. In the proces I´m getting the following error which says absolutly nothing to me. Does anybody have an idea on where the problem could be?AutoCAD Writer: An error occurred for dataset 'C:\\Temp\\RF2017\\RFgrundkort2017.dwg', in function AutoCAD2004Writer::writeInsertAttribute. Exception thrown: 'Invalid input' (Invalid input)Thanks Christian

Google Maps KML to TAB not showing user attributes in separate columns

I have an editable KML with all its user attributes showing in a data table in Google Maps - showing as above when I click on the map objects. I want to be able to export that data back out of Google Maps to TAB or Excel (or anything!), with all these user attribute fields. However, when I export this from Google Maps and look at the Feature Types of the KML Reader in FME Inspector, there are no User Attributes, only Format Attributes. When I use the Inspector, the attributes look as below - there are no kml_schema_ attributes, only kml_data attributes with name (attribute column heading) and value, each one suffixed 1, 2, 3 etc. So when I use a simple workflow with no transformers to export this to TAB, all user attributes are concatenated into the kml_description field as shown below. I have a feeling this isn't normal...……. My original export to KML for Google Maps was from a Shapefile using QGIS export tool (I removed text from "DescriptionField"), and the data

453

5 years ago

Page 106 / 272

Badge winners

markjayson26has earned the badge FME Form Basic Training
teeisisstore123has earned the badge English Speaker
paul.naloshas earned the badge Welcome Back
rzickuhrhas earned the badge Welcome Back
willydeverahas earned the badge Teacher (Bronze)

Show all badges

30,108: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.