- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,780 Posts
24,925 Replies

When you subscribe we will email you when there is a new topic in this category

6780 Posts

Recently active

Most replies Most views Newest first

hansgmContributor

asked in Data

Excel - Named Range - Read/Write

I am writing Data with the Excel Writer to a Excel Template.In this template I have defined Named Ranges. These ranges only consist of 1 Cell (e.g. PrjNr =Schachtblatt!$G$5)The Problem is that FME writes to the Cell G6 (one cell below my named range)Has anybody a solution for this Problem ?Thanks Hans

1456

5 years ago

lazarlubomirContributor

asked in Data

DWG writer: adding a new attribute to block definition - graphic before synchronization

Hello everybody,please, I try to solve one huge problem related to DWG writer. I wanna add a new attribute to block definition (e.g. attribute CODE), whose structure is not synchronized to its graphic. E.g. I have one block and its graphic is inserted to model space (pic below called "old") in DWG. But, meanwhile, spectre of its attributes was spread to nowaday structure (pic below called "new"). Anyway, the graphic is not synchronized, so newly added attributes are invisible.In FME, I need to add one new attribute to block definition and export graphic of block in the same graphic as on pic "old". But, if I have to export to DWG, I still need to define TEMPLATE FILE - this is problematic thing, because DWG writer automatically will load specific block definition will all attributes, so graphic is actual.Please, has anybody any advice, how to add new attribute to block definition with keeping old graphic of block before synchronization?Thank You so much!Lu

9111

5 years ago

jhu_20Contributor

asked in Data

How can I avoid feature database names and only write feature classes to GDB

I am reading feature classes contained in feature datasets from a FGDB and then write all feature classes to a SDE/GDB. My question is how I can avoid feature dataset names and only write feature classes. I don't need the feature dataset names

Converting COLLADA to CityGML

Hello everybody! Can anybody explain to me how to convert collada to citygml using FME? Thank you!

I have migrated data from SQL database to File GDB but unable to read it in ArcMap.

I have migrated data from SQL spatial server to File GDB, I have given the correct primary key and used vertex function to create the points from lat-long values. Migration was done successfully but I couldn't find any spatial data in File GDB.

5 years ago

runnealsContributor

asked in Data

Bulk esri Queries

Hello,I was wondering how easy it would be to accumulate x number of records (for this example 500), then run a bulk roads & highways or geocode query that would send all 500 records at once to be located/geocoded in a single query instead of making 500 separate calls to the service. Does anyone have any workflows like this? I feel like something like this would be extremely good for the geocoder transformer among others. Thanks in advance!

5 years ago

pascatl

asked in Data

No access to @Value() in files passed from outside of FME

I am using the HTML-FeatureWriter for creating a HTML-File. The HTML-file consists of different parts, stored and passed by attributes. The different script parts contain values like @Value(name). Now I want to store the script parts as .txt (or others) outside of FME for better editing. When I'm importing them and link them to attributes, it seems like the "@Value()"-tags aren't recognized by FME. Is there another way for editing scripts containing @Value()-tags outside of FME?

5 years ago

hassdk

asked in Data

Excel FeatureWriter, how to add a blank line

I wish to add a blank line for every 'x' line in an Excel spreadsheet createt in the FeatureWriter. Any help or guide on how to do this? Thank you!

FME Server file extension not specified

Hi all, I have a question concerning the output format of a tool on FME Server. Tool runs fine: input contans a DEM-layer, output contains a ZIP-folder including a .dwg-file. There is only one problem: I manually have to add the extension .dwg at the end of the file name, in order to open the file as a .dwg. Right now, the output file has no extension given after extracting the ZIP-folder. After adding .dwg to the file name, the file is correct.Anyone having a suggestion?

Texture for building -Citygml

Hi,I have 10 building and 10 JPEG files, each JPEG is specific to the buildings .Physical path of the JPEG is configured in the attribute called "path". I need to apply textures based on the attribute "path" . How can I achieve this? Regards,K.Jayakumar

Reading multiple files in a filemap

Hello,I periodically load the latest version of topographic data (shape format) from many municipalities in our GIS system. The data is loaded per topographic object (for example: a workbench for buildings, an other workbench for roads, ...). Each workbench loads the data for all municipalities together. The first time the data was loaded the source contained 94 shape files (94 municipalities). The second time this was 92 (9 old deleted and 7 new added). I have adjusted the change in the data manually (update features and connect the new ones), a work that does take some time. Should the number of municipalities change again next time, the reader must be updated again. Is there a possibility to automatically read all shape files (which can change in number and file name) in one and the same folder, without the need to make manual adjustments? Thanks!Luc

5 years ago

siriosus

asked in Data

Esri ArcGIS Portal Feature Service writer parameters failure

What I'm trying to achieve is to write data to hosted feature layer on ArcGIS Portal.In Esri ArcGIS Portal Feature Service writer parameters I'm using this template: "Host" - https://myarcgisportal.com/arcgiswebadaptor/, and tried all options and accounts in "authentication type" - "Generate token", NTLM, Kerberos and both domain and ArcGIS accounts (ArcGIS Portal admin), it shows "the server at https://myarcgisportal.com/arcgiswebadaptor/ does not appear to be an ArcGIS Portal Instance". Portal is federated with server and ArcGIS Data Store is configured. Maybe something is misconfigured on Portal?Any ideas would be much appreciated.Thanks!

102

5 years ago

ciarabContributor

asked in Data

STAR-APIC Mercator MCF Reader - not reading dto

I have a large number of dto's created within Mercator which I can not read through the MCF Reader. I get the following error message Error - Invalid data in file 'dto_test_notworking_t.dto'Closing input file 'dto_test_notworking_t.dto'MCF_READER_PIPELINE::f_1(SortFactory): Done sorting 0 feature(s)Error - No bounding box coming out of the pipelineA fatal error has occurred. Check the logfile above for detailsFailed to specify the feature index as constraints on the reader I also have a dto file that will read through the MCF Reader. I have tried to compare the structure of both files but the file produced in mercator seems significantly different to the one that will read through the Mercator MCF Reader. Does anyone have experience with this data type and can identify what is wrong with my data ? Sample attached. Thanks Ciara

5 years ago

runnealsContributor

asked in Data

ArcGIS Online Write Error

ArcGIS Online Feature Service Writer: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was '("Connection broken: ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None)", ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))'

141

5 years ago

01011010Contributor

asked in Data

HTTPCaller (PDF) write to MS SQL database

Is it possible to download a PDF file and then write that data to an MS SQL table? Any help would be greatly appreciated!I am able to download, using the below. However I am not able to write to SQL as VARBINARY(MAX).Almost there....

S3ObjectLister and S3Downloader rejects AWS S3 region ca-central-1

Hi, I am using S3ObjectLister and S3Downloader to connect to a bucket, download data and process it. I have two bucket setup in two different regions (ap-southeast-2) and ca-central-1. When I use settings for first region it works fine but when I change settings for region 2 i.e ca-central-1 (which is not available in transfomer's region drop down) S3ObjectLister rejects to connect and gives me follow errorsfme_rejection_code: ERROR_CLIENTfme_rejection_message: fme_rejection_message (encoded: UTF-8): Not able to determine region for ca-central-1.Please upgrade to a newer version of the SDKI am not sure how to access bucket setup for ca-central-1. I have tested bucket setting and it is responding well and tried using different regions with with bucket setup for ca-central-1 I get different error code 301.

5 years ago

bhanu_v

asked in Data

XML reader adds xsi:nil="true" elements as filed names with .nil how to resolve this and have the value populated to be null

I'm reading an XML with ticket details that has xsi:nil=true in the tag and it adds the field name with .nilAlso,there is a tag with xlmns andIm not sure if I have to use a List Exploder to further get its attributes.I'm a novice FME user and have no prior experience with xml eitherI'm looking for direction on how to resolve the field names to be the tag text and populate its values in ESRI Gdb formatAny help will be much appreciated

FME Server - Workspace converting LAS to Recap always fails first run in a new browser session

Hi! I have a workspace that converts LAS into Recap using a pointcloudlasclassifier before writing out to Recap. This workspace runs 100% flawless on desktop. When publishing to FME Server however, the workspace always fails the first run after logging into a new session in the browser. When running the workspace the second time (and following runs) without editing any parameter it runs successfully. Any ideas what can cause this issue? It seems that it is the rcs-files (which are written to a subfolder) that is causing the workspace to fail.

5 years ago

christian_b

asked in Data

FME doesn't detest postgres insert errors

Hi,I use FeatureWriters in FME Workbench 2017 for inserting datasets in Postgres.But when there are errors in my input data, like a string instead a boolean value, the row is not written in Postgres but FME doesn't detect the error, the row is counted like a correct insert and I have the message "Translation was successfull" at the end. Of course, I could use AttributeValidators to detect such errors but I have a lot of fields and I wouldd like to avoid to inspect each field. Thanks in advance for any help,Christian

5 years ago

xgdlc

asked in Data

Child version not automatically after "reconcile and post settings" in writer

Hi,I’m having problems with SDE writer with a “Versioned Edit Session” transaction type in my workspace. The workspace in question is initiated by Workflow Manager. A child version is created in our flow and the name of this version is passed along as parameter value. I’m using a writer, with three feature types, with the following settings: What do I expect:The data is written to the child version. If writing to the tables succeeded, then the child version is reconciled and posted to the parent version. After posting, the child version is deleted. When the writing fails, the child version is not posted to the parent and is automatically deleted. What do I have at the moment:The data is written to the child version. If writing to the tables succeeded, then the child version is reconciled and posted to the parent version. After posting, the child version is not deleted. When the writing fails, the child version is not posted to the parent and is not automatically deleted. The followin

361

5 years ago

btlContributor

asked in Data

OSM to PostGIS keeping all tags

Is there a way process OSM data so that I organise the most important tags into separate attributes while keeping all other key/value pairs e.g. by dumping them into another attribute called "othertags"?For example; an entry in my Highway table might look like this:highway trunk lanes 2 oneway yes width 12 othertags "surface"=>"asphalt", "name"=>"Ermine Street", "maxspeed"=>"70", "lit"=>"no", "ref"=>"A1", "name:en"=>"Ermine Street", "maxwieght"=>"..... Basically I don't want to lose any info, but I don't want to expose all tags to potentially several tens of mostly useless attributes.

5 years ago

lianaolianov

asked in Data

Setting up a trace on a PostgreSQL database from shapefile migration

Hello,I'm migrating some shapefiles using FME to a PostgreSQL/PostGIS database. Is there any way to monitor all of the SQL commands that have been sent to it during the translation ? Thank you.

5 years ago

robertoContributor

asked in Data

Duplicate records from SqlCreator

Hi all.A problem that makes me crazy :-(To collect data form Oracle, I use an SqlCreator with a parametric query.When I run the same query in SqlDeveloper, I takes the correct number of records. Usually a single record.When I do the same in FME, the record is duplicated.The strange thing is that if the correct result is one record, it is duplicated. So two records.If the correct result is three records, the result is four. One duplicated and the other fine.The production landscape where the problem occurs has two FME servers with distributed engines.In the second landscape (testing), the problem doesn't happen.Very strange...Thanks for your supportRoberto

267

5 years ago

lazarlubomirContributor

asked in Data

SVG writer - how to define title and attribute after tag?

Hello everybody, I have to solve urgently problem with generating of SVG files. I still cant find way, how to define title of SVG file and also, how to insert my attribute after <g id> tag, see pic below? Please, do You have any tip, how to figure out this problem?Thank You so much!Lubo

5 years ago

007fkj

asked in Data

Roof is not exporting while converting ifc to citygml

I have ifctoCityGml template (no idea how it is working) and its working fine and convert my ifc to citygml but the only problem i am facing is that it is not exporting roof while it successfully exported WallSurface, FloorSurface and window. And here is its transformation snap:As you can see there is no output from FeatureMerger_2 Transformer. I guess Merged, is not producing any output.

104

5 years ago

Page 130 / 272

Badge winners

canadasmokhas earned the badge Student (Grey)
rzickuhrhas earned the badge Welcome Back
willydeverahas earned the badge Teacher (Bronze)
vertiroyhas earned the badge FME Form Basic Training
marta_podsiadhas earned the badge Welcome Back

Show all badges

30,108: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.