- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,779 Posts
24,928 Replies

When you subscribe we will email you when there is a new topic in this category

6779 Posts

Recently active

Most replies Most views Newest first

verdoodtdriesContributor

asked in Data

Geodatabase Error (-2147024893) .

Hi FME-users,I have a model in FME 2015.1 reading dynamically from a file gDB.If I ran the model locally, everything works fine. However, if I run the model on FME Server, I get following error:Geodatabase Error (-2147024893): The system cannot find the path specified.The path is provided by a published parameter which I'm passing to the model.Can anyone tell me more about this error?

PostGIS Feature Reader not Dynamically bringing postgis attributes

I have a list of postgis tables and their schemas coming from a python caller. I want to dynamically read all the postgis layers and export them. However I cannot get the layer attributes to come through - only the geometry comes through in the feature reader.I'm passing the schema.table as an attribute called datasetName into the "Feature Types to Read". See below the inspector giving a valid value. When running I don't get the attributes that I expected along with the geometry: If, however, I paste in the text that I generated for the datasetName, i.e: o6_energy.bgs_eng_gas_goodcbmpotentialgbv1_bgs_bslnThen it creates a new port with the attributes I wanted: Hey presto, the attributes are there: Can I not dynamically provide the datasetName and get the geometry + attributes to come out of a single predictable port?Note it's not coming out of the generic port anymore, it's created another port with the dataset name. This is massively inconvenient as- as i

4 years ago

neal.gribben

asked in Data

Smallworld to MS SQL Spatial (JDBC) fails to write any features

I am trying to write from Smallworld 4.3, using FME 2018 build 18301 and the MS SQL Spatial (JDBC) writer. The writer creates the new table ok, but when it tries to write the features I get the following error: “C:\\apps\\FME2018\\metafile\\mssql_jdbc_spatial_.fmi could not be opened”. If I look in this directory there are 3 .fmi files that start with mssql_jdbc_spatial_, ie Destination, geommap, & Source. I presume FME is looking for some sort of parameter value, and trying to make some decision on which of these 3 files to use, however I can’t see any missing parameters in my mapping file. Can anyone point me in the right direction please?Thanks Neal

4 years ago

mr_fmeEnthusiast

asked in Data

Run a batch process

Hi, I have a very simple workspace, the result of which is excel spreadsheets. However, there is a published parameter where I always need to inform dates, for example: 20200709030000, 20200710030000,20200712030000. Currently I need to run date by date, is there a way to run date by date automatically, that is, entering the required dates in one go? Thank you very much

Recognize "strikethrough" in cells

I am merging an excel spreadsheet and an ArcGIS SDE feature class on a common field. Some of the entries in the spreadsheet have a "Strikethrough" effect--these entries should be ignored, however, FME is matching them anyway. How can I get it to ignore any entries with strikethrough?

ArcGIS Portal Feature Service name

I am trying to read the domain names from a portal feature service. I believe this requires the use of the REST API and httpCaller. I am also using a Portal Feature Service Reader to do everything else I want to do.I have tried everything I can think of to get hold of the Feature Service parameter with no success.Is there any sort of elegant way to get hold of this parameter so I can use it in the httpCaller to return queryDomains?My last resort would be for the user to have to effectively do this twice when picking the feature service to read (in the reader) and also get them to supply a text published parameter in the run dialogue (for use in the httpCaller).Am I missing something? thanks in advance Ian

4 years ago

mladenamovic

asked in Data

I need a help for POSTGIS to GML feature transformation.

I need a help for POSTGIS to GML feature transformation. All attributes are written except geometry in GML and after translation I got Attribute table. All geometry data are ok in POSTGIS DB.

4 years ago

rjwillshear

asked in Data

Problem with Filecopy writer

I have a workbench set up to detect changes between 2 sets of folders and then copy the new files from one set into the other, with some fancy formatting and fanning applied. The change detector works perfectly in this example I set up, it detects 17 changes and these are passed through an Attribute manager and onto the filecopy writer. Somehow though, the writer copies way more than 17 files that are passed to it so somehow that information is still getting to the writer, but I cant see how. Does anyone have any ideas?

Why does schema reader complain of named range when there are none?

2020-07-24 14:29:55| 0.4| 0.0|WARN |Excel Reader: Internal error: Could not find any sheets to read2020-07-24 14:29:55| 0.4| 0.0|WARN |Excel Reader: Found named range '_xlnm__FilterDatabase' on sheet 'Haul Data'. This is a Microsoft Excel internal name so FME will not show it as a sheet. If you wish to read this named range, please rename it

FME doesn't find existing Feature Service in AGOL then fails because it already exists / Update Token

I have a series of WorkSpaces that run in sequence (via WorkSpace Callers). I have the main WorkSpace scheduled to run a few times a day, and over the last few weeks they've been running fine.Today I noticed some of them began to fail, and throw the same error that I would sometimes get when I set them up the first time, a few months ago:Encountered an unexpected error. The error code from the server was 'none' and the message was: 'Service name 'SERVICE' already exists for 'xxxxxx''. Of the 5 Workspaces that write to AGOL, 4 started to fail. One is working fine. All have the same settings, use "Insert" and "Truncate".Looking deeper in to the logs, I found that for all of the writers that are failing the following is happening (some names redacted): ArcGIS Online Feature Service Writer: Requesting portal informationArcGIS Online Feature Service Writer: Getting list of user content items in 'User_org'ArcGIS Online Feature Service Writer: Searching for all groups in the organization ac

Error "edgeCurves_[edge].has_value()" with reading or writing a IFC file

Hello everybody, i try to integrate an IFC File of a building into a gdb File.Someone from ESRI France has read the file correctly and put in gdb file with Data Interoperability and ArcGIS Pro 2.5.I don't know very much this BIM format but i have some problems to read it in FME 2020.1 (build 20596). step1 : all the file is ok except the class IfcWallStandardCase wich has a problem just in reading it with an inspector.with 2D, no problem, but 3D reading, it failed : Construction de la commande OSG Graphe de scène caught exception: stk::ex::FatalError[0] Expression: edgeCurves_[edge].has_value()[1] auto __cdecl cycletopology::Graph::extractCircuit::<lambda_62cd9dca1bd617e3c133d0725ef0952f>::operator ()(const struct stk::ex::index<unsigned __int64,struct cycletopology::Graph::Edge>) const(C:\\code\\fme\\foundation\\framework\\geometry\\cycletopology\\src\\graph.cpp:167) step 2 :i have tried to write the 1400 items into a gdb file (multipart) with a geometry filter on soli

220

4 years ago

geo-xParticipant

asked in Data

Create a published parameter with date

Dear FME community.I've to use the dynamoDB connector with a partition key like a specific date (for example : today - 5 days).For that I only can using a published parameter :But in this case I don't have access to the date function :Do you know how can I do that ?For information, I've FME Server.Thank you for your help.

1052

4 years ago

lazarlubomirContributor

asked in Data

Upload media files to ORACLE

Hello everyone,is there any possibility how to upload mediafile to ORACLE (e.g. PNG, JPEG etc.) via FME?Thank You so much!Lubo

umapper1Contributor

Hi all!I'm testing the new 12d xml reader and writer transformers. I've started with a simple static reader to writer workspace to see if a basic conversion works with no manipulation but hasn't been successful. I believe it requires some extra manipulation. Had the following error when trying to get back in to 12d model software:I don't know how to read the xml so I don't know what's going wrong. Below is an image of my workspace and attached fme template file. I'm also curious whether/if FME can write back to 12d vertex attributes as well as string attributes. It certainly reads them however puts them in to a list. I wonder if this complicates things on the 'write' side of the process. Any help would be appreciated.Using FME 2020.

336

4 years ago

bfauselContributor

asked in Data

Writing to ArcGIS Online hosted feature service errors

Hello,I have an FME 2018.1 tool that updates an ArcGIS Online-hosted feature service (Writer Mode: INSERT, Truncate First: YES). The feature service has about 15,000 parcel polygons. Typical changes: a dozen or so new polygons per month, a dozen to a hundred attribute table changes per month.The tool/transformers all work when attempted on a local geodatabase feature class. Therefore I am able to rule out transformer problems. But when the tool runs on AGOL-hosted feature services sometimes it works. Other times it fails and returns these various errors: - The error code from the server was '504' and the message was: 'Your request has timed out.'- The app domain with specified version id (xxxx) was unloaded due to memory pressure and could not be found- Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was '('Connection aborted.', error(10053, 'An established connect

S3Connector System Authentication

I am trying to connect to S3 on FME Server using the S3Connector System authentication. Our FME server is using the 6th method as per https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-quickstart.html#cli-configure-quickstart-precedence : Instance profile credentials – You can associate an IAM role with each of your Amazon Elastic Compute Cloud (Amazon EC2) instances. Temporary credentials for that role are then available to code running in the instance. The credentials are delivered through the Amazon EC2 metadata service. For more information, see IAM Roles for Amazon EC2 in the Amazon EC2 User Guide for Linux Instances and Using Instance Profiles in the IAM User Guide. I have confirmed I have access on the server to reach the S3 bucket specified directly via the CLI, but when I run through FME Server I get the following:Attribute(encoded: UTF-8) : `fme_rejection_message' has value `S3Connector: Required Amazon S3 credentials were blank or could not be found. Please note

The reader documentation for acad list 2020 as the most recently supported version, just checking in to see if this is true for the FME 2020.1 release and when AutoCAD 2021 will be supported.

4 years ago

jmacalister

asked in Data

Create a Geotagged Photo?

I have some legacy images (jpg) with a SHP file with points for each image.Is there anyway to create geotagged photos from these?

Read all tables from POSTGIS schema

I need to read all tables from Postgis scehma. With reader I got only tables which has geometry or which has tables related to geometry tables with foreign keys.Is there some option to read them all, or some Python script which can help me with this?

GUID Generator assigning Primary key automatically

When using the GUID generator i would like to assign that column as a primary key without opening the writer and assigning it? Is there a transformer i can use for this? (Would be a great addition to that transformer.)

overwrite existing attribute

I have a .dxf with points and lines within different layers and blocks. For one layer of data, I need to delete the attribute value within the block and insert in it the geometric value z. Which transformer is best to use?

Converting KML generated from Google Earth to Cesium 3D Tiles

I follow step 1 of https://knowledge.safe.com/questions/101352/write-b3dm-from-kmz-with-textures-to-cesium-3d-til.html, selected 'Placemark' feature and run.It generated 'tileset.json' and 'data/data0.b3dm' and I tried loading it in Cesium but I couldn't see anything. What is the right way to do to convert KML to 3D tiles?

Converting AGS Files as a GIS Layer

Hi all,Just been on working on converting AGS Files to GIS format.This is the first time I have gone through this and it is a difficult file to convert.Just wondered if anyone has any experience with this and are there any steps that have to be done before using FME to convert.@daveatsafe - I have seen a similar thread where you have done some fantastic work building the AGS FME file. I have played around with it but struggle with the output. Below is the FME file:I have also used the AGS transformer which FME now has but not getting the output I was after.

Add to Multiple Feature Writers at once?

I'm going from ESRI Shape Files to PostGIS and trying to add a primary key to all my tables so that Mapserver and other queries are happier with the unique Primary Key. I see from https://knowledge.safe.com/idea/74374/postgres-writer-add-unique-primary-option-for-inde.html that I can add a Serial and that works well but I'd like to add that to 20, 30, or even 50 shape files at a time. Is it possible to do this as a batch?Thanks!

103

4 years ago

geo-xParticipant

asked in Data

Compare and update Json into DB

Dear FME community.I would like to compare to database who contains json (with subobjects).The aim is to UPDATE, DELETE or INSERT json into the target DBInforamtion : the base 2 may be to json format or "classical" attributes format.What is the better way to do this ?Thanks.

465

4 years ago

Page 63 / 272

Badge winners

drewpurzyckihas earned the badge Expert (Grey)
tisjadaggershas earned the badge Welcome Back
danilo_fmehas earned the badge Webinar Watcher (Gold)
sjakohas earned the badge Teacher (Grey)
ahmed.shahinhas earned the badge Integrate Data with the FME Platform Training

Show all badges

30,120: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.