- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,779 Posts
24,931 Replies

When you subscribe we will email you when there is a new topic in this category

6779 Posts

Recently active

Most replies Most views Newest first

_jj_

asked in Data

Write to Multiple Excel Sheets

Hi, I have created a simple workbench that merges two datasets together and performs statistical calculations. So far, I have been unable to set my Excel writer to have one sheet for the dataset and another sheet for the summary from the StatisticsCalculator. I have already seen the "write data to different sheet" post, but have not had much luck. Would anybody be able to offer any advise to me, please? Many thanks, Jess

5514

3 years ago

spidermanContributor

asked in Data

how could i configure Oracle reader to connect with the data and read it ?

i have oracle data, how could i configure it to read the data from it .i am not sure how to connect with and read the data parameter available : user and password and Host and port no. and service name FME 2018

103

3 years ago

rob_braggaarContributor

asked in Data

How to configure MongoDB Atlas in FME Workbench database connection

I have the following MongoDB Atlas cluster, hosted at Google Cloud, to which I'd like to connect in FME Workbench.FME should be capable of connecting but I did not find the right settings yet to do so.In my Node.js Express app I'm using a connection string which includes the username and password as well as the database. In FME these are separate fields.The connection string looks like so:In FME I think this translates to this, but it does not work for me. And what do I fill in for authentication database name? I'm stuck at the following error message: Any thoughts much appreciated!

333

3 years ago

jugoslaviaaSupporter

asked in Data

Creating point features from the dwg

My input is a dwg file. Currently, I am reading the layer which consists of the location and the height of the elevation point in the field. I am trying to create point feature with VertexCreator. I think it does create it. However, if I send the output to the PointOnAreaOverlayer, all points are rejected and get "INVALID_POINT_GEOMETRY_TYPE". And idea what I am doing wrong?Here how my workbench currently looks like https://i.imgur.com/nh25NON.png And here is my points and the rejection msghttps://i.imgur.com/75tF2Eq.png

134

3 years ago

eric_armitageContributor

asked in Data

Problem Reading PDF raster.

HiI'm trying to read a raster from pdf plan 08 that can be downloaded from his site:https://challenges.dk/en/challenge/banedanmark-digitisation-cable-drawingsThe plan includes i raster feature. I can view it ok in Chrome but when I try to view it in FME all the RGB and A pixels values are 0 and th plan is not visible. Any idea how to fix this?

3 years ago

gisbradoklaEnthusiast

asked in Data

EBC format database file EBDIC

I am interested in a way to translate these database (Tape) files into a usable format. Anybody have experience? Extended Binary Coded Decimal Interchange Code (EBCDIC) is an 8-bit character encoding used mainly on IBM mainframe and IBM midrange computer operating systems.EBC format descriptionCategory: Document filesApplication: -Mime-type: application/octet-stream

Is there a way to read or write to an MP3 (Music) or MP4 (Video) file's ID Tags?

Is there a way to read or write to an MP3 (Music) or MP4 (Video) file's ID(3) Tags? There is plenty of software out there that allows for the editing of a variety of ID(3) tags in music or video files of the MPEG variety, however it might be useful for a Reader to enable those music / video files that identify their origins to be located from their tags onto a map.Anyone wanting to create a catalogue of their music or video would find the reading of the built-in data tags in their music / video files useful too.....just a thought.

ArcGIS Online JPEG Attachment EXIF metadata

Hi All,I have a workbench that reads a feature service from ArcGIS Online exposing the actual attachment attribute associated with each feature and then extracting the photos attached to it.I'm using RasteReplacer to convert the BLOB data to a JPEG and then writing it with a JPEG writer (with the option to save the EXIF data ticked).However, it doesn't look like the EXIF metadata is writing to the JPEG.I'm sure that the EXIF metadata does exist as I have an existing Python script that uses Arcpy to extract the JPEGs with EXIF out from a file geodatabase. But when I do it through the ArcGIS Online feature service reader, it doesn't seem to be retaining this information .Any help on this would be much appreciated.

we are testing on FME Desktop to extract data (parameters or attributes) from different file formats to MS Excel output.Want to know the procedure how we can extract that data. Also want to know the list of File formats which supports FME to extract

To know the process of Reading and Writing the data. (output to MS Excel)List of Formats where FME can support Read and Write the data.

3 years ago

rawansaleh

asked in Data

Python Exception : 401 Client Error: Unauthorized for url: https://www.arcgis.com/sharing/rest/portals/self?

Hi All, I have an FME workbench which read a feature layer from ArcGIS online and export the information into excel sheet, my workbench is running fine in the desktop without any error but when I published it to FME server some times it’s working and sometimes I got the following error “Python Exception <HTTPError>: 401 Client Error: Unauthorized for url: https://www.arcgis.com/sharing/rest/portals/self?” Please note that I include the AGOL connection when I published my fme, I created a new app for this workbench so my users could run it from their side I’m using FME 2019 Any Ideas? Cheers,Rawan

Stable token to ArcGISOnline (AGOL)

I am trying to connect to AGOL but my token expires. I followed the method in https://community.safe.com/s/question/0D54Q000080hYdzSAE/how-do-i-reliably-connect-fme-server-201819-to-arcgis-online. It work s but then stops working Any suggestions to to fix this? Under File & Connections, I click web connection, then select connection and click manage web services On AGOL developer I selected

How do I fix "plugins/udatasmith_fme.dll' was found but could not be loaded" or "XINPUT1_3.dll is missing" error when using the UDATASMITH Writer?

How can we fix an error like:plugins/udatasmith_fme.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this libraryI already know the answer, but I wanted to share it with all of you good folks in case it's a problem for you too!Quick fix: Install Unreal Studio (https://www.unrealengine.com/en-US/studio) or install DirectX SDK from https://www.microsoft.com/en-ca/download/details.aspx?id=6812 The Details:Most likely your computer already has the necessary DirectX components, either from an Unreal Studio installation or from another application. However, there are some cases where these components may be missing. For example, you are likely to encounter this issue when running a Windows Virtual Machine.In any of these cases, you can install the necessary XINPUT1_3.dll by installing Unreal Studio or the DirectX SDK from the link given above. A bit of trivia: XINPUT1_3.dll is used for getting mouse input in DirectX-based games.

3 years ago

ksafeent

asked in Data

Is there a way to extract Road (2d polygon) from an FBX? Or an FBX to DWG workflow?

184

3 years ago

kwellerContributor

asked in Data

ACAD DWG writer erroneously converts int32s to strings

I'm converting DWGs to DWGs, basically copying existing DWGs to new ones with a few extended entity attributes changing values. However, the data types on the output file are string representations, rather than the 32-bit integers that are read from the input drawing and recognized as integers throughout. How can I get the ACAD writer to output the values with the correct data type? I'm using a dynamic schema, with the schema source being the input drawing. Also, how do I know that the output drawing is truly a high fidelity copy of the input drawing? I'm following all the guidelines in the documentation about DWG-to-DWG settings, yet if data types are changing, I wonder what else might be changed/lost in the process, for example, external data links and line styles.

3 years ago

christianlendl

asked in Data

How to extract a center point of a building in CityGML?

Dear FME Community, is there a way to extract a center point of a building in CityGML? So far I have only done it with the centerpoints of ground sufaces. But what if a complex building has multiple ground surfaces? Is there a way to treat the geometry of a building as one group? So instead of extracting the center point of one surface, extract it from the whole volume of a building. Do CityGML buildings have an individual id? I have attached a sample CityGML file. Thank you so much for your help!With kind regards Christian

Problems with Oracle Instant Client and FME

Good day! I am having difficulties getting FME to use Oracle readers and writers. I am using 64bit for both FME and Oracle instant client. From the website, I followed the instructions for downloading an Oracle Instant Client, unzipping it to a directory and adding this to the front of my PATH environment. The options in the reader and writer gallery are still greyed-out however. I have been trawling the web for the past day or so and nothing I see helps (or makes sense to me!). Any help would be appreciated Rich L

256

3 years ago

mr_fmeEnthusiast

asked in Data

Find Max and Min distance from polygons

I have 2 shapefile files, each have about 13,000 features. I need to know what the minimum and maximum distance each feature of file 1 for example has in relation to file 2. How to do that?

Hi, Encountering Error 'The arc collinear feature error(ORA-13346: the coordinates defining an arc are collinear)'. while inserting data into Oracle spatial. Please advice.

580

3 years ago

sveinjContributor

asked in Data

JSON Error reading Arcgis online feature layer.

When reading an Arcgis online feature layer I get this message. It has worked before and there are no problem with other feature layers: Python Exception <JSONDecodeError>: Expecting ',' delimiter: line 1 column 10367918 (char 10367917)

Hi, Does anyone know how to extract the Creation Date of an IFC file?

I'm trying to extract the Creation Date of an IFC file. It is usually located under IfcProject in viewers like Solibri, but I can't seem to find it.I want to read a folder containing a bunch of IFC files, and create a list of when the files were last created.

893

3 years ago

ekkischefflerContributor

asked in Data

How to write 12dXML including metadata and project attributes?

I'm writing features to a 12dXML file and I'm looking for some more documentation around the writer. All I found so far is the information here. I can see the reader creates the meta_data and project_attributes elements but it seems they can't be written properly. If I do create those as feature types in the writer, FME gives me below warnings and renames my output feature types. These outputs will then be interpreted as models instead (and will be contained in the model table as 'metadata' and 'projectattributes')TwelveDXML Writer: Warning, unsanitized name 'meta_data' will be renamed to 'metadata' following 12d Model naming rulesTwelveDXML Writer: Warning, unsanitized name 'project_attributes' will be renamed to 'projectattributes' following 12d Model naming rulesInterestingly, the project attributes and metadata I am writing into my project_attributes and meta_data feature classes will be contained in my written file, regardless. But still, I get models called 'projectattributes' an

161

3 years ago

swethabhupathiContributor

asked in Data

while adding an .sde file getting error "The error number from ArcObjects is: '-2147220944'"

The error number from ArcObjects is: '-2147220944'. The error message from ArcObjects is: {This version of the Geodatabase client is incompatible with the dataset and cannot open it. i am using an arcpro of 2.7.3 and fme 2020.2 64bit versions.

SQLExecutor deadlocking on PostgreSQL DDL

Trying to run the following SQL/DDL combination:SELECT setval('@Value(table_name)_$(Column_Name)_seq', (SELECT (coalesce(max("$(Column_Name)"),0) + 1) FROM "@Value(table_schema)"."@Value(table_name)"));ALTER TABLE "@Value(table_schema)"."@Value(table_name)" ALTER COLUMN "$(Column_Name)" SET DEFAULT nextval('@Value(table_name)_$(Column_Name)_seq'::regclass);But the workspace freezes with a deadlock on ALTER TABLE. Tried explicitly BEGINning a transaction before the first statement and COMMITting after the second, but that fails with "transaction already in progress" followed by "no transaction in progress". Not even separating the two statements into different SQLExecutors helps. Thinking I'm going to need to split this into separate workspaces, or worst case scenario, doing some of it in standalone Python. But wondering if anyone else has run into this and has better suggestions.

3 years ago

stipica.pavicicParticipant

asked in Data

Error writing to the GEODATABASE_FILE (writing from the cache works fine)

I'm experiencing a strange behaviour with the File Geodatabase writer (GEODATABASE_FILE). Everything works when I write to the database from the cache but I get and error when I try to run the complete workspace from the start (with or without caching).I tried so many scenarios, but I always get an error while running everything from the scratch.Here are the few screenshots showing successful scenario and a writing error.Does somebody have similar experience and what might be a solution to this?I'm using FME 2020.2.3.0 (build 20820) and have localy installed ArcGIS Pro 2.8.1Screenshots:1) run to this (from the cache to the database; last step of the workflow)2) success; features are written to the database3) rerun entire workflow4) error running transaction

1620

3 years ago

runnealsContributor

asked in Data

AGOL Upload/Publish new data & switch existing feature view

Here's a great workbench snippet that uploads a file geodatabase to AGOL, publishes it, updates the view to switch it to your new service, then deletes the old service.

3 years ago

Page 49 / 272

Badge winners

allasimonhas earned the badge Student (Grey)
allasimonhas earned the badge Teacher (Grey)
allasimonhas earned the badge Welcome Back
rspears90has earned the badge Webinar Watcher (Bronze)
lachlan.thas earned the badge Welcome Back

Show all badges

30,122: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.