- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,810 Posts
25,083 Replies

When you subscribe we will email you when there is a new topic in this category

6810 Posts

Is it possible to change the text size when writing ArcGIS Pro geodatabase annotation?

I am writing to an ArcGIS Pro annotation feature class in a file geodatabase defined where the text symbol is not required to be selected from the symbol table. My intent is to change the size of the text and have the symbol stored inline, but have been unsuccessful in my attempts. The font size always ends up as 10. This doesn’t seem to be related to the definition of the annotation class symbol, as I have created annotation classes with different size symbols and the resulting size is always 10. I am setting the following attributes in the workbench and exposing these on the writer:geodb_text_size: 72geodb_symbol_id: -1geodb_anno_class_id: -1geodb_allow_symbol_overrides: TRUEgeodb_font_point_size: 72 In my testing I have been able to change these properties and see the results come through:geodb_text_colorgeodb_font_name I have tried using the TextPropertySetter to change the text size but that doesn’t translate to the resulting annotation. I did try running this with FME 2020.1 aga

530

3 years ago

fhydeContributor

asked in Data

From the Postgresql Writer, when a table is truncated and then inserted with new data is it possible to reset the Primary Key sequence to '1'? It currently restarts at the last PK value (+1) from previous entry.

The Odata reader fails to read organizational Odata feed.

We recently moved to an OData feed for one of our data sets, I am still fairly unfamiliar with this format. I am seeking to find out 1. if I am missing something in getting the Odata Reader to work 2. Failing that, what the recommended process would be to bring this data into FME. The feed (https://itd-pr-test.infotechinc.com/AuthModelService.svc/), is behind our firewall so I copied the header and first item into odata_xml.txt. Using FME's Odata reader I used Basic authentication and the link above. When I try to access the Feeds parameter in the reader or enter one of the table names manually into this parameter, it generates the error found in log1.txt, the most usable part of the log states there is an issue with format. After some research, I thought the Odata might be readable in a json format so I appended ?$format=json at the end of the feed to get the json version( first rows in format_json). This actually allows me to see the tables within the odata in the feeds param

352

3 years ago

johnkContributor

asked in Data

Error using ArcGIS Online Feature Service Writer: Not overwriting feature data where already present

Hi FME world, I have a workspace which reads from and writes to several ArcGIS Online feature service layers. At some point, it has stopped updating the data within one of the layers. The workspace still runs successfully and writes features to the layer, but the data is not updated (where there were existing data present) when I check the written features. Where there are blank fields before, the update works as expected. So there is something to do with not being able to overwrite fields where data is already present.The writer mode is set to UPDATE and there are only ever an X amount of features to update, so the OBJECTIDs never change. Any ideas?Thanks

1650

3 years ago

swachContributor

asked in Data

Running out of memory when reading Smallworld

I have a process that is reading from Smallworld (using the SWORLDSWAF reader) in 2020.1. All it is doing is writing to a file geodatabase. It keeps running out of memory no matter what I do. Is there anything I can do to reduce memory usage when accessing Smallworld?- I can't use 64 bit because the Smallworld reader isn't compatible-I have 32 GB of RAM on my Windows 10 machine-I have the temp files writing to a separate hard drive-I have a WHERE clause filtering out the incoming features Thanks

210

3 years ago

swachContributor

asked in Data

Smallworld Reader Query

I am looking for the proper format to use the WHERE Clause to query features using the Smallworld 4/5 reader in FME 2019.1. The closest I can seem to get is:[interfaces].maintenance_notification where code_group_for_part = "DMPS0TR"[interfaces].maintenance_notification where code_group_for_part = "DMPS0VM"I have tried every combination of things but it always throws errors.

310

3 years ago

arnovananrooijContributor

asked in Data

Multipage pdf example not working

Hi,I found an example for creating multipage pdf on https://www.safe.com/webinars/choosing-the-right-transformer-for-your-data-challenge/?utm_source=youtube&utm_medium=social&utm_campaign=webinar-transformers-2018. I downloaded the workspace pdfpalooza.fmw and tried it. In the demo I see it crates a pdf with multiple pages, but when I run de workspace in FME 2020.1 it writes evething to one page, see attached PNG. I want to achieve the exact same thing, so multiple pages for one of my own workspaces so it would be nice to have a working example. Anyone?

Write to Multiple Excel Sheets

Hi, I have created a simple workbench that merges two datasets together and performs statistical calculations. So far, I have been unable to set my Excel writer to have one sheet for the dataset and another sheet for the summary from the StatisticsCalculator. I have already seen the "write data to different sheet" post, but have not had much luck. Would anybody be able to offer any advise to me, please? Many thanks, Jess

6210

3 years ago

spidermanContributor

asked in Data

how could i configure Oracle reader to connect with the data and read it ?

i have oracle data, how could i configure it to read the data from it .i am not sure how to connect with and read the data parameter available : user and password and Host and port no. and service name FME 2018

100

3 years ago

rob_braggaarContributor

asked in Data

How to configure MongoDB Atlas in FME Workbench database connection

I have the following MongoDB Atlas cluster, hosted at Google Cloud, to which I'd like to connect in FME Workbench.FME should be capable of connecting but I did not find the right settings yet to do so.In my Node.js Express app I'm using a connection string which includes the username and password as well as the database. In FME these are separate fields.The connection string looks like so:In FME I think this translates to this, but it does not work for me. And what do I fill in for authentication database name? I'm stuck at the following error message: Any thoughts much appreciated!

353

3 years ago

jugoslaviaaSupporter

asked in Data

Creating point features from the dwg

My input is a dwg file. Currently, I am reading the layer which consists of the location and the height of the elevation point in the field. I am trying to create point feature with VertexCreator. I think it does create it. However, if I send the output to the PointOnAreaOverlayer, all points are rejected and get "INVALID_POINT_GEOMETRY_TYPE". And idea what I am doing wrong?Here how my workbench currently looks like https://i.imgur.com/nh25NON.png And here is my points and the rejection msghttps://i.imgur.com/75tF2Eq.png

130

3 years ago

eric_armitageContributor

asked in Data

Problem Reading PDF raster.

HiI'm trying to read a raster from pdf plan 08 that can be downloaded from his site:https://challenges.dk/en/challenge/banedanmark-digitisation-cable-drawingsThe plan includes i raster feature. I can view it ok in Chrome but when I try to view it in FME all the RGB and A pixels values are 0 and th plan is not visible. Any idea how to fix this?

3 years ago

gisbradoklaEnthusiast

asked in Data

EBC format database file EBDIC

I am interested in a way to translate these database (Tape) files into a usable format. Anybody have experience? Extended Binary Coded Decimal Interchange Code (EBCDIC) is an 8-bit character encoding used mainly on IBM mainframe and IBM midrange computer operating systems.EBC format descriptionCategory: Document filesApplication: -Mime-type: application/octet-stream

Is there a way to read or write to an MP3 (Music) or MP4 (Video) file's ID Tags?

Is there a way to read or write to an MP3 (Music) or MP4 (Video) file's ID(3) Tags? There is plenty of software out there that allows for the editing of a variety of ID(3) tags in music or video files of the MPEG variety, however it might be useful for a Reader to enable those music / video files that identify their origins to be located from their tags onto a map.Anyone wanting to create a catalogue of their music or video would find the reading of the built-in data tags in their music / video files useful too.....just a thought.

ArcGIS Online JPEG Attachment EXIF metadata

Hi All,I have a workbench that reads a feature service from ArcGIS Online exposing the actual attachment attribute associated with each feature and then extracting the photos attached to it.I'm using RasteReplacer to convert the BLOB data to a JPEG and then writing it with a JPEG writer (with the option to save the EXIF data ticked).However, it doesn't look like the EXIF metadata is writing to the JPEG.I'm sure that the EXIF metadata does exist as I have an existing Python script that uses Arcpy to extract the JPEGs with EXIF out from a file geodatabase. But when I do it through the ArcGIS Online feature service reader, it doesn't seem to be retaining this information .Any help on this would be much appreciated.

we are testing on FME Desktop to extract data (parameters or attributes) from different file formats to MS Excel output.Want to know the procedure how we can extract that data. Also want to know the list of File formats which supports FME to extract

To know the process of Reading and Writing the data. (output to MS Excel)List of Formats where FME can support Read and Write the data.

3 years ago

rawansaleh

asked in Data

Python Exception : 401 Client Error: Unauthorized for url: https://www.arcgis.com/sharing/rest/portals/self?

Hi All, I have an FME workbench which read a feature layer from ArcGIS online and export the information into excel sheet, my workbench is running fine in the desktop without any error but when I published it to FME server some times it’s working and sometimes I got the following error “Python Exception <HTTPError>: 401 Client Error: Unauthorized for url: https://www.arcgis.com/sharing/rest/portals/self?” Please note that I include the AGOL connection when I published my fme, I created a new app for this workbench so my users could run it from their side I’m using FME 2019 Any Ideas? Cheers,Rawan

Stable token to ArcGISOnline (AGOL)

I am trying to connect to AGOL but my token expires. I followed the method in https://community.safe.com/s/question/0D54Q000080hYdzSAE/how-do-i-reliably-connect-fme-server-201819-to-arcgis-online. It work s but then stops working Any suggestions to to fix this? Under File & Connections, I click web connection, then select connection and click manage web services On AGOL developer I selected

How do I fix "plugins/udatasmith_fme.dll' was found but could not be loaded" or "XINPUT1_3.dll is missing" error when using the UDATASMITH Writer?

How can we fix an error like:plugins/udatasmith_fme.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this libraryI already know the answer, but I wanted to share it with all of you good folks in case it's a problem for you too!Quick fix: Install Unreal Studio (https://www.unrealengine.com/en-US/studio) or install DirectX SDK from https://www.microsoft.com/en-ca/download/details.aspx?id=6812 The Details:Most likely your computer already has the necessary DirectX components, either from an Unreal Studio installation or from another application. However, there are some cases where these components may be missing. For example, you are likely to encounter this issue when running a Windows Virtual Machine.In any of these cases, you can install the necessary XINPUT1_3.dll by installing Unreal Studio or the DirectX SDK from the link given above. A bit of trivia: XINPUT1_3.dll is used for getting mouse input in DirectX-based games.

3 years ago

ksafeent

asked in Data

Is there a way to extract Road (2d polygon) from an FBX? Or an FBX to DWG workflow?

200

3 years ago

kwellerContributor

asked in Data

ACAD DWG writer erroneously converts int32s to strings

I'm converting DWGs to DWGs, basically copying existing DWGs to new ones with a few extended entity attributes changing values. However, the data types on the output file are string representations, rather than the 32-bit integers that are read from the input drawing and recognized as integers throughout. How can I get the ACAD writer to output the values with the correct data type? I'm using a dynamic schema, with the schema source being the input drawing. Also, how do I know that the output drawing is truly a high fidelity copy of the input drawing? I'm following all the guidelines in the documentation about DWG-to-DWG settings, yet if data types are changing, I wonder what else might be changed/lost in the process, for example, external data links and line styles.

3 years ago

christianlendl

asked in Data

How to extract a center point of a building in CityGML?

Dear FME Community, is there a way to extract a center point of a building in CityGML? So far I have only done it with the centerpoints of ground sufaces. But what if a complex building has multiple ground surfaces? Is there a way to treat the geometry of a building as one group? So instead of extracting the center point of one surface, extract it from the whole volume of a building. Do CityGML buildings have an individual id? I have attached a sample CityGML file. Thank you so much for your help!With kind regards Christian

Problems with Oracle Instant Client and FME

Good day! I am having difficulties getting FME to use Oracle readers and writers. I am using 64bit for both FME and Oracle instant client. From the website, I followed the instructions for downloading an Oracle Instant Client, unzipping it to a directory and adding this to the front of my PATH environment. The options in the reader and writer gallery are still greyed-out however. I have been trawling the web for the past day or so and nothing I see helps (or makes sense to me!). Any help would be appreciated Rich L

290

3 years ago

mr_fmeEnthusiast

asked in Data

Find Max and Min distance from polygons

I have 2 shapefile files, each have about 13,000 features. I need to know what the minimum and maximum distance each feature of file 1 for example has in relation to file 2. How to do that?

Hi, Encountering Error 'The arc collinear feature error(ORA-13346: the coordinates defining an arc are collinear)'. while inserting data into Oracle spatial. Please advice.

610

3 years ago

Page 50 / 273

Badge winners

herahinahas earned the badge Expert (Grey)
herahinahas earned the badge Teacher (Grey)
herahinahas earned the badge Student (Grey)
adnanyazdanihas earned the badge Student (Grey)
adnanyazdanihas earned the badge Teacher (Bronze)

Show all badges

30,357: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.