- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,807 Posts
25,077 Replies

When you subscribe we will email you when there is a new topic in this category

6807 Posts

philippebEnthusiast

Create new field to ArcGIS Portal Feature

Hello,Is it possible to write new fields in ArcGIS Portal Feature Service with a writer ?I’m getting that message : ArcGIS Portal Feature Service Writer: Attribute 'NAME' on feature type 'Roads' does not match any field on the corresponding layer/table. The attribute will be ignored I can’t believe I have to create those fields with ArcGIS Pro, publish the layer and than run my workbench. Update:OK I just found out that I need my fields to be in lowercase to make it work.But for some reasons some field type are not working.Is there any existing list of all the constraints we need to follow for the fields in Portal? That would save me time! Thanks!

502

3 months ago

emerson_stylesContributor

asked in Data

Strange characters appearing instead of date

I have a script that pulls numerous datasets together, formats them into a consistent set of attributes and then writes them to .TAB files.I’m having difficulty with date field (STARTD) in the final output because although appearing to be correct in the .TAB files, ArcPy is not able to detect the dates in the .TAB files and instead shows the data as odd characters. Please see the image below for more information. Has anyone seen this before or aware of how to fix the issue? I’m not sure if there is a setting in my FME script that may need to be amended.

201

3 months ago

femoContributor

asked in Data

Reading Excel files with different columns

Hello,i need to process excel files, currently by means of FME Form 2023.1, perspectively using FME Flow. These files, however, can differ in columns available. See attachments. The files are processed individually, only one file at a time.If i run the process with file “tk_template_v0.0.xlsx” I want the featurereader to display only the columns, containing in this file. If I run “tk_template_v0.1.xlsx”, which has got 3 more columns, i want these columns to be available in the process as well.I would like to run the script with these files without clicking on the “Feature Types to Read” button any time I process a new file! The sheet name always have the name “Tabelle1”.Unfortunately I do not find a set of parameter that results in the desired output.The existing posts have not yet enlighten me! Any ideas?

665

3 months ago

pehrsContributor

asked in Data

IFMEFeature with aggregated/multiple geometry

We have a reader plugin (c++) that should be able to set aggregated/ multiple geometry to an IFMEFeature.For example:We have only several IFMEGeometry objects. These IFMEGeometry objects should be set to an IFMEFeature. So that we have finally an IFMEFeature that consists of several different geometry objects/ parts. IFMEFeatureIFMEGeometry_Part_1 IFMEGeometry_Part_2 …. IFMEGeometry_Part_nfme_type = fme_areafme_geometry = fme_aggregatefme_feature_type = DepthArea How can we solve this?

494

3 months ago

philippebEnthusiast

asked in Data

Read multiple Excel file with different starting line

Hi,I have thousand of Excel files I need to read but all of them have different starting attributes line. Sometimes line 15 or 16 or 17.(not me who developed that method of working….)The attributes are all the same for all the files.Any idea how I could have the Excel Reader to detect the starting line?Thanks !

523

3 months ago

albjohContributor

asked in Data

Colorize polygons based on attribute value for writing/visualizing HTML

Hi, I’m looknig for a way to colorize polygons based on attribute value for writing to HTML and further use in data streaming service with workspace app. Each polygon have attributes with unique name and color.I want to apply these colors to based on the values in the “name” attribute. I know it’s possible to replace text in the “html_content” using the string replacer but how can I make use of my existing attributes when adding eg. a javaScript function? I guess I need to populate the feature properties dynamically from name attribute:However my edits seem to be omitted when written to final html…Any examples/ideas on this

430

3 months ago

scarterContributor

asked in Data

Issues converting tab to geojson due to NativeX in file

Hello Forum, I need to convert a tab file to geojson, which is ordinarily a simple task. However I am getting this error message…“MITAB Reader: Unsupported table type 'NativeX' in file #######################. This type of .TAB file cannot be read by this library.”Note that the # symbols are masking the UNC path and file name.Does anyone know a way around this? Thanks,Stuart

263

3 months ago

fmesafe.podporaContributor

asked in Data

GeoJSON entry according to the defined schema

Hey. Hey. I have a problem with GeoJson. GeoJson automatically writes the geometry and I would need to write an extra "layer" block to this geometry block, see attachment layer. I tried to create a template on json templater see fmwt, but it doesn't work. The idea of this template was that I would define the structure as json including the "layer" block and then write it as text with all parameters as geoJson, but I don't know if this is a good way to go. Would you recommend me any other options? I also have the schemas available, but I'm not sure on which transformer and in what combination with other transformers to use them to achieve the result. Thank you very much

SHP with ZM dimensions to Postgis linestringZ

Hi all, I did not found the way to remove the M dimension from a shapefile to include it into a postgis geometry defined as linestringZ. Do you know the transforer to be used ? Thanks, Pierre

Fitview when writing to microstation dgn

I am using FME to write to microstation DGN. The FME workbench file is using the fanout option to write different areas to the microstation DGN file, based on the same seed file. At the moment I have to use a microstation macro to "fitview" of each produced file in order to have the microstation file centered at each specific area. I rather use only FME to avoid this additonal step.Is there a way / transformer in FME to save the microstation file centered in the written data?

345

3 months ago

nicholasContributor

asked in Data

Can Writer Esri Geodatabase (File Geodb Open API) write metadata?

Hello all,I have succeeded in building a workspace that Reads from Oracle and Writes a fileGDB that includes metadata for the feature layer in the fileGDB. I used an XMLTemplater to achieve this.I am successful when I use the Writer Esri Geodatabase (File Geodb)However, I would prefer to use the Writer Esri Geodatabase (File Geodb Open API)But when I substitute this Writer, it fails to include the metadata for the feature layer.Is there some setting that I am missing?Or is this functionality just missing from the Open API Writer?

261

3 months ago

gbdContributor

asked in Data

Neighborfinder 3d, calculate 3d distance.

I´m in need to calculate the shortest distance in 3d between a set of basepoints and a line.Something similar to a Neighborfinder in 3d mode.Do any of you know a way to do this?

754

3 months ago

ddecoeneContributor

asked in Data

Reading API into attributes

Hello, i have an api which i need to read on a daily basis.I use an httpcaller, this is what i get.{ "values" : [ { "id" : "66d9f33fa4766fe73ac59fb9", "start_time" : "2024-09-05T20:06:55+02:00", "end_time" : "2024-09-05T20:07:54+02:00", "vehicle" : { "id" : "xxxxx", "country_code" : "BE", "id_type" : "licenseplate" }, "price" : { "amount" : 0, "vat" : 0 }, "right_type" : { "code" : "PAID_PARKING" }, "area" : { "code" : "xxxx", "area_manager_id" : "611e58c434e393575bd3a064" }, "registration_time" : "2024-09-05T20:06:55.593+02:00", "registered_by_organization" : { "code" : "xxxxx", "name" : "xxxxx" }, "external_user_reference" : "31358053", "channel" : { "medium" : "api" }, "tariff" : { "id" : "653ba7cd9c4bdbc

452

3 months ago

andybarkerParticipant

asked in Data

Unable to select Google BigQuery as a writer

I’m working through a test case to pull a table data from one of our MS SQL databases into Google BigQuery. I’ve downloaded and installed the BigQuery package from FME Hub and setup the needed Clientid and secret to have it connect to our Google Cloud project. It tests successfully in the services setup, and if I use the GoogleBigQueryConnector, I’m able to select our cloud project and dataset for reading, so I know the connectivity part of it is working. The issue is trying to write something to BigQuery.If I go to create a writer and choose “Google BigQuery” as the format, the Format selection stays red, like it’s an invalid selection. What am I missing?Unable to select Google BigQuery as a Writer format

422

3 months ago

jakethepainterContributor

asked in Data

Can fme read whether a cell has comments or notes in an Excel xlsx document?

I have a giant spreadsheet that many people have added notes or comments to by right-clicking on the cell and saying "new comment" or "new note". Is there a way for fme to figure out which cells have comments?

nathContributor

Hi, I created a shapefile with line segments (roads). This shapefile has to be loaded into a postgis database and the person who has to do that sends me that she gets this error ERROR: Column has M dimension but geometry does notCONTEXT: COPY tmp_shp_crab_wegsegment, line 1, column geom: "01050000208A7A00000100000001020000000700000000F3BE9F41600A4180690B0048FD0941005FDD2623600A41008F7F97..."I did some searching on the forum and found some things like the Measure remover, and I also set the output dimension to 2D in the writer but she says she still gets it. Does anyone know what else it could be due to? Thx!Nathalie

567

3 months ago

raabsterContributor

asked in Data

Point cloud to point cloud

Hi everyone! So I have some LAS files that I would like to filter. The flow is as follows:Everything seems to be working, but when I read the processed las-files into my program that I need to use, I can’t get it to work. The original files do work, so it’s something that happens along the way. Any ideas?

314

3 months ago

sofiaContributor

asked in Data

List all feature classes and their subtypes, and domain values from a geodatabase

Hi, It seems there is no easy way to do this from what I have read on this topic. I really wish for a way to extract coded domains from feature classes in an SDE geodatabase. I don’t even have to have the field names since I have named the domains after the featureclass, subtype and field it is attatched to. How can I get a hold of domain lists within FME? The point for me is to regularly be able to pull out lists of the options my users have in different fields since these need to be looked over now and then.

643

3 months ago

alindbergParticipant

asked in Data

WFS Reader returns GetFeature error "Unknown namespace"

I’m trying to read this wfs-service https://avoin.metsakeskus.fi/rajapinnat/v1/gridcell/wfs or alternatively https://avoin.metsakeskus.fi/rajapinnat/v1/gridcell/ows with FeatureReader and FME returns following error: 2024-09-11 10:32:43| 0.0| 0.0|ERROR |<ows:ExceptionReport xmlns:xs="http://www.w3.org/2001/XMLSchema=" xmlns:ows="http://www.opengis.net/ows=" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance=" version="1.0.0=" xsi:schemaLocation="http://www.opengis.net/ows https://avoin.metsakeskus.fi/rajapinnat/schemas/ows/1.0.0/owsExceptionReport.xsd="><ows:Exception exceptionCode="InvalidParameterValue=" locator="namespace="><ows:ExceptionText>Unknown namespace [v1]</ows:ExceptionText></ows:Exception></ows:ExceptionReport>2024-09-11 10:32:43| 0.0| 0.0|ERROR |Received error report: ExceptionReport2024-09-11 10:32:43| 0.0| 0.0|ERROR |The XML Module halted on error, see the logfile for details2024-09-11 10:32:43| 0.0| 0.0|ERROR |A fatal error has oc

532

3 months ago

pinkopoContributor

asked in Data

Generic reader fail to read shapefile on FME Flow

Hi guys i been working on a “easy translator” type of app on Flow and really struggling to get it read shapefiles in a zipped file. Error message below.. have no idea why it add a “_0” after “.zip”.. can this be the reason it failed? Shapefile Reader: 'C:\Users\SVCAWS~1.SC\AppData\Local\Temp\fmeengines\AWSGISFME01_Dynamic_Engine1\TempFS_1725628283291_20936\dsGENERIC_1_0\Inputtt.zip_0' is not a valid Shapefile and cannot be read Thank guys!

402

3 months ago

nicholasContributor

asked in Data

How to export the metadata stored in a fileGDB to an XML file?

I have a fileGDB with a single feature class, and that feature class has metadata.How do I export that metadata to an XML file?I am using FME Desktop (FME Form) 2022.1

201

3 months ago

rmpayabyContributor

asked in Data

Issues with UTF-8 after upgrading to FME Form 2024.1

Hello, I have recently upgraded FME Form 2024.1. I tried to run a project, but I immediately got the following error message: “FME failed to restore the process locale to UTF-8. A non-UTF-8 process locale may cause undefined behavior.” Is there any quic fix for this issue?

581

3 months ago

venki.valleriObserver

asked in Data

Transaction Rollback on multiple writers

Hi, Is it possible to rollback all the inserts been made to database through multiple writers(Oracle/Esri) if one of the writers fail?

300

3 months ago

youssefContributor

asked in Data

Writing AIXM 5.X geometry

Hello guys,i am a little desperate in my attempt to write data from our oracle spatial database to AIXM gml. I already watched the Overcoming the Complexities of AIXM with Model Based Data Integration - FME by Safe Software webinar and also read this artical https://support.safe.com/hc/en-us/articles/25407686750477-AIXM-4-5-and-5-1-Reading-Writing-and-Validation-EU-Airports-Demo. discussing the matter. I even downloaded the demo workspaces to try to figure out why exactly mine is not working but without any result yet. I will attach my workspace , a log-file of a successful translation and the resulting gml file to this post and i hope that someone can make out the issues.Dont wonder about the Geometry-Extracter and Geometry-Replacer transformer i use in the workspace, i have already tried it without them and thought they could help, but also with no result.Thank you guys for reading this and helping me out in advance, it is very much appreciated!

Writer Error Geodatabase Error (-2147219884)

HelloCould not able to write “Esri Geodatabase (File Geodb Open API)” facing Error Geodatabase Error (-2147219884): this so frustrating form last 2 days i am suffering from this issue.

263

3 months ago

Page 7 / 273

Badge winners

kenortey8has earned the badge Teacher (Grey)
edwardhas earned the badge Integrate Data with the FME Platform Training
kailinatsafehas earned the badge Enchanted by Attributes
gazmanhas earned the badge Welcome Back
miguelhacarhas earned the badge Spanish Speaker

Show all badges

30,351: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.