- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,807 Posts
25,077 Replies

When you subscribe we will email you when there is a new topic in this category

6807 Posts

Most replies

Most views

Newest first

willydeveraContributor

asked in Data

Transform values from an attribute into a list

Hi, I need help. I have an attribute column X with string values ‘S001’, ‘S002’, ‘S003’, and ‘S004’, all lined up in 1 column with 4 rows corresponding to the string values. I would like the output Y should to be a single row list, having just one column and one row, containing the four values:Y = (‘S001’, ‘S002’, ‘S003’, ‘S004’) Could you please advise how this could be done in FME Form. Greatly appreciated. Thanks, Willy de Vera

302

19 hours ago

palhermansContributor

asked in Data

Connect to SQL Server 2000 (!)

Hi, got a question from a client yesterday who wants (with FME2018.1) to connect to a SQL Server 2000 database (no the question is not from a museum: ).FME returns a Fetching Feature Types Error, "... SQL Server Native Client 11.0 does not support connections to SQL Server 2000 or earlier versions".Any ideas the minimum hazzle to get around here? Just to install the SQL Server native client 9.00 and problem solved? I do not have an environment for testing this myself :/ cheers

1386

23 hours ago

fme_hansContributor

asked in Data

Acces FMEflow via httpcaller

Hi,I am trying to request information from FMEflow with an httpcaller. I have created a temporary token that allows everything. If I include the token in the URL, the request works fine. (https://<...?/v3/info?fmetoken=abcdefg...)When I put the token in the httpcaller I get a 401 warning. What goes wrong in the caller?

285

1 day ago

ydreborgObserver

asked in Data

ChatGPT - The "Generate Workspace Documentation" function in FME

Hi folks! As I was using AI tools like ChatGPT and Copilot to troubleshoot, I suddenly received information from the AI about the "Generate Workspace Documentation" function. Here's what I learned:-------------------------------------------------------------------------------------------------------------------------------Generate Workspace DocumentationThis feature allows you to automatically generate comprehensive documentation for your FME workspace. The output is typically an HTML file that provides detailed insights into your workspace structure, parameters, and transformations. It's incredibly useful for sharing with colleagues or for archiving your workflows. How to Use It: Usage in FME Workbench (GUI):Open the FME Workbench application. Load the workspace you want to document. From the Tools menu, select Generate Workspace Documentation. You can choose to output the documentation in an HTML format, which can be opened in any browser.Command Line Usage:This function is also ava

352

1 day ago

aniqakParticipant

asked in Data

TIFF/GRD Raster Data into a csv/table

Hi, I am trying to convert raster data in the forms of .grd, tiff or GRID from ArcGIS Pro into a csv/table. If anyone can point me in the right direction, that would be greatly appreciated. GRD file loaded on ArcGIS Pro

264

1 day ago

junowong128Participant

asked in Data

Why mutiplate line text attribute igds_text_width_multiplier cannot write to dgn

version: 2024I am trying to convert data from fgdb to dgn. I used AttributeSplitter and DGNStyler to reassign size and width to each text elements. Single line text is work but seem mutiplate line text attribute igds_text_width_multiplier cannot write to dgn. Is igds_text_width_multiplier in DGNStyler cannot update igds_multi_text?Remark: I tried FME 2021 is work. mutiplate line text attribute igds_text_width_multiplier can write to dgn.

312

2 days ago

abnan0001Supporter

asked in Data

extracting information from different folders from KML

Hi AllI would like to extract the information of each folder and sub folder in different field with the folder and sub folder names as snapshot attached.I have 4 Main folder and sub folders for each. In a new column lets called : folderdetails - Active camera traps , Removed camera traps etc this has to be taken.Similarly for sub folders alsoAny guidanxce and support , I have tried doing but im not getting the way i should i needed

Objs aren't in the right position in b3dm

Firstly I combined my building objs by Aggregator, then I separated them by Deaggregator, finally to b3dm. I have coordinates of those building objs but All building overlapped in Cesium, How can i locate the buildings according to coordinates.

3121

3 days ago

texxkContributor

asked in Data

Transposing lists into multiple groups

I’m trying to output all property sets from IFC files into separate Excel sheets. So far I’ve found all of the property sets, their attributes and their attribute values. This is my data:What I would like to do is transpose this list into separate lists for each property set like so: After that I could simply write each list to separate Excel sheets, but this is where I get stuck. I create the sheets by feeding the writer from a DuplicateFilter, but how do I join each PsetAttribute to Pset as well as transpose the data so each PsetAttribute is a single column?I need to do it without knowing the exact names or number of property sets existing in each IFC file as well.

623

4 days ago

boxcase01Participant

asked in Data

Excel Writer: Output Field Names in Columns instead of Rows

Hi, I’m using FME 2024.1.I want to write xls files out where my field names appear in Column A (with their corresponding value pair in Column B) instead of in rows. Sounds simple, right?!Writing the data out with an Excel Writer produces a default output like this:Field Names in Row 1, values in the corresponding column....this doesn’t make for a particularly human-readable output when you have 250+ fields in the output dataset.This is the style I would like the output to be in:Field Names in Column A with matching values in Column B.I have tried using an AttributeExploder to create name:value pairs but am having trouble getting from there to anything particularly useable (I still have a lot to learn about working with lists). Oh, great hive mind, please help me out! Thanks, Casey

151

10 days ago

bigclContributor

asked in Data

Geodatabase deleter leaves lock on geodatabase preventing update

Hello : ) I have a Form workbench that first deletes some records from two tables in a geodatabase and then inserts new records into these tables in the geodatabase. This worked fine in FME 2021 but after upgrading to FME 2024 the delete creates a lock on the geodatabase and causes the process to fail: An error occurred while attempting to open an insert cursor on the table 'Total'. The error number from ArcObjects is: '-2147220947'. The error message from ArcObjects is: {Cannot acquire a lock.} Any advice on how to fix this problem would be great.

243

10 days ago

grzegorzwiernyContributor

asked in Data

MText Annotations CAD to GIS Conversion.

Hello FME Community,I am trying to convert annotations from a CAD (.DWG) file to a GIS (.GDB) file in the form of points, in such a way that each line of annotation text is a separate point with an attribute of this text. Everything seems to work fine in my workbench, however, after attaching to GIS programming and loading the resulting points, it turns out that in many cases additional points have been created in each line of text, which prevents me from using them correctly.Has anyone encountered something like this and would be able to help.I attach screenshots of sample annotations in AutoCAD and after conversion in GIS software.FME version: FME(R) 2023.2.1.0 (20240104 - Build 23774 - WIN64)

383

10 days ago

jlorenzettiObserver

asked in Data

Add an accompanying Word Doc to my fanout zip folders

I’m fairly new to FME and I’m not sure this is possible. I’m attempting to add a MS Word doc. to multiple zip folders (from a fanout) that contain shapefiles. It’s basically a data dictionary that needs to accompany the shapefiles. Is this possible?

413

10 days ago

lazarlubomirContributor

asked in Data

Problem with exporting to Excel

Hello, unfortunately I have repeatedly problem with exporting to Excel in Workspace. I checked log, there is following message: 2016-11-24 10:05:57| 67.6| 0.2|ERROR |Excel Writer: Failed to save changes to the spreadsheet 'D:\\XXX\\XXX\\XXX\\new.xlsx'. Check that you have write permission to the file, it has no password protection and is not opened by another application. Error message is 'Permission denied.'It looks, that there is error on Excel side, right? I just want to create new Excel file...

18821

11 days ago

Jonathan SlopeContributor

asked in Data

ChangeDetector gives confusing results

Hi all, I've got some confusing to clear, and hope to find an answer here. I have 2, completely the same datasets, uploaded to ArcGIS Online. Now, i want to update them. To test it, i took 2 completely identical layers, read them from AGOL and now, it shows differences. Can someone explain me what the problem is? If i only check on attributes, then there is nothing wrong, but if i also check on geometry, there is somewhere a change, and the Changedetector gives updates as output, but it should be unchanged. All the data is 2D, there is no 3D. In the update detection key attributes, i selected all the attributes, but left GlobalID and OBJECTID out of it. same for check attributes. Even more confusing, if i do the same process in a new workbench, with the same sources etc, i get different results. Sometimes it igeve met 900 updated, and somethimes 1322Thanks in advance!

13911

12 days ago

rudy_vContributor

asked in Data

Error running translation - reading SQL Server Spatial data on Flow and Form - 2024.1

Hi I am doing migration testing from 2023.1.2 and 2024.0.3. It seems to completely fails on 2024.1.I have tested it on 2023.1.2 and 2024.0.3, worked perfect - no issues.It fails on FME Flow and FME Form on the server - but works OK on my local PCon the server - oldeb 2019, clr 2019, are installed, as with .net 4.7, 4.8 andIt is just a simple sql server spatial reader - and a bit of reprojection - it fails on reading the reading the dataCheersRudy

yahyanarContributor

I am trying to read an ALKIS data file coming as XML file. I have two files, the first one come with version 6.0 and FME opens this file without any problem (xmlns="http://www.adv-online.de/namespaces/adv/gid/6.0"). However, when i try to read the version 7.1 (xmlns="http://www.adv-online.de/namespaces/adv/gid/7.1") I got an error as following:XML Parser error: 'Error at file: 'K:\……..line: 1 column: 1 message: invalid document structure'An error occurred while attempting to parse the XML Schema document 'file:///K:/Geodaten/Projekte/ALKIS/2411_ALKIS_NAS/NAS-Operationen.xsd'The XML Module halted on error, see the logfile for detailsA fatal error has occurred. Check the logfile above for detailsFailed to specify the feature index as constraints on the readerFailed to obtain any schemas from reader 'NAS' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information do you have any so

302

12 days ago

oliver.morrisContributor

asked in Data

DuckDB Summarize command

I am trying to use the duckdb summarize commandhttps://duckdb.org/docs/archive/0.9/guides/meta/summarizein an in memory duckdb using the sqlexecutor:SUMMARIZE SELECT * FROM read_parquet('/Users/x/Downloads/Address.parquet');This doesn’t return any results/attributes but ‘runs’ successfully in FME. In DBeaver it runs no issues.Any idea is there is a trick to get this working?Many ThanksQ!

514

13 days ago

lambertusEnthusiast

asked in Data

PostGIS Reader - warning about 3D feactures

I created a 2D spatial point dataset in a PostGIS database.Today I tried to load them into FME, that works perfect. I get the right locations including the according attributes.I only get this warning:Dimension metadata is ambiguous for spatial column 'geom'. Reporting 3D when 2D+measures might be presentDid I forget to set some specific settings while creating this dataset? There should be no 3D data present, I only saved 2D data :)

513

15 days ago

lifalin2016Contributor

asked in Data

What versions of OGC Geopackage and SQLite does FME produce ?

I'm having a hard time determining which version of OGCGEOPACKAGE that FME produces ? It's not in the writer doc, so I'm asking here.And subsequently, what version of SQLite is produced? (newest is 3.39.4 from Sep 29 this year)As far as I can gather, the versions has been fixed since 2020.0? Is this true?In the "gpkg_extensions" table I found a reference to "spec120", which may (or may not) indicate, that the Geopackage version is 1.2.0, a fairly old version (newest is 1.3.1).And the real question is what extensions are the SQLite database born with? Clearly not "foreign _keys".Can one update some template database if one needs a newer version/more extensions?Cheers.

302

15 days ago

nicholasContributor

asked in Data

How to SELECT all records with Point geometry?

Hello all,I have an Oracle Spatial table that contains some records with a Point geometry and some records with a Polygon geometry.Considering the large number of records, I would like to take advantage of the ability of the Oracle Spatial Reader to perform a SELECT within the Oracle database and return only records with a Point geometry(This is preferable to Reading all records and then using a GeometryFilter for performance reasons)How to I write the SELECT statement?I assume it has something to do with SDO_GEOMETRY, but I just cannot get the syntax correct

223

16 days ago

ldreyfussContributor

asked in Data

Portal Service published from FME Form doesn't have data in the fields.

I’m using the ArcGIS Portal writer to publish point data to a portal. The dataset publishes successfully in FME and all of the points appear on the map, but the attributes don’t show up in the table. Removing specific fields doesn’t seem to help. Has anyone seen anything like this before?

223

16 days ago

edwibberleyContributor

asked in Data

ESRI ArcGIS Server Feature Service reader won't read feature type. Error - ArcGIS Feature Service Reader: Encountered an unexpected error. The error code from the server was '500' and the message was: 'Error performing query operation'. Details: ''

Hi, I have a workspace using an ESRI ArcGIS Server Feature Service reader with a token authentication. I am trying to read 3 feature types from the map server and 2 of them read fine but one comes back with the error: "ArcGIS Feature Service Reader: Encountered an unexpected error. The error code from the server was '500' and the message was: 'Error performing query operation'. Details: ''" Does anyone have any ideas of why only one of the feature types would not work? The three feature services should all have the same naming standards and schema so there is no reason why they should behave differently that I can see. Are there any suggestions for how I might be able to find the source of this issue? Any help would be greatly appreciated! Thanks.

7817

16 days ago

zzupljaninContributor

asked in Data

Insert external reference

Hi,I've been trying too use autocad_xref_path and autocad_xref_name to insert file (another dwg) into REALDWG writer feature type. It should be basic. But it's not working. No warnings, no errors.Did anyone succesfully managed to do that? Can you explain me what am I doing wrongRegards,Želimir

6716

16 days ago

fme_hansContributor

asked in Data

Dynamic reading and writing tables

Hi,I would like to create a workspace that reads all tables that start with the same prefix. I then want to save the result per table as a shape file. If a table is modified by a add or remove an attribute, the workspace should pick this up automatically. Is that possible? My first thought was to work with a dynamic reader, but then I get stuck that it will retrieve all tables, including in other schemas within the database. The second approach is, I create a query that generates select statements and puts these statements in a text file. I then read the text file with a textline reader and install an SQLExecuter. That's all going well.What I run into is that the SQLExceuter cannot automatically expose all attributes.

7210

16 days ago

Page 1 / 273

Badge winners

gazmanhas earned the badge Welcome Back
miguelhacarhas earned the badge English Speaker
miguelhacarhas earned the badge Spanish Speaker
miguelhacarhas earned the badge Student (Grey)
miguelhacarhas earned the badge Expert (Grey)

Show all badges

30,351: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.