- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,781 Posts
24,935 Replies

When you subscribe we will email you when there is a new topic in this category

6781 Posts

Recently active

Most replies Most views Newest first

solyContributor

asked in Data

geometry validator duplicate consecutive points ?

Hello ,I am checking duplicate consecutive points It is clear that issue locations port show one vertex of duplicate point with coordinates (x,y).i would like to know the two vertex that duplicated then I choose one of them to cancel .but it show me only one vertex .How could I show the two vertex ? FME 2021

511

5 months ago

alfonsContributor

asked in Data

list in Excelsheet on specific row and coloum

Hello,I generate a data pool from various data sources with identical attributes, which I filter and sort using various criteria. From these results I create several lists (Top50), which I output in an Excel table with the XLS writer. In principle, this works well, but I would like to insert a blank line between the output lists or output the lists from a certain line in the Excel sheet.I tried to integrate this blank line into the list using a new entry, but only managed to do this using the Python caller, which I wanted to avoid. If the list did not contain 50 elements, I did not manage to output the second list in a specific line again.My question now is, how can I start the output of the N.th list on the 55th line (without using the Pythoncaller. Furthermore, I have not found a way to output a list in the 55th row in column K. Is there a possibility for this in FME?Thank you very muchTranslated with DeepL.com (free version)

561

5 months ago

datamanContributor

asked in Data

Export layers from a QGIS Project

Hello everybody :-) we have a QGIS Project (.qgz) with 2 Layers, which we want as GeoJsons export. If possible uploading them into a FTP Server.Can we do this using FME? I have searched a bit and I do not find any Readers for QGIS… Thanks in advance!

1844

5 months ago

dworkhkParticipant

asked in Data

Seeking Guidance on Iterating CSV Files and Configuring Table View Schema in Feature Reader

I'm currently working on a task where I need to iterate through each CSV file found within specified folders and convert them to SHP files. My approach involves using the path to identify all files under the specified folder and then filtering them by extension using an attribute filter. However, when I use the FeatureReader to read the CSV files, it reads all the CSV files and combines them into one table.I'm looking for guidance on how to set up a loop to iterate through the files one by one, rather than reading them all at once. Additionally, I've noticed that there are no columns shown in the visual preview, and I have to manually check all the columns in the column options to visualize them in the preview.Is there a way to configure the table view/data schema in the FeatureReader to address these issues? Any advice or suggestions would be greatly appreciated. Thank you!

412

5 months ago

solyContributor

asked in Data

how to remove specific index of coordinates in a line and rebuild the line without this index?

Hello ,i would like to remove specific index of a vertex coordinates from a line .then build the line without this vertex .How could I achieve it ? my second question :How could I find which index vertex coordinates so close to next index coordinates ? then filter it to keep only one of them.thanks in advanceFME 2021

615

5 months ago

solyContributor

asked in Data

question : the output of changed spike remover t

Hello ,Spike remover : It cleans the lines and removes spikes and fix it but Changed port : the line geometry is changed .( I mean the position of line )i would like to fix the spike but keep the line without changing the position of it .How could I achieve it ?my second question :how to find and define the part of line that has spike ?Spike removed create point I would like to get also the Part of line that spiked . FME 2021 thabks in advance .

771

5 months ago

lambertusEnthusiast

asked in Data

Create equal sized polygons on point locations

Main question: how to create polygons at point locationsWithin FME 2024.0 I created a point dataset of cross sections with 866 points.At each location I want to create a square, which is sized 10 by 10 meters. The current points should be in the centre of the squares.Any suggestions how to achieve this?I tried the Bufferer but did not find the right settings yet to get a nice square at each point location. Output should be like the blue squares in this image:

794

5 months ago

justynakrajewskContributor

asked in Data

DGN Writer - lines

All two-point lines when exported to DGN, are saved as ‘Linestring’, not ‘Line’.I have a problem with this in the later stages of working in OpenCity Maps. All two-point lines are displayed as ‘Linestring’ and none of the functions work properly for me.In DGN Writer I select : Two point Line output; Type 3 Elements .Please, can anyone tell me how to write these lines as ‘Line’?

451

5 months ago

jiaxinContributor

asked in Data

Featurereader cannot use an user parameter to read multipule feature types

I use the feature reader to read data from PostGIS, I created a user parameter in feature reader to get the feature type to read. However, it did not work if I select multipule features (tables) from my postgres database. It only works when 1 feature type is selected. Is this a common issue of FME?

687

5 months ago

neaContributor

asked in Data

Not able to update a field in a FGDB using FeatureWriter

II read from a FGDB do some processing then I want to write back (update) to a field in the same FGDB. I have a FeatureHolder immediately after reading the FGDB to force complete reading before writing. The Where clause make sure I only update records with matching PremiseIDs (original source data and stream data). I only want to update one field but I don’t see how to specify that field in the FeatureWriter. In a AttributeManager before the writer I remove all other attributes than the one I want written. Not working.

522

5 months ago

ajhemelsContributor

asked in Data

Create pdf file from excel file

Hello,How can I make a workspace to convert excel sheets into a pdf files?I have tried everything but nothing works.Is there anybody who succeeded in this?Thank you in advance!Anne

mr_fmeEnthusiast

Hi,It's possible to use FME Desktop to obtain indices like NDVI from images without downloading them? Thank´s

302

5 months ago

edwibberleyContributor

asked in Data

ESRI ArcGIS Server Feature Service reader won't read feature type. Error - ArcGIS Feature Service Reader: Encountered an unexpected error. The error code from the server was '500' and the message was: 'Error performing query operation'. Details: ''

Hi, I have a workspace using an ESRI ArcGIS Server Feature Service reader with a token authentication. I am trying to read 3 feature types from the map server and 2 of them read fine but one comes back with the error: "ArcGIS Feature Service Reader: Encountered an unexpected error. The error code from the server was '500' and the message was: 'Error performing query operation'. Details: ''" Does anyone have any ideas of why only one of the feature types would not work? The three feature services should all have the same naming standards and schema so there is no reason why they should behave differently that I can see. Are there any suggestions for how I might be able to find the source of this issue? Any help would be greatly appreciated! Thanks.

6475

5 months ago

sammySupporter

asked in Data

Cannot write out 19700101000000 ESRI ArcGIS Portal Feature Service Writer

I am having a unique issue where I cannot write out the date 19700101000000 (01/01/1970) to my ‘Date’ data type fields in an Esri sde feature class. How do I fix this problem? When I want to write out 19700101000000 to one of these fields, the writer runs successfully and I get the success message but then when I read the data back into FME or I check my attribute table in ArcGIS Pro the field shows up as 18991230000000 (12/30/1899). The date is formatted correctly. I can write out other dates no problem. I can write out 19700101000001 and 19710101000000 no problem. I just can’t write out 19700101000000. I can open the attribute table in ArcGIS Pro and manually enter the date as ‘1/1/1970 12:00:00 AM’ (from the calendar/time picker) and the table will accept it. I can also use calculate field and input '1970-01-01 00:00:00' (python format) and the table will update correctly. I have tried using AttributeManager and DateTimeConverter to make sure the date is formatted correctly and the

15311

5 months ago

kyp4810Contributor

asked in Data

I want to convert ifc file to citygml via fme.

I am currently researching converting ifc to citygml. fme is using a paid version with a license. When I simply convert ifc to citygml using fme, an error appears and it does not work.Do I need another method to convert ifc to citygml?

703

5 months ago

eric_armitageContributor

asked in Data

OData writing

I am starting to work with reading and writing OData. I can see there is an OData reader but no writer. Writing seems to be possible using the HTTP caller. Is there a particular reason why there is no OData writer? Are there plans for an OData writer? Just want to make sure we are building the process correctly.

421

6 months ago

mariasContributor

asked in Data

What can be usedsimilar to FeatureReader transformer to read schema and data?

I need to extract TAB or Shape file from S3 and read data from it including schema.I have discovered in this articlehttps://community.safe.com/data-7/how-to-extract-the-actual-shapefile-from-featurereader-geometry-and-attributes-14548?tid=14548&fid=7that FeatureReader apparently can’t read all attributes that are in the file, until I expose them. But what is I don’t know the list of all attributes? I don’t know what exactly will be uploaded by other people to S3 bucket, I just need to read the file. Could you help, please, to identify the correct settings of FeatureReader or another way to extract data?

592

6 months ago

mariasContributor

asked in Data

Which transformers can be used?

Hello,I am authoring a workspace, that uploading data in PostgreSQL database.And I have difficulties to implement one function.There is a validation that checks if value is not empty or null. If object has missing unique S_ID, it is still gets uploaded in the “Data” table. But also, I add a record in the “Errors” table, that feature has missing S_ID.When features get uploaded in the “Data” table they are automatically assigned another unique key “ID” this is just a sequential number in “Data” table. The task for me is to add “ID” from “Data” table when I create a record with error in “Error” table. Because it will be the only unique attribute by which feature can be identified in case it is missing S_ID. The difficulties for me is that I am logging errors earlier than ID attribute is assigned to the uploaded features. I thought to use VariableSetter and Variable Retriever that should help in this case. But I don't know how to extract “ID” attribute anyway. I am using FeatureWrite

899

6 months ago

mcannalea12Contributor

asked in Data

Join/Test on Attributes and Geometry simultaneously

This seems like it should be really easy to do but I’m spinning my wheels. I have a dataset of points, each with an attribute of Contract Number. I have a set of polygons also with Contract Number attributes. I need to determine if the point falls within a polygon AND the point contract number matches the polygon contract number that it falls within. What’s the best way to achieve this?

FME Server change database to SQL Server

I am trying to change the FME Server database from the default Postgres to SQL Server. I have followed the instructions in this link: http://docs.safe.com/fme/2018.1/html/FME_Server_Documentation/Content/AdminGuide/Changing_Database_Provider.htmbut after everything is done, I cannot login as admin anymore. I get the login page to come up, and I can confirm that connectivity is there to SQL Server, but it won't accept my password for admin anymore.

846

6 months ago

boron013Contributor

asked in Data

DGN Smart Solid - Solid interpolation to mesh

Hello,I’m working in FME Form (both tested in 2023.2 and 2024.0 ) with DGN files contaning 3D objects in Smart Solid format.I’m looking for some possibility in controlling solid to mesh decimation process. At the moment I can’t find any way to change default way how FME Reader create mesh from solid objects.For example some circular object is decimated as 8 vertices.I’ve already tested Stroking Tolerance without any effecthttps://docs.safe.com/fme/html/FME-Form-Documentation/FME-Form/Workbench/Stroking_Tolerance.htmand “Number of interpolated curve vertices” in DGN Reader parametrs. Any suggestions?

1013

6 months ago

mattwilkieContributor

asked in Data

How to update available EPSG coordinate systems?

The Coordinate Systems Gallery is missing EPSG spatial references we use all the time. How to update the gallery list so that more EPSG codes are available? (e.g. anything on https://epsg.io/)

1517

6 months ago

wisegisContributor

asked in Data

Dynamic Field Names to Standardized

I have multiple sensor output csv files that have the same field names that changes with every single file. The locations of the fields stays the same which is good. An example is ID, DATE, TEMP, COND_HIGH, COND_LOW. If the reader field names are changing constantly what is a good way to strip those names and put the simple ones above in their place? I have attempted or looked at the Schemamapper, but I’m not sure if that is the route to take. The other way I messed with was Reader > UUID > AttributeExploder > AttributeCreator (Conditional Statements) > Aggregator? Any help would be appreciated. I think I am making this harder than it needs to be.

422

6 months ago

areyiContributor

asked in Data

Deleting ffs file content

Hi together, Is there a way to delete the content of a ffs file but not the file itself? I am using FME 2021.2.0.1. Thanks for your support

735

6 months ago

aaronContributor

asked in Data

How to write attachments to ArcGIS Online?

I need to copy records from one hosted feature layer in ArcGIS Online to another hosted feature layer. Schemas are identical. Some of the records in the source data have an attachment (only 1 per feature/record so only in the 0 position in the list). No problem getting all of the records to write from the source to the destination but the attachments are not included. Anyone know how to do bring over the attachments with the rest of the data?

5876

6 months ago

Page 15 / 272

Badge winners

bwnhas earned the badge GIS Day 2024
alkamelgishas earned the badge English Speaker
alkamelgishas earned the badge Arabic Speaker
alkamelgishas earned the badge Welcome Back
alkamelgishas earned the badge Integrate Data with the FME Platform Training

Show all badges

30,126: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.