- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,807 Posts
25,077 Replies

When you subscribe we will email you when there is a new topic in this category

6807 Posts

Filtering GPS points using polygon shapefiles!

I have one shapefilter consisting of agricultural land and some gps points in csv. how can I filter these gps points which fall in the agricultural land? I have already tried Spatial Filter but it doesn´t work all the time it fails. Would be really nice if anyone could help me with this problem. :)

362

6 months ago

david_Contributor

asked in Data

Avoid automatic date conversion

Hi,Is there any way to prevent FME Desktop from converting dates to its internal format? For example, if you get '2024-05-30' I want it to remain '2024-05-30' and not '20240530'.I understand that it can be useful in some cases but there are others that this automatic conversion becomes a headache. Thank you!Regards.

481

6 months ago

proteveContributor

asked in Data

problems with arcs from dwg

I have a close polyline in dwg and some lines inside this polyline. the polyline contains arcs too. with these 2 I create small areas in fme.now the problem:when i create these areas the boundary where the arc part of exterior polyline is different fromthe boundary of smaller areas.is this a bug in fme? cause it doesn’t make sense to create parts of the same arc that are not colinear with the arc that the part was extracted.or is there a setting that i have to set? ive notice that the arcs has different description in inspector windowfor the new created areas it says “IFMEArc: Arc By Center Point With Ends”and the other shape it says IFMEArc: Arc By Bulge. example:Pink area was generated and overlaps the exterior boundary (blue line) area. that should not happen

mr_fmeEnthusiast

Hi, everyone.I have two datasets. I need to find polygons that do not overlap, even if they have different shapes. I'm using a spatial filter, and I've tried others too, without success. When analyzing the failed ports, some polygons appear as 'NO INTERSECT', but in ArcGIS, it's possible to see that the polygons are overlapping others. I've tested this and I think the intersection analysis in ArcGIS is better than the spatial transformers in FME. How can I perform this validation correctly in FME? I'm worried that my results are not reliable when using FME for detecting overlaps. Could it be that my configuration in the transformers is incorrect? Which transformer or configuration is equivalent to the intersects operation in ArcGIS?

421

6 months ago

kaitlyncmcneilContributor

asked in Data

Unable to read CSV file

Hi all, I’m trying to create a simple script which reads a csv and writes to a point gdb. The CSV files I am trying to read are hosted publicly online but they are failing to open in FME workbench. I’m using a Feature reader to do this (for CSV format, and with the csv URL below), but I keep getting the following error: I am fairly new to FME so I’m not sure if there’s an obvious setting in my workbench that I’m missing here. Thanks!

1124

6 months ago

sreuContributor

asked in Data

Importing Smallworld Auxiliary trail (XML)

Hi everyone,i try to import an Auxiliary trail created in Smallworld to FME for further intersections with different smallworld objects (using the SBS Plugin). Unfortunately it seems that FME cannot read the XML file correctly as i cant see any geometries. I used the XML (Extensible Markup Language) reader but maybe another reader might be better? or might a writer be useful to extract the geometries? I attached the XML file an hope that somebody has an idea what to do. Thank you!

843

6 months ago

thiruppathirajsContributor

asked in Data

snapping error

Hey Everyone!its just a curious doubt…Can we solve snapping errors on Fme form?

672

6 months ago

pauldContributor

asked in Data

Looping through list to exclude counts

Hi.I have a problem where I have a local counter (_count) that adds a counter to each feature that passes through. I also have a list of numbers I want the counter to ignore. Eg 1 to 10,000 but ignore the 244 numbers in my _ignoreList, which is dynamically created. 1,2,3...39,40,42 (ignore 41 because its in my list)Any ideas on how I would go about this?All help is greatly appreciated.Regards, Paul

672

6 months ago

solyContributor

asked in Data

question regarding to geometry validator

Hello ,I am checking duplicate consecutive points It is clear that issue locations port show one vertex of duplicate point with coordinates (x,y).i would like to know the two vertex that duplicated then I choose one of them to cancel .but it show me only one vertex .How could I achieve it ? FME 2021

freddy17Contributor

Hi Everyone I see that there is a .bcf writer available in fme:https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/bcf/bcf.htm The documentation mentions that .png "snapshots" should be created for the writer. To my knowledge I have not seen any way to take images from fmes workbench viewer or inspector, therefore I assume you will have to create your own pngs for this.. Has anyone had a go at trying to write .bcfs in FME? I would love to see some best practices or how tos for this writer. RegardsFred RegardsFred

683

6 months ago

solyContributor

asked in Data

geometry validator duplicate consecutive points ?

551

6 months ago

alfonsContributor

asked in Data

list in Excelsheet on specific row and coloum

Hello,I generate a data pool from various data sources with identical attributes, which I filter and sort using various criteria. From these results I create several lists (Top50), which I output in an Excel table with the XLS writer. In principle, this works well, but I would like to insert a blank line between the output lists or output the lists from a certain line in the Excel sheet.I tried to integrate this blank line into the list using a new entry, but only managed to do this using the Python caller, which I wanted to avoid. If the list did not contain 50 elements, I did not manage to output the second list in a specific line again.My question now is, how can I start the output of the N.th list on the 55th line (without using the Pythoncaller. Furthermore, I have not found a way to output a list in the 55th row in column K. Is there a possibility for this in FME?Thank you very muchTranslated with DeepL.com (free version)

571

6 months ago

datamanContributor

asked in Data

Export layers from a QGIS Project

Hello everybody :-) we have a QGIS Project (.qgz) with 2 Layers, which we want as GeoJsons export. If possible uploading them into a FTP Server.Can we do this using FME? I have searched a bit and I do not find any Readers for QGIS… Thanks in advance!

2234

6 months ago

dworkhkParticipant

asked in Data

Seeking Guidance on Iterating CSV Files and Configuring Table View Schema in Feature Reader

I'm currently working on a task where I need to iterate through each CSV file found within specified folders and convert them to SHP files. My approach involves using the path to identify all files under the specified folder and then filtering them by extension using an attribute filter. However, when I use the FeatureReader to read the CSV files, it reads all the CSV files and combines them into one table.I'm looking for guidance on how to set up a loop to iterate through the files one by one, rather than reading them all at once. Additionally, I've noticed that there are no columns shown in the visual preview, and I have to manually check all the columns in the column options to visualize them in the preview.Is there a way to configure the table view/data schema in the FeatureReader to address these issues? Any advice or suggestions would be greatly appreciated. Thank you!

442

6 months ago

solyContributor

asked in Data

how to remove specific index of coordinates in a line and rebuild the line without this index?

Hello ,i would like to remove specific index of a vertex coordinates from a line .then build the line without this vertex .How could I achieve it ? my second question :How could I find which index vertex coordinates so close to next index coordinates ? then filter it to keep only one of them.thanks in advanceFME 2021

635

6 months ago

solyContributor

asked in Data

question : the output of changed spike remover t

Hello ,Spike remover : It cleans the lines and removes spikes and fix it but Changed port : the line geometry is changed .( I mean the position of line )i would like to fix the spike but keep the line without changing the position of it .How could I achieve it ?my second question :how to find and define the part of line that has spike ?Spike removed create point I would like to get also the Part of line that spiked . FME 2021 thabks in advance .

771

6 months ago

lambertusEnthusiast

asked in Data

Create equal sized polygons on point locations

Main question: how to create polygons at point locationsWithin FME 2024.0 I created a point dataset of cross sections with 866 points.At each location I want to create a square, which is sized 10 by 10 meters. The current points should be in the centre of the squares.Any suggestions how to achieve this?I tried the Bufferer but did not find the right settings yet to get a nice square at each point location. Output should be like the blue squares in this image:

824

6 months ago

justynakrajewskContributor

asked in Data

DGN Writer - lines

All two-point lines when exported to DGN, are saved as ‘Linestring’, not ‘Line’.I have a problem with this in the later stages of working in OpenCity Maps. All two-point lines are displayed as ‘Linestring’ and none of the functions work properly for me.In DGN Writer I select : Two point Line output; Type 3 Elements .Please, can anyone tell me how to write these lines as ‘Line’?

461

6 months ago

jiaxinContributor

asked in Data

Featurereader cannot use an user parameter to read multipule feature types

I use the feature reader to read data from PostGIS, I created a user parameter in feature reader to get the feature type to read. However, it did not work if I select multipule features (tables) from my postgres database. It only works when 1 feature type is selected. Is this a common issue of FME?

697

7 months ago

neaContributor

asked in Data

Not able to update a field in a FGDB using FeatureWriter

II read from a FGDB do some processing then I want to write back (update) to a field in the same FGDB. I have a FeatureHolder immediately after reading the FGDB to force complete reading before writing. The Where clause make sure I only update records with matching PremiseIDs (original source data and stream data). I only want to update one field but I don’t see how to specify that field in the FeatureWriter. In a AttributeManager before the writer I remove all other attributes than the one I want written. Not working.

542

7 months ago

ajhemelsContributor

asked in Data

Create pdf file from excel file

Hello,How can I make a workspace to convert excel sheets into a pdf files?I have tried everything but nothing works.Is there anybody who succeeded in this?Thank you in advance!Anne

mr_fmeEnthusiast

Hi,It's possible to use FME Desktop to obtain indices like NDVI from images without downloading them? Thank´s

302

7 months ago

sammySupporter

asked in Data

Cannot write out 19700101000000 ESRI ArcGIS Portal Feature Service Writer

I am having a unique issue where I cannot write out the date 19700101000000 (01/01/1970) to my ‘Date’ data type fields in an Esri sde feature class. How do I fix this problem? When I want to write out 19700101000000 to one of these fields, the writer runs successfully and I get the success message but then when I read the data back into FME or I check my attribute table in ArcGIS Pro the field shows up as 18991230000000 (12/30/1899). The date is formatted correctly. I can write out other dates no problem. I can write out 19700101000001 and 19710101000000 no problem. I just can’t write out 19700101000000. I can open the attribute table in ArcGIS Pro and manually enter the date as ‘1/1/1970 12:00:00 AM’ (from the calendar/time picker) and the table will accept it. I can also use calculate field and input '1970-01-01 00:00:00' (python format) and the table will update correctly. I have tried using AttributeManager and DateTimeConverter to make sure the date is formatted correctly and the

15511

7 months ago

kyp4810Contributor

asked in Data

I want to convert ifc file to citygml via fme.

I am currently researching converting ifc to citygml. fme is using a paid version with a license. When I simply convert ifc to citygml using fme, an error appears and it does not work.Do I need another method to convert ifc to citygml?

743

7 months ago

mariasContributor

asked in Data

What can be usedsimilar to FeatureReader transformer to read schema and data?

I need to extract TAB or Shape file from S3 and read data from it including schema.I have discovered in this articlehttps://community.safe.com/data-7/how-to-extract-the-actual-shapefile-from-featurereader-geometry-and-attributes-14548?tid=14548&fid=7that FeatureReader apparently can’t read all attributes that are in the file, until I expose them. But what is I don’t know the list of all attributes? I don’t know what exactly will be uploaded by other people to S3 bucket, I just need to read the file. Could you help, please, to identify the correct settings of FeatureReader or another way to extract data?

602

7 months ago

Page 16 / 273

Badge winners

kailinatsafehas earned the badge Enchanted by Attributes
gazmanhas earned the badge Welcome Back
miguelhacarhas earned the badge Spanish Speaker
miguelhacarhas earned the badge Student (Grey)
miguelhacarhas earned the badge Expert (Grey)

Show all badges

30,351: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.