- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,807 Posts
25,077 Replies

When you subscribe we will email you when there is a new topic in this category

6807 Posts

poonam21Contributor

Create ESRI Shapefile from CSV

Hey,There is one blog on support.safe.com on working with esri shapefile data. There is a scenario and below explained the workspace attached to it.I am not getting how the Shapefile is created in below scenario. The shapefile was already given in the template file.Below is the link of the article - https://support.safe.com/hc/en-us/articles/25407430413837-Tutorial-Getting-Started-with-FME-DesktopHow the esri shapefile used in the reader is created? Thanks in advance

1042

2 months ago

mr_fmeEnthusiast

asked in Data

How to filter pixel value - other way

Hi,I understand that the Raster Expression Evaluator transformer doesn't work properly, only in the new version 2024.2.I would like to know how I can proceed with my workspace, as I want to keep only the raster pixels with values greater than 0.3. How can I solve this? Please find my sample attached: https://drive.google.com/file/d/1Yil9aZj5mkiTQi7lbvDJfFejWKQE4YTl/view?usp=sharing Thank´s

342

2 months ago

lsugumarContributor

asked in Data

Load column name as an attribute value and column values loaded into another attribute

Hi, I have an excel spread sheet that i have to read and load into a database table. The structure of the excel sheet is different from that on the database. Sample screen shot of the excel spread sheet is seen below. Columns J-S are county names, and the values associated with it are the cost for each county.I need the 10 county column names loaded as values into COUNTY_CD column in the database and its associated county cost value loaded into database column COST_PER_SQFT. So, for every row in the excel spread sheet I will have 10 rows in the database and each row represents data for each county. The database columns and the values to be loaded should like belowI had looked into several post that does transpose of columns, pivot tables etc, but I couldn’t find a solution that works for me. Any help is much appreciated! Thank you,lsugumar.

392

2 months ago

simonlrContributor

asked in Data

DGN reader not reading all of the drawing.

HiI have a DGNv8 3D CAD drawing of a bridge i want to load into FME since i have been tasked with converting it to a different format.The issue is that not all parts of the bridge loads/reads properly, most notably the deck of the bridge is missing. Most of the bridge is drawn using smart solids.Here is the bridge in MicrostationHere is the bridge in FME. All i have done is add a reader and an inspector.And if u look at the feature information for those missing parts it says nan. I have attached the dgn file in a zip file. I hope some can help me or confirm that it is not possible in FME.Thanks for taking the time to read my question.

412

2 months ago

ienesaglam60Contributor

asked in Data

open kmz file error coordinates wgs84 latlon degree to decimal

I have a kmz file. There is a point in it. When I open the kml file with fme, the screenshot is attached where it converts the geographical latitude and longitude from degrees minutes to decimal. Additionally, degrees have been converted from minutes and seconds to decimals by Tubitak, the leading institution in Turkey. The screenshot is attached. Does anyone know the reason for the difference?

201

2 months ago

bkorsagerObserver

asked in Data

I need coordinates of intersection of two lines that intersect

I need the coordinates of the intersection, where lines cross the railroad geometry.With SpatialFilter/SpatialRelator I can isolate the lines (from a larger dataset than shown here). But I cannot identify the coordinates of the intersection.In the drawing the red dots are the points I need, they are handdrawn for explation.Any ideas as to what I could do?Thank you :)

Update sharepoint list

Hi FME fans, I am using the MS Sharepoint List writer to update values - this is using Feature Operation 'Update' using Row Selection 'sharepoint item id'.This works fine when I give it a new value, eg a different date, however if I set the value to null in FME the value in sharepoint doesnot change. How can I set the value to null?Thanks, Owen

mr_fmeEnthusiast

Hi,I have a dataset with 8 images. Look below at the images together: After using the Raster Mosaicker, the output is 1 image like this: What could I have done wrong in the transformer, or what else is necessary?Thanks.

512

2 months ago

lazarlubomirContributor

asked in Data

WORD (DOCX) TO PDF in FME ?

Hello everybody,I found many discussions about this topic, but, I just want to renew this discussion. Is there any way, how to convert word (docx) file to PDF format in FME, please?Thank You so much for all tips!Lubo

1928

2 months ago

bradContributor

asked in Data

Connecting to OS Downloads API via FME

Hello There, I’m hitting a brick walk with trying to get FME to talk to OS Downloads API, as anyone found any advice and guidance on this?

141

2 months ago

seanlegeerContributor

asked in Data

Trying to run a workbench in FME Server via Job Submitter and find the output.

Hello, we are trying to use our FME server to run all of our data conversion via the API. We have created a workbench and uploaded it. We set the service to Job Submitter. When we run it we can not see were the output was written to. The log indicates that job was run successfully but the log does not have any mention of an output location. We have tried to set the output File Geodatabase location to a network drive: “\\nos.noaa\MCD\FADS\FADS_Projects\FME_Workspace_Output\Weekly_Atons” and a local server drive: "F:\FME Server System share\repositories\Testing_Nate\ALL_USCG_Weely_Xmls_to_GDB\output\Weekly_Atons"Any help would be greatly appreciated

425

2 months ago

graysonContributor

asked in Data

copying values (ID) from intersecting line features to point features

Below you can see line and point features. Let's say each line segment has its own unique ID - in the example below, it will be from 1 to 6. I want to copy IDs from lines to poles that they intersect.According to my example, it would be:Point A: ID 1, 2, 3, 4Point B: ID 4, 5, 6 I have thousands of lines and points. What’s the best way to do it?Appreciate any help!

242

2 months ago

raaijennielsParticipant

asked in Data

Table missing in FME

Hi there, the table shown in the pdf image is missing in my data inspector. In some newer pdfs it does apppear. Can anyone help me '’expose'’ the tables. Also my attributes are only showing as format attributes. This makes it very difficult for me to turn my filtered data (.dwg file) Into an Excel. edit: I got it the table working by turning on all the parameters in my reader. I dont know which parameter did the trick…

211

2 months ago

youssefContributor

asked in Data

AIXM 5 geometry with XML-Templater

Hello Guys,i have an issue with bringing our geometry from a oracle 12C format in a AIXM gml format. Whatever i tried so far, the writer just refuses to write any geometry, while anything else seems to work just fine. The output was good enough to satisfy the AIXM validation but it is useless for us until i am able to write the geometry too. I am trieing to achieve that with the help from the XML-Templator and so far, this is how it looks:It looks fine to me, the coordinates are hard coded for testing and will later be replaced by a variable holding the coordinates for each object. But i would like to write any geometry in the first place before i think about that. I will provide my workspace and the gml i managed to generate with the hope that somebody can make out the issue at hand. Ty for reading this and every bit of help is appreciated!

301

2 months ago

neaContributor

asked in Data

Using dwgstyler to convert a point feature class to an autoCAD drawing with inserts

I’m trying to use the DwgStyler to convert a GIS, point feature class to an AutoCAD drawing with inserts and attributes.

212

2 months ago

aguanContributor

asked in Data

How to transform this json file to a table?

I have this json file (see the attached txt file) that I want to load into a table (shown as in the attached excel file). I have done many json conversions over the years, but this one puzzled me quite a bit and could not figure out a good way to do it. The difficult part is that for each asset Id, there could be a few years of emissions. Each emission has two emission type, n2o and co2. How can I capture each year and its emissions into rows based on the emission type to be pivoted? { "assets": [ { "Id": 25494428, "Emissions": [ { "2021": [ { "EmissionsFactor": 1, "EmissionsFactorUnits": "U1", "n2o": 10 }, { "EmissionsFactor": 2, "EmissionsFactorUnits": "U2", "co2": 100 } ] }, { "2022": [ { "EmissionsFactor": 3, "EmissionsFactorUnits": "U1", "n2o": 11

622

2 months ago

adam_timmonsObserver

asked in Data

Bentley Microstation Reader Not Showing Referenced Files

Note: we are primarily using FME Form version 2023.2.4.0 (build 23785), but have also tested this on 2024.0.1.0 (Build 24202) with similar results.We have received DGN files that are referencing models that are both internal and external to DGNs themselves. These external DGN files are located in the same directory folder as the file being read. We are interested in having the reader (Bentley MicroStation Design (V8)) read not just the primary DGN, but also the referenced models.In the parameters for the reader, we check the box for “Read Elements from Reference Files” and set the value for “Max Depth of Reference Files to Read” to something arbitrarily large like 20.Selected parameters, but have tried a variety of combinations of values with no difference in outcomes.Because we are interested in reading data from different files, the “Single Merged Feature Type” option is selected.When the reader is run, we see data from the primary DGN, but nothing from any other DGN that it it is re

501

2 months ago

gogopotter90Contributor

asked in Data

How to use Python script into FME ?

Hello , i have a Python script works good into Pycharm without problems , to do some tasks on excel file then i am using the new excel file output of Python as input in FME .i would like to use Python caller , to put the same script inside FME.how could I change the script to be compatible with Python caller ?which changes should I consider and think about it ?Thanks in advance

422

2 months ago

emerson_stylesContributor

asked in Data

How to add nodes on a line with point data

I’m doing a routing analysis and I have a road network that I need to create new nodes along where I have points for addresses. I used the AnchoredSnapper transformer to ensure that the points align with the line data. The point data (addresses) is a separate dataset from the line data (network). Does anyone know how to create new nodes along an existing line using point data?

332

2 months ago

fmelizardContributor

asked in Data

Proper use of the OSM reader?

I'm trying to load OpenStreetMap using FME. This works great with small datasets in 2012, however as soon as I start playing with large datasets (millions of features) I hit the problem that the FME OSM reader acts as a grouper - it reads the entire dataset in before it actually trys to translate everything. Does this have to happen? Is there a way to disable it or is this a limitation of the XML reader? It's massively slowing down everything because even with 32GB of RAM, FME is still filling it up and then writing to temp disk space (despite the original dataset only being about 7GB uncompressed). Using 2012 SP4 64bit. 2013 13206 is 5.5 times slower on the small dataset, so not using that despite changes in #13082 to make "it better with large datasets" - not sure what that means.

306

2 months ago

harmenContributor

asked in Data

User parameter: selecting table from file geodatabase

Within the User Parameters I have added the option to Select a File.More specific the user has the option to select a Geodatabase (Items to Select).When the user has selected the Geodatabase, I like to have the user also select the database of his/her own choice within that Geodatabase. Is there a way to configure that?

write a list of gdb feature classes to excel

Hi, I am a total novice with FME - will be going on some training soon, however I am trying to get familiar with the software prior to that. I have what I think is a very simple task but can't seem to figure it out. All I want to do is create an excel file with all of the feature classes contained in my geodatabase. My geodatabase (version 10.1 in ArcGIS) contains feature datasets - although I do not these listed in my excel output. Sorry for asking such a basic question - I am new to the knowledge areas/and community

17414

2 months ago

ed-progresContributor

asked in Data

Can FME read in data from Oracle SQL Views?

Hello,I was wondering if FME can read in data from Oracle SQL Views?If yes, great. How?

353

2 months ago

ricardoaContributor

asked in Data

Create polygons from a string of coordinates

Hi there!I want to create polygons from an attribute that contains a string of coordinates and other information. My problem is that I don't know how to only extract the coordinates from the string and then create the polygons by their ID attribute. The string in the coordinates attribute looks like this:“{"type":"Feature","properties":{},"geometry":{"type":"Polygon","coordinates":[[[13.707920553133594,60.03475791657763],[13.708950521395312,60.03304306231432],[13.705474378512012,60.03160680337132],[13.702513219759567,60.02997753853561],[13.702255727694139,60.030577803349054],[13.703929426119434,60.03184261136259],[13.706161024019824,60.032571461785544],[13.707920553133594,60.03475791657763]]]}}” ID attribute 1 to 10 Regards, Ricardo :)

836

2 months ago

ricardohhdParticipant

asked in Data

How do I keep the attributes from a DXF?

I have a DXF file that consists of multiple geometries and attributes. I want to convert this DXF file to a file geodatabase with multiple layers based on each geometry type in the DXF. The different layers also need to retain the same attributes as the DXF files. I attached the file as a zip to this post.I tried loading the DXF file in FME using the Autodesk Autocad DWG/DXF reader and splitting the geometries using a GeometryFilter. That worked fine. However, the attributes disappear when I read the DXF file in FME. Do you have any suggestions on how to retain the attributes of a DXF file when reading it in FME and converting it to a GDB? The data was gathered with a Leica gs18T in case that helps.

181

2 months ago

Page 5 / 273

Badge winners

kenortey8has earned the badge Teacher (Grey)
edwardhas earned the badge Integrate Data with the FME Platform Training
kailinatsafehas earned the badge Enchanted by Attributes
gazmanhas earned the badge Welcome Back
miguelhacarhas earned the badge Spanish Speaker

Show all badges

30,351: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.