- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,700 Posts
24,697 Replies

When you subscribe we will email you when there is a new topic in this category

6700 Posts

Recently active

Most replies Most views Newest first

sibghat

asked in Data

Excel to GIS format using FME changes column names at each run?

In below image if my excel sheet name is January then all the Fields of Januray joins with writer field "Previous reading","Current reading" etc.If my sheet name is February then all the fields of February joins with with writer field "Previous reading","Current reading" etc.I want a single Fme tool to just read from excel sheet name if its January then all the fields of Jan goes to relative field.If my sheet name is March then all the cloumns of March goes to the specific field.

8 years ago

marion

asked in Data

CSV reader with ftp path randomly fails

Hello all, I have a problem with CSV reader with FTP path in FME Desktop / FME server 2015.1. My goal is to watch an FTP server for new files, when a new file comes in, test the name for today’s date and the extension for .csv, do some manipulation to that file and put the data in a database. Once it is done, I want to trigger a job on the database. As for now, I have a watcher on my FTP server which triggers a workbench that tests the name of the file and launch another workbench with an fmeServer_JobSubmitter. This workbench has a csv reader that takes the FTP path of the file and reads the file. It does the manipulations and put the result in the database. Then, the original workbench triggers the job on the database. I have around 150 files to load every morning and it works for around 140-145 of them every time, but there are a few files that don’t work for a mysterious reason. For the files that didn’t work, I tried the use the same JSON received by the watcher in the “test t

8 years ago

joeli

asked in Data

Microstation to Sketchup - Origin

Hi, I have a Microstation file in which I am writing to Sketchup. The initial translation from microstation to sketchup works but when I open my sketchup file, the model is placed very far from the origin. Is there anyway that I can move model to the origin?

8 years ago

me1

asked in Data

Boundary and geometryname

Hi everyone, Is it possible to change geometry names for a boundary too? I used the GeometryPropertySetter to set the GeometryName and Traits (see pic below), but it also changes the geometry name for the Boundary IFMELine. I want to set the name for the boundary to curveMember (see Example 2nd pic). The Problem is, that FME is creating a LinearRing for an ElevatedSurface, but i need an GeodesicString. I hope that the geometryname will help me with that. My geometry: It should look similar to this: thanks, Mel

8 years ago

dkar

asked in Data

Transform a 2D autocad file (dwg) to CityGML

Hello, I am trying to create a workflow in order to transform a dwg to a cityGML file and later to import it into a 3D citygml database. I have tried to find an example online doing something similar but I had no luck. I wanted to ask if something like this is possible with FME and if there is an available example to get a first impression of how to implement it. Thanks. Dimitris

8 years ago

olivierContributor

asked in Data

Uploading a file geodatabase to FME Server from the web interface

A user is supposed to use FME Server's web interface for running a FME workspace that has been published on it. That FME workspace takes a file geodatabase as input. The user should upload his/her file geodatabase at runtime in the web interface for that workspace. The problem is that the browser will not let the user select the folder defining the file geodatabase. Furthermore selecting all subfiles of that geodatabase will lead to a failed run. What is it that I am overlooking? Thanks in advance!

8 years ago

apence231

asked in Data

Error with ODBC connection on FME Server

I have an ODBC connection to a table that geocodes addresses and writes it to an ESRI ArcSDE feature class. When I run my workspace on my desktop everything works fine, as soon as I upload it to my FME Server I get this error: Database Error Message: [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified It's a System DNS connection and I checked all the drivers and 32bit connections and everything is good. So not sure what is causing it not to work on the FME Server. Thanks!

8 years ago

jubert

asked in Data

Split the table multiple tables

Hi, Say I have a massive table (+15million lines) with multiple columns , it has a Field called "category"..the category Field has multiple data values in it. how do i split the table based on the field category? say the field has 150 categories in it..therefore I need to have 150 tables. so if the input is 1 csv file.. the output required is 150 csv files separated per category. I think this could be a test filter with so many filters in it. thanks in advance. kind regards, Jubert

Hi, I create a MapInfo to CSV just to get a feel of how to use FME WorkspaceRunner, I tried to imitate the example: https://knowledge.safe.com/articles/Samples_and_Demos/WorkspaceRunner#toc1 which was provided in the Documentation however I am quite wondering how it works. I have 30 mapinfo files (on my target application could be 20k++ files) so when I run the normal mapinfo to csv it goes normally as below: however, when I run using the workspace runner, I get 4 times the number of files i had previously. why is this so? thanks in Advance. kind regards, Jubert

8 years ago

jimoParticipant

asked in Data

Unicode conversion error

I am reading from a shapefile into a Python caller and get this error message: Attribute value of 'DESCRIPT' could not be converted to Unicode using attribute's encoding of 'utf-8' This error occurs at this line: feature.getAttribute("DESCRIPT")).strip() I have used the Python shapefile module in a standalone Python script to isolate the offending character. It is the hyphen in this string: 200 Block of W Georgia - In my standalone Python script I can convert the hyphen by converting from its Unicode number to a Window hyphen, like this: 0x96:'-' However, the exception is raised in the FME Python Caller in the line above before it gets to my conversion function. This happens with FME 2015, not FME 2011. Is there any workaround? Thanks

8 years ago

keelan_shelton

asked in Data

Modelling Cuboids on vertices

Hi guys, I am currently creating a 3D model for a drainage run, As they tend to be quite simple, I am using FME to do it. I have all of he information saved in .csv files (Manhole Co-ordinates, Manhole Cover Levels, Pipe Levels, Pipe Diameters etc.) Now, I have modelled the pipes just fine by using a point connector to connect the manholes with the same pipe attricute and then 3d buffering the line by the radius of the pipe, but, the manholes are a different question, as they are being modelled as Cuboids. With the cover level being the top face, and the bottom of the pit being the bottom face. In this site we have basically a different chamber depth for every manhole, and about 10 different cover sizes, so, inserting 3D Cuboid Cells/Blocks is out of the question. The only way I can get this to work is to offset vertices from the centre of the manhole cover, connect the lines using a point connector, and then extrude them to become the faces of the cuboid and aggregate them. Of course

8 years ago

zzupljaninContributor

asked in Data

line to mesh

Hello, is there a way to convert polygonal entity (geometry) into a surface or mesh or face? thank you

8 years ago

jorge_vidinhaContributor

asked in Data

Postgresql/Postgis control order of reading feature types

How one can control the order of reading of multiple feature types in one PostgreSQL/Postgis reader so you take advantage of Supliers first , Areas first , Candidates first and so on First ??

9 years ago

aleksandar

asked in Data

Text encoding/decoding

Hi all, If I have GML file (utf-8 encoding) with (e.g.) LATIN SMALL LETTER C WITH ACUTE which I want to insert into SQL Server table with SQL_Latin1_General_CP1_CI_AS collation, and want to be able to export that (imported) value from table to gml file, what should I do? I tried text encoders/decoders, but without success.

9 years ago

roxana

asked in Data

oracle spatial relational connection

Hi! I'm trying to add an Interoperability Connection to an Oracle database(Oracle Locator) using Oracle Spatial Relational Format and I get this error:Error connecting to Oracle database: message was `ORA-01017: invalid username/password; logon denied'. (serverType=`ORACLE8', serverName=`instance/database', userName=`user', password=`***', dbname=`') Otherwise, if I choose Oracle Spatial format, I manage to connect with the same user and password but the data I retreive is incomplete. Does anyone encountered this problem?There is something that I'm missing? Thank you! R

9 years ago

aquamarine

asked in Data

Convert DGN curve to points

Hi, I have a Microstation V8 DGN file with Curves. I want to convert these curves to points but maintain the same number and position of the vertices as they are in Microstation. When I use the "Chopper" transformer with number of vertices set to 1 (since I want points) it seems to create a lot more points than there are vertices in the original file. Any ideas? Thanks,

9 years ago

davideagleContributor

asked in Data

Write GML to multiple ZIP files

Hi there Community, I'm trying to fanout GML files into multiple ZIP files, where the GML file always has the same name but the ZIP file name is controlled by an attribute. So I want: test.gml\\North.zip test.gml\\South.zip test.gml\\East.zip test.gml\\West.zip It appears that the fanout dataset capability doesn't allow me to do this and I can only create many differently named GML files in the same ZIP. Does anyone know a way around this? Thanks in advance, Dave

9 years ago

aleksandar

asked in Data

Schema based GML Writer

Hi all, At the moment, I have workspace using XMLTemplater to make desired GML, and after that sending it to text writer to write a file. I saw that there is GML writer that supports user specified schemas. Does someone has an workbench example using this writer? I want to read data from SQL Server Non-Spatial stored procedures and, after transforming them, write them into GML file. Thanks!

9 years ago

fmelizardContributor

asked in Data

Changing the font type in MSWord docx

Hi All, I was wondering if anybody has any experience with changing the font type in the example ws (https://knowledge.safe.com/articles/Samples_and_Demos/Write-Microsoft-Word-docx-with-FME) When examining the result docx I can see different font types created, but cant find how to set/change them. Any help would be appreciated. Itay

9 years ago

aleksandar

asked in Data

Column's default values when inserting row in SQL Server

Hi people, me again, Why FME's SQL Server Non-Spatial Writer does't see column's default contraints? My table has column that is neither unique nor primary nor nillable, but has default constraint. In my workflow I'm not specifying any value (in some cases) to that columns, because I intend to use that default value. Thing is that FME doesn't write any row to that table because of missing value. What is going on?

9 years ago

max

asked in Data

Converting shape file to xml file

Hi, I have a spatial dataset as shape file (.shp) and need to convert it into an XML file. Can we do that in FME?

9 years ago

mapperContributor

asked in Data

reading sde table with archiving enabled

I am having trouble reading data from a sde table with versioning enabled. Since archiving has been enabled the data I want is in a view. I can see the view in the table list but the reader fails to be created I get the error "Error while retrieving layer info structure for layer 'shape' in table 'ACCESS_BRIDGE_PT_EVW'.:SDE_ERROR_CODE(-20) Layer not found". I thought I might be able to create a reader for the base table and filter based on the esri managed field gdb_to_date. But that field is not exposed in the workbench. Anyone have experience reading data from sde with archiving enabled? My sde is using postgresql/postgis as the backend DB

9 years ago

me1

asked in Data

Geodesic Geometry Writer

Hi all, Is there a possibilty to write geodesic Data to an AIXM Writer? Now I use the GeometryPropertySetter Transformer, but it creates a LinearRing instead of a GeodesicString. I found an entry in the fme wiki about geometry builders: xml-geodesic-string (http://docs.safe.com/fme/2013/html/FME_ReadersWriters/Default.htm#xml/xml_geodesic_string.htm): is non-composite builder that interpolates a sequence of geodesic control points into a line geometry. (Built-In Geometry Builder (http://docs.safe.com/fme/html/FME_ReadersWriters/FME_Readers_Writers.htm#xml/built_in_geometry_builde.htm%3FTocPath%3DFME%2520Readers%2520and%2520Writers%7CXML%2520%28Extensible%2520Markup%2520Language%29%2520Reader%252FWriter%7CxfMap%7CFeature%2520Mapping%2520Rules%7CBuilt-in%2520Geometry%2520Builders%7C_____0" target="_blank)) But I don't get how to activate the geodesic geometry builder. Thanks, Mel

9 years ago

blix

asked in Data

Text above attributes in excel and csv files

Hello! I was wondering if it's possible to create a standard text above the different attributes in excel or csv files? Here's an example of how it should look like. Two rows is standard and the attribute names will start at row four. Thank you!

9 years ago

longhornfan

asked in Data

Delete records from a geodatabase based on County from an incoming shapefile (NOT TRUNCATE) then load the shapefile

Good morning, I have lease shapefiles we receive from a company (numerous leases for each county). So for example if I have 3 counties already in an existing geodatabase, those counties for this example are named Harris County, Thomas County, and Johnson County. If the shapefile the company has provided has Johnson and Thomas counties (No Harris County data), I will want to delete all records with Johnson County and Thomas County from the existing geodatabase ... and replace them with the Johnson and Thomas County data from the shapefile. But here's the kicker, I want to keep all existing Harris County leases in the geodatabase. A truncate will not work because I want those existing Harris County leases. Here's what would happen in a perfect world. Again this is just me dreaming and I'm asking all of you if this dream can be a reality. Step 1: Get a list of what counties are in the incoming shapefile (Johnson and Thomas) Step 2: Delete all records in the geodatabase tha

9 years ago

Page 229 / 268

Badge winners

paulmcm601has earned the badge Student (Grey)
paulmcm601has earned the badge Welcome Back
marcosfmehas earned the badge Welcome Back
a-a-ronhas earned the badge Teacher (Grey)
bwnhas earned the badge I Get a Buzz From Geodatabase

Show all badges

29,707: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.