Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 6,779 Posts
  • 24,922 Replies
6779 Posts
L
lorans9
asked in Data
dynamic writer for shapefile ZM

I am using a dynamic writer to generate shapefiles. It is almost working fine except the geometries (Points, Lines and Polygons) are always generated with Z and M... even if the input (also over a dynamic reader) has no Z and M.Any Idea how to solve this problem?? (Using FME Desktop 2015.0 Build 15253)

142
takashi
Contributor
8 years ago
O
olivier57
asked in Data
Dxf => Postgis : Store Layer Properties on Features not working ?

Hi,I'm trying to convert a dxf file to postgis using group by attribute schema. This works fine but if I "select Store Layer Properties on Features", I do not get new columns describing autocad_layer_linetype, autocad_layer_color, and autocad_layer_lineweight as I expected.Why ? I'm using FME Desktop 2016.1.0.0 (20160419 - Build 16492 win32) on x64.Thanks,Olivier"If you select this option, the AutoCAD Reader will add additional attributes describing the layer properties for the layer of each feature. These include autocad_layer_linetype, autocad_layer_color, and autocad_layer_lineweight."

82
nielsgerrits
VIP
8 years ago
A
Anonymous
asked in Data
Set KML Balloon Width

I have a KML file with lots of text in the attributes, and the balloon puts this text onto multiple lines. In KML you can set the width of the table in the description tag to make the balloon wider, like this:<table width='300px'>Is it possible to do this with FME?

555
arnold_bijlsma
Enthusiast
8 years ago
M
michael_m
asked in Data
How to combine attributes when there is nothing to join on

Hello,I am working to pull information from autocad block attributes and need help overcoming a problem. Currently, each block's attributes have their own record in the table I am writing them to (they are organized this way straight out of the DWG reader). Looks like this:Attribute1Attribute2Attribute3<Null>AB<Null>CDE<Null><Null>What I want to do is combine the records somehow so the table looks like this:Attribute1Attribute2Attribute3EABECDAny ideas how I can do this? I have tried FeatureMerger and InlineQuerier but have had no luck because there is nothing to join on. Thanks,Mike*EDIT*Initially in the DWG reader I was Grouping Entities by Attribute Schema. I just tried grouping them by Layer and got the same results.

114
M
8 years ago
M
mahendra30627
asked in Data
How to perform Update operations on smallword features by using FME workbench.

Hi All,I want to perform Insert and Update operations in smallword by using FME workbench.I want to update the existing cable features with new values.About Datasets:I am performing update operation on Cambridge database in network data cable feature. I want to update existing cable data based on cable id. The updated data values are available in Excel format. How can I perform update operation based on excel values using FME workbench.Now I want to update “914668, 914698, 914712, 914748”id Known As values as below.I am facing problems in creating workbench in FME. I need to know the clear process for creating fme workbench for Update operation in Smallworld data.What are my possible solutions?Thanks in advance for your help.

113
M
8 years ago
P
phatnine
asked in Data
Problem with workspace runner and excel files

Hi guys,I need to write about 30 excel files (xlsm) into a sql server database. Each excel files has the same structure, but have different data inside.I have a workspace that reads the excel file and write data int othe database, without any problem. I tried running a workspace runner to run the 30 excel files. The problem is that it only writes NULL value data. It writes the good amount of entries, but each attribute is NULL.I have FME desktop 2015.1, and SQL Server 2014.Thanks,maxime

52
P
8 years ago
boubcher
Contributor
boubcherContributor
asked in Data
Extract color code from an excel file of certain column

Hello Guys ,We do have a large number of excel we are moving to GIS , but certain column are colored and we want to extract this value and add it as an attribute to output. in order to do some analysis Thanks

193
roland.martin
8 years ago
K
kat
asked in Data
data extraction from excel file

Hello, Once a week we receive an excel file. You can see on the attached image how the excel file looks like when you open it with FME Inspector. I would like to create two new tables: one for the new units (row 6 till 9) and one for the new cells (row 14 till 23) including the headers (unit, unit title, south limit etc). How can I extract these rows using FME? The structure is the same every week (new units, then new cells) but the number of rows is variable.

1193
K
8 years ago
J
jillacklamcorp
asked in Data
Update Google Calendar / access spreadsheet add-ons

Here is what I am trying to do: When someone puts a file in a certain folder, I want a notification on my Google Calendar on the day the file was put there. I guess my first question would be, Is there a way to add things to Google Calendar?My second question would be, assuming there is not a way to access the Calendar: I am able to create a spreadsheet in Google Docs. Then there is an add-on "From Sheets to Calendar" that will take the information from the spreadsheet and add it to the calendar. Is there a way for FME to access and run that Add-On?

63
mark2atsafe
Safer
8 years ago
A
adriancoelho
asked in Data
FME 2015- Translation reports a success but no records to be found

On writing data using the ArcSDE 10.1 Geodatabase writer in FME 2015 to an existing featureclass ( ArcGIS 10.0 client), the translation reports a success but no records can be found in A or base tables. I then delete the spatial index for the featureclass and then load and this time it works. My questions are: a) Why does the above happen without a good notification? b) What are the best practices for loading- delete spatial index, load and the rebuild?

442
A
8 years ago
K
kouri1986
asked in Data
creating attributes from HSTORE field from postgres database

I am reading in a postgis table with a hstore column. I want to create attributes from all the fields inside of it. What is the best way. Since I need the spatial index I was under impression I needed to read in with postgis reader. My python is not great so hoping it can be done without using python.Any help would be great.

334
takashi
Contributor
8 years ago
A
amgaad
asked in Data
FME Sql reader help

Hi, I am new to FME, just learning bits and bobs as I go.I am trying to connect an sql reader to a non spatial sql server.No matter what I fill in for the connection it fails. The sql server is on a another pc which is part of a domain. For the server field of reader should I be writing an ip address or domain name or pc name too?Any guidance would be appreciated.

91
C
8 years ago
ngoorman
Contributor
ngoormanContributor
asked in Data
FME doesn't read the same GDB feature class twice - intended behaviour or bug?

Today I noticed something about reading the same geodatabase feature class twice, using multiple feature types within the same reader. FME doesn't do this.I had one single merged feature type set up, to process all data within the geodatabase. This was the only reader in the workspace. At some point I needed one specific feature class from the geodatabase for a specific function, so I used the "Import feature type" function to do it. From there on, that feature class would no longer be output through the single merged reader, but only through the separate one. Suddenly my workspace was no longer outputting all data from my geodatabase, since the separate feature class was discarded halfway through the workspace. However, there was nothing that indicated that this was going on - looking at the properties of my single merged feature type, it still claimed to read all feature classes. Disabling the separate feature type did not affect the single merged feature type - it stil

92
takashi
Contributor
8 years ago
G
gary
asked in Data
Correct WHERE Clause for Geodatabase Reader

I'm attempting to limit the number of records being read on multiple file geodatabases by setting the WHERE Clause parameter to yesterday's date:    Edit_date BETWEEN SUBDATE(CURDATE(),1) AND CURDATE()     "Edit Date" is Field Name and the Data type is Date.  I've tested a few different SQL statements, but can't seem to get the right combination? Is this the right approach or is there a better way?  Gary

2105
arnold_bijlsma
Enthusiast
8 years ago
M
mahendra30627
asked in Data
How to read smallworld data by using FME workbench?

Hi All,I want to see smallworld data in FME workbench using FME reader. Actually i tried the process same as Shape file but it displays Errors.

192
mark2atsafe
Safer
8 years ago
A
andreparviainen
asked in Data
Bug in FMEServerEmailGenerator (attatchments)

Hi,There seems to be a bug in the FMEServerEmailGenerator transformer. I had some issues in FME 2015 and hoped it would be fixed in the newer realeses in 2016.However when I recently updated to the present realese (2016 b16492) the problem still remains.When attatching a file, or several, the JSON messege that builds from the transforemer add the attatchmet twice in the text_line_data output. Therefore the Email won't be sent to the receiver.I have used a workaround with StringReplacers to get rid off one of the attatchments and made it work like it should. The problem is that I have to customize it every time I want to use a different massage or attribute to post. So it would be great to have this bug fixed in a new patch in the future. Thanks in advanceAndré

63
rylanatsafe
Safer
8 years ago
warren156
warren156
asked in Data
Read KML from Url - Failed to decompress

Hi There,I'm hoping someone can give me a hand with this problem. I've recently attempted to read a kml file from a url and bring it into my workbench.However, whenever I attempt to read it in FME 2016.1 claims there was an error and says: "Dailed to decompress to 'temp path location... - Failed to initialize the reader'. I've attempted to download the kml file and read it into my workspace from a file path and it works fine. Does anyone have a thought as to how I could fix this???Thanks,Warren

192
warren156
8 years ago
K
kevwin
asked in Data
How to shorten attribute names?

I am trying to read from an Esri SDE and write to a shapefile, but the length of the attribute names are causing problems for the writer. I've tried using AttributeRenamer to manually make all the attribute names under 10 characters, but is there any other way to address this problem? I'm using FME 2014.

1112
ebygomm
Contributor
8 years ago
A
avanham
asked in Data
reading description attribute from kml-file

Hello all,This question has been asked before, but despite an example found here i still can't manage to get the description-attribute from the following kml-file: . Somehow FME sees the values for the kml_description (and kml_description_raw_text and kml_description_text) attribute as missing. I know for sure there is a description as i see it when opening the kml-file in Notepad++. What i do see, when sending the data to an inspector is three attributes:- kml_description_b (with Value Onderwerp:)- kml_description_b{1} (with Value Status:)- kml_description_b{2} (with Value Nummer:)So the field name has become a value and the original value is lost.I hope someone can help me with this. I've also been trying this with the Esri ArcGIS tool 'KML to layer'. Then i do get the description in a feature class, but somehow all locations are placed at the same coordinate.Greetings,Antoon van HamCity of Eindhoven, Netherlands

783
A
8 years ago
D
drakez
asked in Data
SQL Statement to Execute after translation problem

Hello,since updating to 2016.1 I have a problem with my sql statements to execute after translation. I need to update sequence values, because I am manually inserting data into serial column. However I am getting following error:Error executing SQL command ('select setval('$(Schema).unip_property_attributes_id_seq', (select max(id) from $(Schema).unip_property_attributes))'): 'ERROR:  syntax error at or near "$"LINE 1: ...property_attributes_id_seq', (select max(id) from $(Schema)....                                                             ^'PostgreSQL Writer: SQL statement To Execute After Translation failed; see above for detailswhere unip_property_attributes_id_seq is the name of the sequence I am trying to modify (set value) and $(Schema) is a published parameter where the name of the schema is stored. Seems like after updating to 2016.1 there is some problem with addressing published parameters in sql commands after translation, because $(Schema) parameter used in sql executor

100
D
8 years ago
M
murray901
asked in Data
SDE_ERROR_CODE(-25) Insufficient permissions

SDE_ERROR_CODE(-25) Insufficient permissions

92
redgeographics
Celebrity
8 years ago
J
jillh
asked in Data
Start row parameter

I'm a new FME user, so any help would be greatly appreciated. I'm using FME 2014. I have a workbench with just a reader and a writer. The reader is set to start reading at row 2. This works great until I save the workbench and go back in, and then it seems to reset to start reading at row 1. This has happened twice so I don't think it's just me? Can you point me in the right direction? Thanks!

73
J
8 years ago
J
jodell
asked in Data
How to increase Placemark Size of KMZ conversion to Microstation V7 DGN

Hi Folks,New user here so I appreciate your feedback (and understanding). I am working with a KMZ and while I am able to write it to a MicrostationV7 format, it falls in the right place but I am only getting a simple line style as my only feature in place of the Placemarks. I would like to give them style and weight as they are so tiny I can barely see them in my map. Is this possible? Or am I looking at having to work in Microstation to "amp up" the symbology (points and lines).Thank you for your feedback! Enjoy your day.

41
mark2atsafe
Safer
8 years ago
dos_gis
Contributor
dos_gisContributor
asked in Data
Adding Description & Properties to AGOL feature

Is it possible to set the ArcGIS Online properties (Description, Access & Use, Properties) when uploading a feature?

41
bruceharold
Contributor
8 years ago
E
edttom
asked in Data
How to translate Access select query to FME?

Hi all,I'm trying to translate an Access select query to a FME script. I have two Excel files in Access: one that contains data (LINC_RawData) and a comparison file (Linc_Recoding_Scheme)Below select Access query shows records that have a value in the "Category" field and that do not have a value in the "UID" filed.How can I translate this to FME? Basically, all data should flow through to a writer except when it matches above query, I'd like it to appear in a separate output (or list / filter)Thanks,Ed

212
E
8 years ago

Badge winners

Show all badges
30,106
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.