Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 6,779 Posts
  • 24,922 Replies
6779 Posts
g_karssenberg
Contributor
g_karssenbergContributor
asked in Data
SchemaMapper/Reader issue loading Excel sheet with attribute names similar to FME format attributes

I may have encountered an issue with reading Excel sheets with attribute names that start with parts of existing FME format attribute names.My first experience with this was while using the SchemaMapper transformer, but when I investigated the Excel reader, I noticed similar behaviourThe attribute names I wanted to use were:fme_geometry_namefme_type_nameIf a sheet with these attribute names is loaded into the SchemaMapper transformer or the Excel reader, I notice the following behaviour:SchemaMapper Dataset can be loaded and Parameter window works as expected. When clicking Next, a popup with 'Reading Dataset' appears and disappears very quickly. I am not able to finish the SchemaMapper wizard.Excel Reader Dataset can be loaded, but after completing the Add Reader wizard, the FeatureType object on the canvas does not contain the added attributes.When repeating the process with the following attribute names, everything behaves as expected:geometry_name_fmetype_name_fmeMy impress

203
g_karssenberg
Contributor
6 years ago
S
sega
asked in Data
Adding kml from FME-Cloud /Resources/Data to AGOL

Hi gents and ladies,I'm trying to move my GIS in cloud:) unfortunately I didn't find the information about how can I add files stored on FME-Cloud to AGOL.F.e. I have the Vessels.kml file in Data folder on FME-Cloud/Resources and I want to add this file to AGOL. Is it possible or not?Thanks in advance.

56
bruceharold
Contributor
6 years ago
E
emmythammasine
asked in Data
FME Exporter for Revit 2017

When will an exporter plugin be available for Revit 2017? We here at the Denver International Airport have upgraded to Revit 2017 and updated our models. We currently are taksed with exporting our facility models from Revit to ArcGIS...

238
M
6 years ago
P
pfetob
asked in Data
Error when recreating GeoJSON from attribute

HiI'm new to JSON and GeoJSON, but I have some text for a geometry generated by Mapbox coded as GeoJSON:"{"type":"FeatureCollection","features":[{"id":"c2fc8b172269fb5b220d5661e804a7e5","type":"Feature","properties":{},"geometry":{"coordinates":[[[5.7289984618329015,58.97117391031097],[5.727435803187348,58.97244926566199],[5.725808033947516,58.97459712581869],[5.728542686566385,58.97520118738589],[5.729714680561443,58.974630685071816],[5.728868240463584,58.973858813964995],[5.728314798897173,58.9731876075123],[5.729193794339011,58.972449265591706],[5.730040234436871,58.971274597908206],[5.7289984618329015,58.97117391031097]]],"type":"Polygon"}}]}"In my workspace I have added a creator with an attribute containing this text. I the add a Geometry-replacer and choose GeoJSON. Upon running the workspace I get syntax errors.JSONFragmenter(JSONQueryFactory): A

465
B
6 years ago
philippeb
Enthusiast
philippebEnthusiast
asked in Data
Run FME Server process automatically after it fails

Hi,We have FME Server 2017.1 with lots of scheduled tasks and sometimes, for several reasons, some of them fails.Do you know if it's possible to tell FME Server to run the process (for some workbench only) a second time if the first time it failed?Exemple : I have a scheduled task supposed to run at midnight but for a reason it fails. FME could try to run automatically an hour later the same process with success, or not. If not, it could stop there, or try an hour later a third time or indefinitely, until it succeed.So, is that possible or I'm dreaming?

181
david_r
Influencer
6 years ago
A
aarcra
asked in Data
When will the File GDB Open API be able to...

Hi,When will the File GDB open API be able to read and write a File Geodatabase without completely locking down the database? We find that only one bench can be in a File Geodatabase when using the OPEN API reader and writer, else we will start getting failures.When using the ESRI GDB reader/writer, you can have as many operations occurring simultaneously as you want in a File GDB, as long as no one is trying to drop and create a table that is currently in use.When will the OPEN API be able to do the same?Thanks!

41
geosander
6 years ago
A
ajayj80
asked in Data
Will the IFCGUID value differs for a building model entity say IFCProject for LOD200 and LOD300?

Will the IFCGUID value differs for a building model entity say IFCProject for LOD200 and LOD300?

10
A
6 years ago
C
cng
asked in Data
Arc SDE Connetion issue for Sql server

hi , i am getting below error while connecting SQL Server from FME desktop ,  Making a direct connection using instance 'sde:sqlserver' and userId = 'username' Error connecting to instance 'sde:sqlserver' for database 'sde' on server '!not_used!' for user 'eifme'.:SDE_ERROR_CODE(-324) Cannot connect to database because the database client software failed to load.  Be sure the database client software is installed and configured correctly.. Error connecting to instance 'sde:sqlserver' for database 'sde' on server '!not_used!' for user 'eifme'.:SDE_ERROR_CODE(-92) Bad connection handle  Currently using Arcgis 10.2.1   any idea...

994
C
6 years ago
D
david_prosack88
asked in Data
IFC File Path/IFC file name

Hey all,I have a Revit file and I'm using the IFC reader to translate my data. Is there an attribute or way to call the file path of the IFC reader that contains the data? In CAD or SHP I can use an attribute that contains the path. However, with IFC data, it appears that attribute is blank. What I really want is the name of the IFC/Revit file. I tried using some of the FME parameters, but the path remains the same when the Revit file is replaced with a different Revit file. Any advice would be appreciated! Thanks!

322
D
6 years ago
I
is
asked in Data
How to modify text attributes from SHP

Hello,I have text attributes of dimensions - such as 500/90 , 800/460, 30/90 etc. In a result I need to get the largest dimension value and delete the rest. For example - get the value 800 (and delete /460) or get 90 (and delete 30/ ).Any ideas, how to manage this?

56
I
6 years ago
A
afme
asked in Data
merge (.tif) image into one GeoTIFF

I have 10 image in a (.tif) format without coordinate system. I would like to get the same result in the link below, that is, in my case, a final output to the 10 images merged into one GeoTIFF file.https://knowledge.safe.com/articles/22971/basic-raster-mosaicking.htmlWhen I had add the reader, I have select the multiple images, but the images overlap each other in the same position. How can I solve this and then get the final output?

1949
A
6 years ago
R
raymondwalsah
asked in Data
FME and Map 3d 2018

I'm using Map 3D 2018 64 bit and a trial version of FME 2017.1.0 64 bit.However I cannot get FME to load into the data connector in Map 3D. I have used the integration console to enable FME.I'm trying to translate Mapinfo TAB files into Map 3D including the object data from MApInfo

112
jneujens
6 years ago
E
egaru
asked in Data
AGOL reader: Change feature service

Hi!I have a question regarding ArcGIS Online Readers in FME (2017.1.2). I set up a connection to an existing feature service and created the feature types of the reader. After that, the name of the service (but not its schema or configuration) was changed through the AGOL web site. Since FME cannot find the source anymore, I wanted to change the value of the parameter 'Feature Service'. However, this does not seem to be possible. Neither through published parameters nor the Navigator entry itself.Or there a specific reason for that? Or might it be a bug? What I would expect is the same behaviour as e.g. for a File GDB (change path / change path and update feature types if schema has changed).Greetings, André

73
E
6 years ago
G
gtissington
asked in Data
Convert Polar Coords in NetCDF

Hi, I am pretty new to FME and trying to get my head around the new NetCDF sSupport.I have a NetCDF 4 file with two raster bands: MEAN_WIND (magnitude) and MEAN_WIND_DIR (radians). I need to convert this to two new raster bands U and V. I.e. a vector equivalent to the input bands.The math is like this:mean_uwave = Math.Cos( mean_wave_dir * 2 * Math.PI / 360.0 ); mean_vwave = Math.Sos( mean_wave_dir * 2 * Math.PI / 360.0 ); But how would I apply this calculation to NetCDF files?Thanks.Garth

72
G
6 years ago
R
robertdbuckley
asked in Data
How to edit pointclouds?

I have "dirty" lidar data containing first and last returns and also errors under and over the surface level. (Screenshot)What would be a good workflow to clean this data? Is there a full automated method or would I somehow be deleting manually?

82
R
6 years ago
fmeuser_gc
Contributor
fmeuser_gcContributor
asked in Data
Sql server to netezza write

I have a workspace which writes geometry features from SDE SQL to Netezza. Most of the time the workspace fails for certain features. But the same workspace goes through if I use the Attribute filter and run those specific features which caused to fail.Any idea for this behavior please?Thanks

00
fmeuser_gc
Contributor
6 years ago
P
patoche94
asked in Data
XML Filter with several WFS feature types

Hi everyone, I'm trying to read WFS Datas. In order to have a smaller flow, I use a XML Filter. If I read just one Feature Type, it is OK, I get all its features.But I just ask for two Feature Type, I get no features and the following message :Here is the XML Filter I use :<Filter xmlns="http://www.opengis.net/fes/2.0"><PropertyIsEqualTo><ValueReference>WM_VERSION</ValueReference><Literal>0</Literal></PropertyIsEqualTo></Filter>Is there something wrong with it ?I could get a WFS Reader with its XML Filter per Feature Type, but it will be boring ;o)Many thanks if you can help me !

140
P
6 years ago
T
toasthall
asked in Data
Adding 3 consecutive records

Hi,We 100+ years of rainfall data that we would like to find 3 consecutive days where the rainfall is greater than 50mm after a certain date. I can do this in Excel but I can't for the life of my figure out how to do it in FME. Does anyone know if it is possible?In excel adding three consectutive days rainfall is pretty simple =SUM(F2:F4) and fill down the column.Cheers,Dale

124
fmelizard
Contributor
6 years ago
J
josephjones
asked in Data
LiDAR processing workflow DEM, DSM, DTM onto 3d KML surface

I was wondering what workflows people use with FME workbench to take a classified point cloud and transform it into a DEM with contours, DSM, and DTM.I'm working with a dataset that has around 30Million points with low,med,and high vegetation. This objective is to take all the vegetation, transmission line, and transmission tower and display it as a 3D surface onto Google Earth.

171
fmelizard
Contributor
6 years ago
A
akheirabadi
asked in Data
Scheme(Anyformat) cannot read WFS structure

Hi,I want to use Scheme(Anyformat) for reading WFS structure, it is working fine for excel, csv,shapefile, FileGeodatabase and even ESRI FeatureService but not WFS.I want to use generic reader, so I have to use this reader for all of them and I know FeatureReader can read WFS without issue.Has anyone had this problem ? Any solution ?Regards 

85
deanatsafe
Safer
6 years ago
S
sivag75
asked in Data
Geodatabase_SDE reader issue in web service application

Hi,I am using FME 2015 version.I am developing a web service application to read data from ArcSDE database using 'GEODATABASE_SDE' reader. While reading the feature from the reader, it throws an exception as 'No definition was found for coordinate system 'ESRI(ESRI)'. The log file information is shown in the attached image: But, I tested the same code in windows forms application and it is working fine. It finds the matching projection and read the data successfully. Its log file information is shown in the attached image: Kindly clarify how to resolve this issue. Thanks  Sivakumar

73
pratap
Contributor
6 years ago
A
Anonymous
asked in Data
PowerPoint Writer and Transformers Documentation

I was interested to see the new PowerPoint writer and transformer for FME 2018, but I cannot find any documentation on these items. Is there any?

63
debbiatsafe
Safer
6 years ago
owen
owen
asked in Data
read dgn mesh objects

Hello,   Does anyone know how to read mesh objects from a dgn? I need to create solids from these features, but the meshes all seem to come in as 2d lines, nowhere near the rest of the 3d lines where they should be extruded.  Would be grateful for any assistance with this!  Thanks,   Owen

225
fmelizard
Contributor
6 years ago
pflegpet
Contributor
pflegpetContributor
asked in Data
Automating WFS download

Hi, I would like to create a workflow to download and merge vector data from a WFS. The city of Vienna provides building footprints in shape format via WFS. Due to the large filesize it is recommended to reduce one download to a tile of 2x2 kilometers or smaller. As I need the complete dataset I try to create a workspace to download all tiles with getfeature requests (e.g. https://data.wien.gv.at/daten/geo?service=WFS&version;=1.0.0&request;=GetFeature&typeName;=ogdwien:FMZKGEBOGD&outputFormat;=shape-zip&SRS;=EPSG:31256&BBOX;=2748,341794,4516,343209) and then merge the tiles into a File GDB. Is it possible to dynamically create the request by inserting the necessary bounding box coordinates and then merge data directly out of a ZIP file. Thanks for any help.

484
pflegpet
Contributor
6 years ago
S
sobanmughal
asked in Data
combining and transposing multiple excel files

I have multiple csv files that i need to combine. Table structure looks like below. I want the output to look like Table 3 and 4. I have tried to used to the columns to rows transpose but the input tables are not fixed and can change with new lines added etc, so not exactly sure how to do thisTable 1LineAtt1Att21X 502X 493X 334X 895X 906X 45Table 2LineAtt1Att21Y 232Y 143Y 514Y 785Y 346Y 78Table 3Line123456Att1 (Table1)XXXXXXAtt1 (Table2)YYYYYYTable 4Line123456Att2(Table1)504933899045Att2(Table2)231451783478@takashi

117
S
6 years ago

Badge winners

Show all badges
30,107
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.