Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,703 Posts
24,707 Replies

When you subscribe we will email you when there is a new topic in this category

6703 Posts

Recently active

Most replies Most views Newest first

How to write in a Excel file a listing with a specific format according to the data of a polygon?

Hello, I Have a dwg reader. I use a lot of transformer to have a an excel file which contains a list of points (Point) that form polygons (PARCELLE N°). I write the list like on the Print Screen 1 but it's not the result i would like. I want to have for each polygons a list of points and like in the Print Screen 2 where I write Parcelle N° in a cell and Surface in Another and below the list. The Polygons must be sorted PARCELLE N°. I must repeat the format for each polygons. The number of polygons and points is variable depending on the source dwg file. Can you help to do this or give me some tips? I think I must use some python code to solve question. I attach 3 excels files : - listing_surface_template.xlsx which is the templace I use. - listing_surfaces_exemple.xlsx which is the file I obtain with my workspace (Print Screen 1) - listing_surfaces_exemple_final.xlsx which is the file with the desired format (Print Screen 2). Print Screeen 1 Print Screen 2

aguanContributor

How to close excel file reader after the data us loaded?

I used an excel file as a reader, read in all needed features, do some calculations, then use the same excel file in featurewriter to update one cell in it. The process works if I enable the feature cache and run step by step. But a complete run encounters an error indicating the writer fails due to the excel file being open. I need the process to run in the same workbench so I can use FME parameter XLSX_ROW_ID for excel to locate which cell is to be updated. If I can close the excel reader after all features are read in, and let the feature writer open it again for update, that should work.

lifalin2016Contributor

Proper escaping in database writers ?

Hi list.I'm writing data to an SQL Server database, with full schema targets.My schema names often include a dash (e.g. "RSF-Aflob"), which freaks FME out, as it doesn't perform any form of escaping. It errs both when writing data, and even when I import attribute names to a transformer.Now, proper escaping is an integral part of database manipulations, so I wonder why it's omitted in FME ? FME do know which database type is in question (here: SQL Server which uses [xxx]), so escaping the proper way really is possible.Can anyone shed some light on this issue ? Should it not be promoted as a improvement request ?Cheers.

FeatureWriter and shapefiles

Hi, I'm using a FeatureWriter to export a bunch of data from an SDE Geodatabase to Shapefile format. The final product is not including the .sbn and .sbx files. Is there a way the FeatureWriter can include those files, or some other Transformer I can use?? Thanks,

redgeographicsEvangelist

SDE Write error (-2147418113)

Asking this on behalf of a customer:They recently upgraded to FME 2019 and are having some issues writing to SDE. If they write to an existing feature class they get this:Geodatabase Writer: The field 'OBJECTID' in table 'Afvalbakken' will not be updated since it is not editableA 3D feature was encountered in the feature class 'Afvalbakken', which is defined as containing 2D features. The feature, and any other applicable features in the same feature class, will be modified so that it has the same dimension as the feature classAn error occurred while attempting to insert a row into the table 'Afvalbakken' using a cursor. The error number from ArcObjects is: '-2147418113'. The error message from ArcObjects is: {Klasse is niet geregistreerd}Writing to a new feature class leads toTransactions are being used by the Geodatabase WriterGEODATABASE_SDE writer: An unknown exception occurredAny suggestions?

DEM GeoTIFF to rgb band png Tiled Web Map TMS

Hi, I'm completely new to FME and was wondering if the following was possible, and if yes, how?I have DEM GeoTIFFS Greyscale 32 bit floatingpoint. We need to convert this to .pngs (or similar) where the rgb values/bands represent elevation, so maximum 1,6 million values. We want elevations for the world, so between -12000~ to +8868.The output is going to be png Tiled web map, like Google maps, TMS with zoom levels folders (for example 10,13,17 and 21). This will be used in a terrainsystem witha custom shader for elevation.Is this possible? If something is unclear please let me know. Any help is appreciated.Regards, Robin

GDB_GEOMATTR_DATA

From ESRI documentation it shows that they use the field GDB_GEOMATTR_DATA as an 'extra' way to store complex polygons. That is, if you want to use more than regular straight lines between the points of that polygon. Inmy case, that field only contains 'NULL' values, as I only use simple straight polygons.So far, so good in ArcGIS pro, but when you try to read the FCL in FME(2019.2) an error occurs that the row is not available. The only way is to exclude the field when you want to read the data. The problem is that you normally don't look for that field as this is not allways added to the FCL. Also FME_server cannot handle this field.The question: is there a way to get past this issue without having to think about field GDB_GEOMATTR_DATA, even better: I hope that FME will fix this reader issue.

swachContributor

Writing to SDE with attribute rules and database sequences

Is there any way to write to an esri sde feature class with attribute rules and database sequences?

effieContributor

Automatically creating coded domains in Writers

Hi,Is there a way to automatically create new coded domains into Esri Geodatabase (File Geodb) writers? I have all the domain information in an excel file. Is it possible to have a function to import the table into the coded domain window?Thanks.

virtualcitymattEvangelist

Hi All, Just been playing around with the 3D PDF writer and have noticed that my output seems to be in mm rather than meters (AdobeReader has a measurement tool) I've turned off "Move to local Coordinate System" but the issue is still there. Is there a way to specify the unit in the writer? or is the only way to do this to scale the model so that the measurements are at least accurate?

SharePoint List Reader '404 Client Error'

Good afternoonI have a workbench that is using the sharepoint reader to to pull the contents of a list into fme, where when I run it fme reports Microsoft SharePoint List Reader: Client-side error: '404 Client Error: Not Found for url: https://........The list has ~95 fields in it (so quite a few and the url call is quite long). Through trial and error I have found that there are a couple of fields that if I exclude from the Reader the workbench runs ok. The fields are type string line of text in sharepoint. They have / characters in their names (but so do some of the other fields). None of the records in the list actual have any values entered in those fields at the moment (but there are others like that which read ok) and so I'm a little stuck as to what's causing the error.These are the 2 bad-eggs I dont' have any Features to Read parameters set in the Reader. Has anybody out there run into a similar issue with the sharepoint reader?@mark2atsafe I see a few share

Uploading a file to a shared Google Drive folder

I've been trying to upload an excel file to a shared drive on Google Drive using a GoogleDriveConnector and keep getting an upload error where it can't find the folder I'm sending it to (404 Client Error: Not Found for url). I can upload it fine to My Drive, but can't find a way to upload it to the shared drive. Has anyone had the same issue and found a way around it?

OSM-XML Writing a osm_relation_type=multipolygon

I want to write areas with holes as "osm_relation_type=multipolygon".It works fine when I give the objects directly to the OSM-writer (FME does all the work).However, I would like to assign the node/way/feature-ID myself and determine the number of vertices of a "way" myself.I tried following workflow:Getting a "feature-ID" to the areaSplitting the areas in simple features an features with holesExtracting the outershell and holeWriting the tag "role=inner" (hole) and "role=outer" (outershell) to the geometrySplitting the geometry after 1964 (e.g. year of birth) verticesCopy the "feature-ID" to "feature_relation_id"Getting a "way-ID" to the wayJoining a feature and it's ways by "feature-ID" and the attribute "feature_relation_id" an creating the members (ref/role/type)Dropping the original feature-geometryAdd the attributes "user", "timestamp", "version"

Autodesk Writer - Warning - The fila has been saved by A school version of the product

Hello, We have a workspace with transform a Geodatabase file in more thant 300 dwg based on surface. When I open the dwg with AutoCAD, I have a message like below. It says that "file was written by a school version of Autocad and A text is written in the trace banner". (Print Screen 1) THe workspace run with the version of FME : FME(R) 2018.0.0.2 (20180414 - Build 18301 - WIN64) and the version of AutoCAD I chose to write it's AutoCAD 2010 I have the same type of message with files (Print Screen 2 wrtten with FME(R) 2019.1.0.0 (20190710 - Build 19608 - WIN64). The message the files was written by a application which hasn't been developped by Autodesk or which hasn't got an Autodesk's licence Can you help me with this issue ?It's not very good to have this kind of message in file to share for internal and external purpose. I can send files if necesssary. Best Regards Bernard DinonPICC_Crisnée-Odeur.dwgOSP3_2020_Blegny_Plan_20200319.dwg PICC_Crisnée

mr_fmeEnthusiast

how to break the JSON file into attributes?

Hi, How can I broken the attached JSON file into attributes? Thank´s

Generate URLs for features in an AGOL feature layer

Hi, I'm looking for a way to automatically generate URLs for each feature in an ArcGIS Online feature service and add it as an attribute. If possible I also need the URL to zoom into the specific feature instead of opening the entire layer view. The URL will then be attached to an email body to allow the necessary people to view what feature is requiring repair. Has anyone been able to do something similar to this or have any ideas of how I can accomplish this task? Thanks!

DGN-file fail on reading elements by geometry

I'm trying to read a .dgn-file with Bentley MicroStation Design (V8) reader. When i change parameter to group element by Geometry instead of Level names i get this error. Anyone know why i can read elements by level names but not with geometry? 2020-06-03 13:14:04| 15.0| 0.0|ERROR |f_0: Lookup table `DESIGNGEOMIgdsTypeToGroupLUT' doesn't contain key `igds_oriented_arc' or have a default value

Create texture/border on Cesium 3d Tile

HiI have created cesium 3d tiles from a shapefile. The screenshot with pink 3d cylindrical shape shows that. I would like to add border and vertical lines as you can see in the sample screenshot from google earth below: Can anyone help on how I can do that?

lifalin2016Contributor

Read data with FeatureReader from dynamic schema in SQL Server ?

Hi list.We're importing data from customers on a daily basis, and we utilize the strategy of creating a new schema for the new data with the date included, e.g. "Fiber20200602" (with yesterday's data still in schema "Fiber20200601"). The tables and views in each "day-schema" is identical.I want to have FME read tables from the latest schema, and I use an SQLExecutor the generate the wanted schema name. But how do I utilize it in FeatureReader ?I added two tables under "Feature Types to Read" (by point and click). This worked very nicely.Using the text editor I then changed the hardcoded schema name to be my variable. This removed my two output ports, even though my "Output Ports" was set to "One per Feature Type".I then tried to change the setting to "Specified", and added the two tables as fixed schema. This regenerated the output ports, but the read input data was output on the "Generic" port none

Polygon to Multipolygon

I want to transform a Personal Geodatabase to a PostGIS database. In my Personal Geodatabase are Polygons (which also have multi parts). I used an Aggregator Grouped by OBJECTID of the features to create Multipolygons. Unfortunately this resulted in a geometry collection, so I used a GeometryRefiner which was suggested to me, but this only converted the Geometry collection back to Polygons. I also applied a GeometryFilter to check that there are only Areas in the dataset - this is actually true. So, how can I identify the error? And how can I create Multipolygons so that my transformation will be successful?

Time difference during loading: Geopackage from QGIS and Geopackage from FME

When investigating access to geopackages from network drives, a temporal difference in loading behavior between geopackages created by FME and geopackages created by QGIS was determined.In comparison, GeoPK created in QGIS will load 10 times faster when opened in QGIS than GeoPK from FME.The reasons for this behaviour and an evaluation of possible steps to remedy the problem could be investigated. Differences:geometry ConstraintFME: = GEOMETRYQGIS: = POLYGONDimension ConstraintFME: = xyzmQGIS: = xyVersion des GeopackagesFME: 1.0QGIS: 1.2Probably the difference depends on the version of Geopackage:FME: 1.0QGIS: 1.2 Questions:What does the time difference depend on?If from version, then how can the version in FME be changed from Geopackage 1.0 to 1.2?Thank you in advance

Hello, i have 3 csv writers, one is a header record from an sql database that has 10 fields. the second is the main body of the file i'm writing and this has 12 fields. the third a footer record again read from a sql database. to write them as one csv output i use a file name attribute the same for the 3 files with the second and third appended. my problem is the output file only shows ten fields not the twelve as defined by the structure in the writer. does anybody know how to overcome this. Thanks

How to get overlapping shape points inside dwg boundary

I have a shape file with points and I would like to get the points which are inside an Autocad-boundary. I tried it with Pointonareaoverlayer and spatial filter, but every point goes to the 'failed'output :-S....It isn't rocketscience, but I can't fix it.Who could get a look at my workbench and fix it? It would be great! :-DThis is the input:

arsiContributor

Geotiff change nodata from RGB-value 3 bands

I'm new to FME, so if there's a better option it would be greatly appreciated: I have multiple geotiffs (georeferenced black and white aerial phtographs) that I want to convert to a single ECW for use in Geoserver. As there were issues with black and white I set the cut off edges (which contained labels e.g.) in MS Paint before georeferencing in QGIS to RGB red (as these could be manually set to nodata in QGIS).So the corresponding geotiffs have all band 0 (red8) value 237 / Band 1 (green8) value 28 / Band 2 (blue8) value 36 (and a band3 alpha8 255) for the nodata values. I'd like to have this RGB value 237, 28, 36 set to be interpreted as extra nodata value or set to be replaced by value 0 and add this (with the other value 0 for nodata for the normal background, as the geotiffs are not fully upright) to the ECW as nodata.I tried rasterPaletteExtractor but it rejected the geotiff. Or should they all be extracted by band first (bandselector) or should it be done in some way

How can I get the elevation from ASCII to a 2D vector point

Hi.I have LiDAR data in .asc and .las formats. I also have .shp file points that I would like to attach the elevation from the LiDAR. How would I go about this?Any help wold be much appreciated.Paul

1
...
62
63
64
65
66
67
68
...
269

Page 65 / 269

Badge winners

philipsteenkamphas earned the badge FME Certified Professional
john_eskhas earned the badge English Speaker
john_eskhas earned the badge Swedish Speaker
john_eskhas earned the badge Student (Grey)
john_eskhas earned the badge FME Form Basic Training

Show all badges

29,736: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK