- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,825 Posts
25,142 Replies

When you subscribe we will email you when there is a new topic in this category

6825 Posts

itayContributor

Writing DWG hyperlink

Hi,Does anybody have any experience in writing hyperlinks in an Autocad DWG?The only mention in the documentation is rather sketchy and doesnt help much :Shttp://docs.safe.com/fme/2015.1/html/FME_Desktop_D...Any tips or info are welcome.Itay

takashiContributor

From this Q&A;: Geojson reader-encoding issueThe Source URL: http://stadtplan.bonn.de/geojson?Thema=14403&koordsys;=25832/geojson.jsonI think there is a room to improve GeoJSON handling.The GeoJSON reader should support various encodings.The GeoJSON reader and the GeometryReplacer (Geometry Encoding: GeoJSON) should set an appropriate coordinate system to the geometry if the "geometry" member object contains a valid "crs" member, like this.{ "type" : "FeatureCollection", "features" : [ { "type" : "Feature", "geometry" : { "type" : "Point", "crs" : { "type" : "name", "properties" : { "name" : "EPSG:25832" } }, "coordinates" : [ 369127.5691, 5624581.982 ] }, "properties" : {...

Why do I only get attributes, but no geometry when using the WFS Reader and File Geodatabase Writer?

The URL for the reader is : https://itportal.decc.gov.uk/arcgis/services/OGA_Public_WGS84/OGA_Quadrants_WGS84/MapServer/WFSServer?request=GetCapabilities&service;=WFSThe XML for all the relevant URLs in the log file appear OK to me, and no errors are being reported (not even any warnings).

error number from ArcObjects is: '-2147154945'

Hi all,I am using FeatureWriter to update an existing Feature Class that lives in my SDE. Versioning is enabled. The Transaction Type is a Versioned Edit Session and my Writer Mode is Insert. I have Drop Table as No and Truncate Table as Yes. Essentially I want to replace the old FC with the new one I am creating.I noticed the writing was taking a while, and it seems like it eventually times out. Maybe this is the case, I want to double check with the community.The full error message is:"An error occurred while attempting to store a row into the table 'SDE.XXXX'. The error number from ArcObjects is: '-2147154945'. The error message from ArcObjects is: {Table schema changes after cursor declared [42000:[Microsoft][SQL Server Native Client 11.0][SQL Server]Could not complete cursor operation because the table schema changed after the cursor was declared.] [DB.SDE.XXXX]}"To note: I am not touching anything while this process is running. Thanks!

Pictures/Video + Point Cloud

Can anybody tell me how to do the following?I am trying to shoot video or take LOTS of pics and stitch together with my LiDAR point cloud....this way it is like Google Streetview but with cm measurable quality

HTML table section parsing

Hello,I am trying to parse an HTML page with FME 2014 but, after a bunch of tests, I do not succeed in decoding the rather simple <table> section of my HTML imput. I fear that my troubles come from the FME version I am currently using.I have indeed read many posts dealing with HTMLExtractor, HTML Table Reader but these transformers are only available in 2017 version (thanks to @takashi for all of them !).Can someone tell me if there is a way to decode HTML table section with 2014 version of FME and how ? I join a sample of the file I have been trying to decode (the <table> part is the only interesting section of this file).Any help would be really appreciated.Thanks a lot.

FME API version of module 'FILEGDB' matches current internal version (3.8 20160224) Error running translation.

I am using an eval version of FME Workbench 2016. Threw the following error message when I have more than 2 Esri Geodatabase (File Geodb API) readers in my workspace. Anybody had the same issue?FME API version of module 'FILEGDB' matches current internal version (3.8 20160224)Error running translation.

Converting KML Attribute Data to Shapefile

150

7 years ago

danilo_fmeEvangelist

asked in Data

Migration Oracle to SQL Server

Hello,I would like to do a migration between Reader ( Oracle - No Spatial ) to Writer ( SQL Server ).The question is: Its possible to migrate all from Oracle ( primary keys, foreign keys, indexes , views ) to SQL Server? Thanks,Danilo

110

7 years ago

johannParticipant

asked in Data

short datatypes understood as long with new Shapefile reader (FME2016)

My shapefiles have attributes coded as short (integer with 6 digits) and FME2016 read them as long, so when I output them in a dynamic workflow, their width is 10.- If I manually force to short, they are 5 digits long, which is not OK...- If I manually force to number with 6 digits and precision 0, it is OK, but I can't do it dynamically with datasets of many shapefiles... This is since FME2016 supports the short/long etc. datatypes for shapefiles. With FME2015, my data was understood correctly as number with 6 digits, in dynamic workflows.Is it a bug or can I automatically force all such attributes to numbers with 6 digits ?

12521

7 years ago

mygisContributor

asked in Data

Asking questions in the title isn't the right way but perhaps if I could check if there is a reason why some users still put the entire content of the question in the title/subject I would surely inform the moderators

7 years ago

codgik_1

asked in Data

problem with creation DEM/elevation raster from ASCII XYZ

I have problem with creation DEM/elevation raster from ASCII XYZ. I've loaded ASCII XYZ using CSV. I've used transformers: VertexCreator, NumericRasterizer. Translation was SUCCESSFUL, but finally elevation doesn't exist. What can be wrong? In attachment I send fmw file.

Dynamic Source file - zipped / not-zipped

HiI have a simple workbench that converts ASC > XYZ as below:fme ASC_to_XYZ.fmw --SourceDataset NT26SW.asc --DestDataset NT26SW.xyzHow can I make the workbench deal with a dynamic "SourceDataset" as sometimes I need to pass a gzipped version of the sourcefile. The example below with the ".asc.gz" sourcefile will not work. fme ASC_to_XYZ.fmw --SourceDataset NT26SW.asc.gz --DestDataset NT26SW.xyz I am trying to resist re-writing code that pre extracts the "asc.gz" file before passing to FME.Thanks,Mike

File Copy Writer Error attempting to copy from when writing to Biztalk monitored fileshare

Hi, I havethis error using FME FileCopyWriter (runs on FME Server) to copy files processedby FME to a fileshare that is monitored by Biztalk. Biztalk is taking care oftransferring files to a different (and isolated) location. We are currently testing a set of about 100 files(140Mb, mostly shapefile, jpg and wld), the final set would take about 4500files and 40Gb.I use aworkspace that reads from Excel a list of source and target locations, and a FeatureReader(PATH Reader) to read all files at the source location. Finally a File CopyWriter to write each file to the Biztalk target location.Sourcefiles are ready and static, no read/write actions on them. When running theworkspace with Biztalk services turned off things are all running fine.However, when Biztalk services are running, the process crashes with thefollowing error: 2017-08-08 09:33:07| 0.5| 0.0|INFORM|File Copy Writer: Copying file '2016_01w_O10_1_2.jpg'2017-08-08 09:33:07| 0.5| 0.0|ERROR |File Copy Writer: Error attemptin

HTTPCaller: request WFS with bbox source parameters from other WFS

I would like to be able to make a WFS- (HTTPCaller-)request within a variable bbox-area. These variable bbox-parameters represent municipality-areas. Currently my worfklow looks like this:In my current workflow I make a request to a WFS-service containing municpality names and boundaries (not included in the screenshot). Next I make use of BoundsExtractor and AttributeWriter to store these bbox-values.Next, I have a CSV-file containing all of my WFS-requests (FeatureReader3)For instance:ID,URL1;https://geoservices.informatievlaanderen.be/overdrachtdiensten/GRB/wfs?version=1.1.0&request;=GetFeature&maxFeatures;=1000&StartIndex;=1&typename;=GRB:GBG&outputformat;=application/jsonWhat I would like to do is to join URL from above (FeatureReader3) with the BBOX-values coming form FeatureReader4. Ultimately my request should look like:https://geoservices.informatievlaanderen.be/overdrachtdiensten/GRB/wfs?version=1.1.0&request;=GetFeature&maxFeatures;=1000&Start

940

7 years ago

hoa_leContributor

asked in Data

How to write *.mdb to *.Gdb

Hi everybody,I have a .mdb emtpy fields. Now, I want to convert to .Gdb (point format).I use read .mdb and writer .gdb but I don't get point file in Gdb. Could you tell me why? Thank youI attached my workspace in the bellow:

1930

7 years ago

chriswilsonSupporter

asked in Data

Process fails due to reader error, despite 'ignore failed readers' being set

I have a workspace that is aimed at accepting either a shapefile or a DWG to define an area of interest which in turn is used to find data. I've linked both readers to optional parameters, blank default sources, and set 'ignore failed readers' to yes, yet when only uploading a shapefile (i.e. not uploading a DWG) I still get a process failure on FME Server with this message about the DWG reader failing:I can try later with feature readers, but to me this shouldn't fail - any ideas?

7417

7 years ago

pinkopoContributor

asked in Data

Create new file geodatabase on writer

Hi guys,I am trying to automate a process which requires to write into a new file-geodatabase everytime i run. is there a way that FME can create a new file geodatabase for my feature classes in a same workbench?Thanks!

Create 3DTiles in WGS84 with unit in Radians

I have a dataset with 3D buildings in the format CityGML (EPSG: 25832) and would like to present this in Cesium as 3DTiles. The 3DTiles must be available in the WGS84 with units in Radians, and at first the longitude and then the latitude must be listed. (See 3DTiles specification: https://github.com/AnalyticalGraphicsInc/3d-tiles#coordinate-system-and-units) Input data: Format: CityGML EPSG: 25832, Unit: metre Geodetic CRS: ETRS89 Date: European Terrestrial Reference System 1989 Ellipsoid: GRS 1980 Example: 544913.83 5460346.67 205.41 (x, y, z) Required output data: Format: 3DTiles EPSG: 4326 but in the unit radiant Geodetic CRS: WGS 84 Date: World Geodetic System 1984 Ellipsoid: WGS 84 Prime meridian: Greenwich Example: 0.1678606623,0.86034635,205.41 (longitude, latitude, height)Here my experiments:Reader: CityGML (EPSG 25832) -> Writer: 3DTiles (LL84-RADIANS)Reader: CityGML (EPSG 25832) -> CSMapReprojector (25832 to LL84-RADIANS) -> Writer: 3DTiles (LL84

280

7 years ago

mygisContributor

asked in Data

FME Cloud - Running Scheduled Job during an FME Cloud Running Scheduled Instance

Hello,I am curious to know if the Scheduled Instance on FME Cloud would terminate a non completed job in FME Server.In this theoretical scenario I would schedule the FME Cloud Instance to be activated let's say at 10 a.m every day and that the FME Server Job would run at 10:15 every day. Under normal circumstances it would take 30 minutes to run the job and my FME Cloud Instance will be deactivated at 11 a.m . But what would happen if the FME Server Scheduled Job one day takes 1h 30 m to run, would FME Cloud Scheduled Instance wait for the job to complete? Thank you.Lyes

110

7 years ago

Anonymous

asked in Data

ArcGIS Portal Writer is not Linked

I am using the Esri ArcGIS Portal Feature Service writer to publish feature services to our ArcGIS Portal from an Oracle database. When we use ArcMap to do this it writes to ArcGIS Server, not ArcGIS Portal, and creates a link between the Oracle database and the feature service in ArcGIS Server. Then when the data changes in Oracle, those changes are reflected in ArcGIS Server. You can also write back to the database by putting the feature service on a map in ArcGIS Portal.However, this is not the case with the FME Portal Feature Service. It creates a file geodatabase and a feature service from that geodatabase, but the link to the source Oracle database is broken. In ESRI terminology this is a "hosted service". Changes to the Oracle database are not pushed to the feature service.Are there plans to make a Esri service that writes to ArcGIS Server and keeps the connection between the source database and the feature service? We would like to automate our publish process to ArcG

Reducing bit depth in TIF images

Is there a way to reduce the bit depth in TIF images from 24 to 8? I've gad a look at the RasterInterpretationCoercer and RasterNandInterpretationCoercer transformers but haven't managed to get very far. The ultimate destination is BIX BCP and this is only compatible with 8 bit colour hence the requirement to reduce the bit depth. Thanks, Matt

annette2Contributor

Hi,I have received a text file to convert to polygons with donuts but I am unfamiliar with the format. Does anyone have any experience with a file with the following header:Version 780 Charset "WindowsLatin1" Delimiter "," CoordSys Earth Projection 20, 109, "m", 5.387638889, 52.156160556, 0.9999079, 155000, 463000 Bounds (13558, 306866) (278118, 619026) Columns 1 RxLev Char(9) Data Region 789 36733 278118 583666 278038 583666 278038 583746 278038 583825.9999 278038 583906 277958.0001 583906 277958.0001 583986 277878 583986 277798 583986 277718 583986 277638.0001 583986 277558 583986 277478 583986 277478 583906 277398 583906 277398 583986 277318.0001 583986 277238 583986 277158 583986 277158 584065.9999 277078 584065.9999The end of the file has the following information: 7 16518.0001 365666 16438 365666 16438 365585.9999 16438 365506 16518.0001 365506 16518.0001 365585.9999 16518.0001 365666 5 199958 461506 199878 461506 199878 461425.9999 19995

FBX converted from CityGML can`t open in Blender

Hi,I have a cityGML file.I added the FBX writer and used the Generate option to convert it to FBX.It generates without errors 6 files, but if I try to open them in Blender I receive an error related to the incorrect binary. The same with every 3D modeling editor: can´t open it!Someone can help me? Screenshot available below. If needed, I can paste the log file.

How to insert image into excel files by FME2014?

@MarkAtSafe

150

7 years ago

Page 191 / 273

Badge winners

aawad.93has earned the badge Student (Grey)
aawad.93has earned the badge Arabic Speaker
aawad.93has earned the badge English Speaker
aawad.93has earned the badge French Speaker
aawad.93has earned the badge Welcome Back

Show all badges

30,457: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.