- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,775 Posts
24,909 Replies

When you subscribe we will email you when there is a new topic in this category

6775 Posts

Recently active

Most replies Most views Newest first

ravinhasseea

asked in Data

FeatureWriter error

Hi I have used a FeatureWriter to write to an SDE feature class. While this seems to work, I am still getting an error in the log file. Any ideas?Total Features Written 9669=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-The below feature caused the translation to be terminatedStoring feature(s) to FME feature store file `C:\FME\BatchProcesses\FMEDailyProcesses\log\pipes_logFile_log.ffs'+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Feature Type: `Tester_PASSED'Attribute(string) : `_dataset' has value `<Unused>'Attribute(32 bit unsigned integer): `_feature_type{0}.count' has value `9669'Attribute(string) : `_feature_type{0}.name' has value `wgis.pipes'Attribute(encoded: fme-system) : `_num_features_read' has value `9669'Attribute(32 bit unsigned integer): `_total_features_written' has value `9669'Attribute(string) : `fme_g

How to create a list of attribute values from many input files as plain text

I am reading many features in a database, putting them through a 'spatialfilter'. All features that don't intersect are to be sent to the 'emailer'. How can i group a single attribute from many features as plain text so i can add this list to the 'emailer' body?

How to insert external reference of TIF/TFW files into existing dwg

We have geoereferenced tiff files which we would like to integrate with some existing dwg'sHow to do it?

LAS to Landxml (autodesk)

Hi !I would like to know if it's possible to transfert LAS files to Landxml ?Just like XML files are exported from a surface in Autocad.The purpose of this transformer is to load LandXML surface into Autocad Infrasworks as a Terrain so i can drape Buildings/Roads/City Furniture/Streams on it. Let me know if you think it's possible.Best regards

Convert lat/lng to geom data type

I have to convert these lat/lng to geom data type, such these lat/lng are in space (here I have done wrong), Kindly guide how I can convert them (lat,lng) to geometry such that they occur in space. Thank you

Date is shown in Inspector but not coming up in SHP

Hi,I'm merging a DGN file with excel table writing into a SHP (feature type definition 'import from Dataset' - I used a template given to me)The excel table contains date, I've used DateFormater- DestinationDateFormat: %d"/"%m"/"%Y, it looks like it should work and it is working when I run the workspace redirected for FME Data Inspector, dated are coming up perfect, fields with no no date have <missing> instead.When I view the SHP in Data Inspector as to 'open a dataset in a new view' dates are missing as they are missing when I view in in ArcGIS.How to make it the date viable?I've tried the FeatureWriter, dynamic properties and used the template .shp a s schema definition, that doesn't work either.Would anybody have any idea why the date is so difficult to write into a SHP? I use FME Desktop 2016.1.3.Would the proper XML workspace exported from GDB help? There is a .shp.xml given to me within the shapefile template anyway.Kamil

polygon with single pair of coordinates,Hi

HiI'm having a problem reading and then writing shapefile into MS SQL database. Shapefile contains multiple polygons (and multi polygons), but apparently there are few with only single pair of LAT / LON coordinates. These are rejected and not written. Is there a way how to write them anyway?Thanks,

7 years ago

felixderglueckl

asked in Data

Create PDF from an Excel file

Hello everyone,after creating a few excel files in my workbench I wanted to sum them up in a pdf file. I used the FeatureWriter to create the Excel files. After each FeatureWriter I inserted a PDFPageFormatter which I connected to a normal Writer for the PDF. What happens is nothing. The Excel files and the PDF file has been created but the pages in the pdf are empty. I'd be thankful for hints.Best regards,Felix

How to extract a raster from a DGN file

I have a Microstation DGN file, and inside it is an imported raster (not a referenced raster file). In FME this raster image is coming through as a nongeometric collection. How Do I go about extracting the raster file from the DGN so I can use it as a raster image? I have tried using the geometry filter, but since fme reads the raster as a nongeometric collection it thinks there is no geometry instead of filtering it through the raster port. Are there certain attributes that need to be set on the raster image in Microstation in order for fme to register it as a raster?

Downloaded zipped GML files to file geodatabase

Hi all, I am trying to create a workbench that will read/download 52 individual URLs and write them as 52 individual feature classes in a file geodatabase as well as 52 individual dwgs both using part of the original URL as the file name and for the file geodatabase as an attribute under the feature class. I will hopefully have this run monthly as a batch file.I have a list of 52 URLs that are stored in a spreadsheet (example of a few attached). Each URL is a download link for a .zip file that contains an individual GML file. I can pass the URLs successfully to my HTTPCaller which saves the response body to file. An example of the original URL called is this below:http://data.inspire.landregistry.gov.uk/Kensington_and_Chelsea.zipWhereas the response file that is saved is called 'http_download_1497369123968_8888.zip'I need to have a way to transfer the actual URL name from the spreadsheet so that it can be an attribute of my output. I'm not sure how to do this?Below is a

Creating CityGML hierarchy

Hello, I have one question regarding conversion 3D city from SHAPEFILE to CityGML.I have more classes of objects (vegetation, cityfurniture, buildings, ...). I would like to ask how can I follow the structure of creating _AbstractClasses in FME workspace? How can I create abstract features and use them as gml_parent_id in those features which are in the hierarchy down below? Thank You Michal

Get the custom attributes when converting a Revit rvz file

Hi, I have some trouble when I want export the custom properties of a Revit file. After exporting in rvz with the "Export Revit property sets" checked, I can see them when I open it in the inspector, but I can't access them in the workbench, or export the properties in a csv (with the ID I could reaggregate the data).Could you help me ?

FME Server with OS authentication type Geodatabase connection

Hi,Does anyone know why FME server is unable to handle an SDE connection file with OS authentication? I have several FME desktop workspaces using OS Authentication and I publish it to FME server and run my FME Job Submitter service. I also have the conection file uploaded, but somehow during translation it fails to utilize/recognise the SDE connection which is setup with OS Authentication. On the other hand, the windows server where FME Server is installed has ArcGIS Desktop installed too and I am able to connect to the database using the OS authentication SDE connection file.

I want to translat CityGML>IFC and i get this Error, at the end i cant get any geometry.

HTTP 503 Service Unavailable scheduled backupConfiguration.fmw

We run SSL and use a CNAME of gisdata.launceston.tas.gov.auFME Server 2017.0 is throwing:HTTPCaller(HTTPFactory): Received HTTP response header: 'HTTP/1.1 503 Service Unavailable' from 'http://papfme1.launceston.tas.gov.au:80/fmerest/configuration/migration/export'Terminator(TestFactory): Terminator: Termination Message: 'Unable to retrieve backup from FME Server `http://papfme1.launceston.tas.gov.au:80'. Please ensure that the credential are correct and that user `fmeadmin' has fmesuperuser role. The error was: HTTP/1.1 503 Service Unavailable - http://papfme1.launceston.tas.gov.au:80/fmerest/configuration/migration/export.'fmeadmin is in the fmesuperuser role and I have changed all hosts to use https and the CNAME above. The schedules>Backup Configuration form does keep reverting the password to 3 characters (which it isn't). If I paste http://papfme1.launceston.tas.gov.au:80/fmerest/configuration/migration/export into a browser it takes me

Is FME's DWG Reader able to determine DWGUNITS setting of a given DWG?

I successfully read autocad_insunits (Format Attribute) for any given DWG (In Autocad, this is the INSUNITS setting). Is it also possible to determine the DWGUNITS setting for any given DWG? I believe that I have tried all of the Format Attributes, with the word unit in the string, in FME 20160516 - Build 16494 - WIN64.Thanks.

7 years ago

emili

asked in Data

Export dgn 7 to dgn 8 from attribute selection

We want to export a DGN V7 file to v8 version with some specifications. For example: In version 7 we have grouped some elements in the same level, but with different colors and styles. The objective would be to be able to make different selections of level, style and color and in the reader environment, and export that selection to a specific level in the output file v8. How can we do this? thanks for your help

292

7 years ago

fmelizardContributor

asked in Data

I noticed that the PATH (Directory and File Pathnames) reader doesn't read my hidden files on Windows. Is there anything I can do?

7 years ago

zzupljaninContributor

asked in Data

Convert HTML page to image file

Hi, is it possible to convert HTML page to jpg file.Thank you, cheers.

1237

7 years ago

oscardInfluencer

asked in Data

Question about reading and writing the same XML

Good morning.I have the XML file of an ATOM feed. That XML has to be updated every time the resources provided by that service are updated. Several dates must be changed.My first approach is read the XML with the XML reader, calculate the current data, modify the XML using the XMLTemplater and wirting the same XML file using the Text File reader (with "Overwrite" set to YES)..The process reads the C:/ATOM_feed.xml, edits it and writes the file C:/ATOM_feed.xml.This doesn't work:"Error opening dataset 'Text File' for writing, ensure that file path and permissions allow for writing".I guess it makes sense.So, in order to avoid this, I have used "Creator" to create a feature with an attribute "join" set to "A". I have added the same attribute to the feed from the XML Reader and I have perfomed a Merge using "FeatureMerger" (Requestor = new feature, Supplier = XML). That way I can read and write the same XML file. The

Adding Hotlinking into a MapInfo table file

Hi all, This might be completely in the world of fantasy! I've programmed FME to produce a MapInfo table (using MFAL writer) containing points at 25m intervals along road centres (using Ordnance Survey's ITN data), each point contains a URL including Long/Lat coordinates so that I can invoke Google Street View. In MapInfo, I need to add the Hotlinking capability after FME so that the URLs can be read and linked to. I've looked at the tab header file (in Notepad) and it seems to need a few lines of code at the bottom of it. I was thinking, could I program FME to add this automatically? Has anyone thought about this before? Perhaps this is beyond the use of FME. The closest way I could think of would be to create a text file and write the specific text to it then replace the actual .tab file component in Windows Explorer but it wouldn't be a tidy process. Regards, Ian

222

7 years ago

fmelizardContributor

asked in Data

How can I download a file from Box.com, Google Drive, OneDrive or S3 by using the file name instead of the id

How can I download a file from Box.com, Google Drive, OneDrive or S3 by using the file name instead of the id?

7 years ago

stagha

asked in Data

MongoDB Writer doesn't write attributes,MongoDB Writer not writing fields

Hello,I am evaluating FME for a project but have hit a hurdle trying to write to a MongoDB database. I have put together a very simple workspace that reads data from an Excel file and dumps it into MongoDB. When I run it, I get the following error:MONGODB writer: Existing feature type 'rawData' does not contain an attribute matching the schema attribute 'customerId'. Attributes named 'customerId' on incoming features will not be written to the existing feature typeI get the same error for each attribute that I have defined. The writer succeeds in creating the collection and populating it with documents, but all the documents only have the '_id' field set.On the writer, I've set Attribute Definition to Automatic and also given the collection name under the General tab. Otherwise I've left the defaults.Am I missing something?,Hello,I am evaluating FME for a project and put together a simple workspace that pulls data from an Excel spreadsheet and d

248

7 years ago

tim_woodContributor

asked in Data

Attribute type message when opening 2016.1 Workspace in 2017.0

I've just opened one of my 2016.1 Workspaces that reads a ShapeFile in 2017.0 and some ArcSDE layers and writes to 2 File Geodatabases (FGDBs). I got the following message in the translation log:Attribute type 'fme_char' not found in ATTR_TYPE_MAP. Trying 'fme_int8' Attribute type 'fme_int8' not found in ATTR_TYPE_MAP. Trying 'fme_int16'I've still got 2016.1 installed so I'll run the Workspace in that, but I'd appreciate any explanations of what this means. I'll try re-creating the Readers and Writes in 2017.0 when I get a chance.

Hi,Yet another newbie here.I am just wondering if its possible to change writers output in some quick way (drop down list, etc).let me explain... I have an excel spreadsheet and 13+ feature classes (ArcGIS 10.3.1) I am using FeatureMerger to join the table with every single feature class (not always basing on the same common field). So far so good, it is working fine but sometimes i need to change an storing location, eg. output1: local test area, output2: internal server (SDE), output3: external server (SDE). How to change the output locations all at once. At the moment i have 13 writers and i don't want to change each of them every time and i don't want to create workbenches for each of the potential outputs. How to do that? Thanks,

913

7 years ago

Page 196 / 271

Badge winners

j.botterillhas earned the badge FME Flow Authoring Training
giszughas earned the badge Student (Grey)
sopog44800has earned the badge Expert (Grey)
sopog44800has earned the badge Teacher (Grey)
sopog44800has earned the badge Student (Grey)

Show all badges

30,063: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.