- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,826 Posts
25,148 Replies

When you subscribe we will email you when there is a new topic in this category

6826 Posts

Extracting ECW header information

Hi!I have a problem with a ECW Raster. When I try to write to ECW I get the Log information "ECW writer: The datum in coordinate system 'RAW' is unsupported. The resulting file will be bave no datum." So i assume FME somehow reads this 'RAW' information from the ECW header. How can I read this information into my workflow so that i could edit it somehow in the process.I've tried to set the correct coordinate system and so on but it didn't worked out.

Can't read files in folders with brackets with Directory and File Pathnames reader.

Dear community,When I try to scan a directory where the folder contains brackets the files in this folder are not being read.I can imagine why brackets cause problems but sadly this data is often external input. Does a workaround exist? (Other than scanning folders for brackets and edit the folders.)folder:output: path_windows D:\\tmp\\New folder (25)\\input\\test D:\\tmp\\New folder (25)\\input\\[test] D:\\tmp\\New folder (25)\\input\\test\\data.txt D:\\tmp\\New folder (25)\\input\\test\\[data].txtmissing output: D:\\tmp\\New folder (25)\\input\\[test]\\data.txt D:\\tmp\\New folder (25)\\input\\[test]\\[data].txt

Geometry attribute desapearing when using PostGIS reader

I am using a PostGIS reader for a table with geometry type "Point". Once the workspace generated, the feature doesn't have the geometry attribute anymore, does anyone knows why?

480

8 years ago

ddecoeneContributor

asked in Data

converting shape polygon to autocad mpolygon

Hello,i have an issue with the convertion of shape polygon to autocad Mpolygon (with map-data)The mpolygons are ok displayed by autocad map, but when they are opened with other CAD (briscad) programms some of them dissappear. It seems to have something to do with the loop direction of the mpolygon. Autocad is able to detect the incorrect polygons but not able to repair them. (audit the drawing, "incorrect loop direction")When i import the mpolygons directly in autocad, this problem does not accur. So it has something to do with FME.I have been looking for an attribute which could let me change this, but I have not found one. Is there a way in FME to get to change to the loop direction?thanks in advance

Writing nested GML files

I'm needing to write a reasonably complex GML v 3.2 file that will be created from a series of flat tables. I'm not sure how to construct the data in FME so that the writer will create the "nested table" structure required by the GML.An example of the output structure would be as follows:<gml:featureMember><geometryProperty><gml:Point> etc...</geometryProperty><propertyType>Private</propertyType><addressList><address><number>12</number><street>Main</street><zip>39945</zip></address><address><number>12b</number><street>Main</street><zip>39945</zip></address><address><number>13</number><street>Main</street><zip>39945</zip></address></addressList></gml:featureMember>Is there a tutorial on using the writer for complex output like this or can someone advise what the data should

OS Authentication for SDERASTER formats

Hello, When you use the SDERASTER reader or the SDERASTERCATALOG writer or the SDERASTERMAP writer it allows you to initially use the OS Authentication option but when it gets added to the canvas the username and password fields are empty and red. It won't let you run the workbench until they are filled in. How do you get it to use the OS Authentication option correctly? Thanks, Peter.

8 years ago

darius

asked in Data

Creating interactive PDFs with layer visibility

Does anyone know if in FME it is possible to create a PDF with different layers (shapefiles) where you can switch off and on their visibility?

I'm trying to read a SpatiaLite table with a Primary Key Unique ID (PKUID) field, made in QGIS. All the fields of the SpatiaLite table can be read, except for this PKUID field. Even an AttributeExposer does not do the trick. Is there a reason for this? For the moment, I created a workaround: I read the table, together with the spatial data, in a SpatiaLite reader. Then I read the same table in an SQLite reader, which can detect the PKUID field, but does not contain the spatial data. A FeatureMerger does the rest.

WorkspaceRunner: Issues with sketchup and geodatabase

I have successfully implemented a WorkspaceRunners that run a workspaces that read in from CSV files, IFC files and Shapefiles. However trying to implement a similar WorkspaceRunner to read a batch of Sketchup files fails. If the WorkspaceRunner sends the Source filename that the Workspace being called was created with it works fine. However sending another Source filename, the workspace being called fails to read that file. On a different note, I cannot see how to use WorkspaceRunner to read a batch of Feature Datasets in a geodatabase.Thanks

8 years ago

geogaardContributor

asked in Data

Spatialite line features written in FME viewed in ArcMap creates an unexpected view

I am creating a Spatialite database with FME 2016.1 64 bit. I have both polygons and lines. Polygons shows up perfectly, but the lines are all over the place. I have added a picture showing the lines that should have depicted a road network in a municipality. Have anyone had the same experience or any idea why the lines drawn like this? I have been trying to adjust how ArcMap reads the data with the "query dialogue" but no success. My ArcGIS version is 10.3.1

How do I import Layer State to sheet files (Autocad)

8 years ago

gifupack

asked in Data

FME How to read multiple CSV files from many folders and write to GDP tables by folder

I have 13000+ CSV files, all containing around 13000 rows. These CSV files are arranged in 146 different folders. All CSV files have the same schema with ; as separator. These CSV files contain about 175 million rows of data combined. The folders are named as seen in the picture below (for example ...\\CSV_folders\\5785xxx)CSV files are named like these:I already tried to copy all CSV files to same directory and run them to one GDB with FME. This went well... but resulted too heavy ESRI GDB that takes forever to search through. (175 million rows, around 20GB)Now I would need to make things a bit differently. I would like to work with FME to create one ESRI Geodatabase. It should contain tables named like these folders containing CSV files. A table in the GDB should have all the CSV files loaded in the table, that are inside the original folder. This would split my 175 million rows to 146 tables, making it a bit faster to search trough with Arcmap.So my problem is, how to make FME read

Does anyone have an example of using the JSONUpdater? I am trying to update multiple Json files (up to 50) without opening them up and finding my value to change but am looking for FME to help fill this gap. Thank you in advance!

1310

8 years ago

lavairyeContributor

asked in Data

Material definition in OBJ export

Hello,I'm exporting OBJ files from a CityGML dataset. In the mtl file, FME write a Tr attribute. Can somebody please tell me what is this parameter (I don't see it in the wavefront format definition)?

8 years ago

fmelizardContributor

asked in Data

When writing to ArcGIS Portal, all my mixed-case field names show as lowercase in my feature service. Why is this happening?

I have a workspace that contains an ArcGIS Portal writer with mixed-case field names. It runs without a problem when first creating the feature service on ArcGIS Portal. However, when I attempt to use that same workspace to write updates to that feature service, I see warnings similar to the following: ArcGIS Online Feature Service Writer: Attribute 'myFieldName' on feature type 'Feature_Type' does not match any field on the corresponding layer/table. The attribute will be ignoredIf I check the feature service itself, I can see that all the mixed-case field names have actually been set to lowercase (so, myFieldName is actually set to myfieldname).

1040

8 years ago

fmelizardContributor

asked in Data

FME support for the program I use

Can I find out how to use FME to transfer data between programs I am using? To export? Import?

8 years ago

hanie

asked in Data

How to manage converting unclassified XYZ to Minecraft?

I'm trying to convert XYZ point cloud to DEM so I can generate a Minecraft world. After searching and reading "How to make Minecraft worlds" article I saw the Norway example (las2MinecraftFMEpediais workbench) by @dmitribagh similar to what I'm trying to implement, unless it is using classification attribute values (e.g. 2 for ground, or 5 for vegetation), while my XYZ point cloud doesn't have these attribute values.In the Norway example, the point cloud has another classification attribute values for water (9 or 18), while the one I have has no points for water or spaces under bridge for example. I'm attaching a picture of my dataset in the FME inspector. How could that XYZ be used to make a Minecraft world out of it? Appreciate any advice or suggestions. Thanks

(General) LiDAR Vegetation Class Question

Hi,Can anyone answer a LiDAR point class classification question? According to the ASPRS standard for point class classification, the following class relate to vegetation:3 – Low Vegetation 4 – Medium Vegetation 5 – High VegetationCan anyone tell me whether there are actual ‘standardised’ (above ground) height ranges associated/relating to each of the vegetation class? If so what at the numeric values? For example; 3 – Low Vegetation – 0.0m to 0.5m 4 – Medium Vegetation – 0.5m to 1.0m 5 – High Vegetation – 1.0m to >>mIf there are NOT any standard numeric height ranges; can anyone explain what the Low, Medium and High descriptions actually mean in reality? I have looked at various ASPRS documents but can not find any form of detailed explanation.ThanksRob

8 years ago

ashertbrooks

asked in Data

WorkspaceRunner: Server workspace path

How can I I set the workspaceRunner parameter 'FME Workspace' to my FME server path containing uploaded workspaces?I have an attribute with the workspace name that gets set dynamically, so I know which workspace to call, but rather than set the path to a network location I would like to run workspaces that exist in the FME server environment.

8 years ago

xavigarciamar

asked in Data

Offset "Y" in a IFMEMultiCurve

Hi everybody ,Anybody knows why in the elements type IFMEMultiCurve doesn't apply the offset of the Y coordinate ???.I have a diagram with input V7 microstation and output V8 Microstation and I see that if I put a Offseter with a offset of 4.000.000 applyes the offset to all the elements except to the elements of type IFMEMultiCurve (Type 33 of microstation).Maybe another way to apply offset to elements ???Any idea ?? , thanks for the help !!

8 years ago

turid_skedsmo

asked in Data

Reading unversioned SDE table with archiving enabled

I'm trying to connect to an unversioned table that has archiving enabled. I'm using the Esri Geodatabase (ArcSDE Geodb) reader. I connect as the owner of the table, the same user that was used to enable archiving. In the table list i cannot see the table ending in _evw (the database view containing the archived information), only the feature class itself. Should I be able to see the _evw-table?I add this Archive Where clause: GDB_FROM_DATE > 20070101090000When trying to read the features, I get this error message: "Invalid archive where clause. The archive where clause must be in the format 'GDB_FROM_DATE|GDB_TO_DATE <logical operator> <date> [AND GDB_TO_DATE <logical operator> <date>]' and be space delimited."What am I doing wrong? Are there any other fields I should have filled in? Could the date format be wrong? There are no historical versions or historical markers in the database.

240

8 years ago

fmelizardContributor

asked in Data

Trying to access the Offline Help for FME Server 2016.1 returns "Sorry, Page Not Found" ?

In the FME Server Web UI, the Help > Documentation link returns me with a "Sorry, Page Not Found" error -- what gives?!

I am trying time entry from a SQL table to Excel to be imported into our time entry software. I want to create one worksheet that contains all employee entries and then an individual worksheet for each employee in the same workbook. I can get it to do one or the other but not both at the same time. SO far I know if I define the sheet name - Time Entry - I can write all the data to one sheet. Or if I set the sheet name to - Employee Name - I get the individual sheets for each employee. I have tried coping the writer and defining the sheet name both ways but that doesn't work.

Can you modify the response headers for a data streaming service?

Hi allI've created a WMS service that streams GeoJSON as the response for the GetFeatureInfo operation. At first I was creating the JSON using the JsonTemplater connected to a Text File writer. When I tested the workspace the result displayed directly in the web browser. Problem was I had some formatting issues in the returned JSON that I'd have to deal with.I realized that if I switched to a GeoJSON writer the formatting would be handled for me. This works great but when I test via a web browser I get a file download instead of the a direct display of the returned data in the browser.I think it's caused by the Content-Disposition header in the request response.This is the response when using the Text File writer:And this is the response when using the GeoJSON writer:Is there any way to remove the Content-Disposition header when streaming from a GeoJSON writer?Update:I've used the JSONTemplater to create a return JSON with the same structure as the GeoJSON would hav

arthyContributor

Hi,I have a hundred of mapinfo files that I would like to convert to shapefile. It is obvious to write a workspace that works for one file but it not obvious for me to write a batch (MSDOS) that will convert all the mapinfo files.I tried to riun my workspace in a batch script but it is not working when I'm changing the SourceDataset_MITAB to another mapinfo file."C:\Program Files\FME\fme.exe" Y:\tmp\siurs\script\mitab2shape.fmw --SourceDataset_MITAB C:\Users\xkaptar\Documents\SIURS\projet\mapinfo\Ville.tab --DestDataset_SHAPE C:\Users\xkaptar\Documents\SIURS\projet\shapefileWhat I want is to have an input file <filename.tab> and the output should be <filename.shp> (with the other extensions <filename.shx>, <filename.dbx>, ...).Thanks

1170

8 years ago

Page 211 / 274

Badge winners

eulalie4has earned the badge FME Certified Professional
albineprohas earned the badge Welcome Back
andyliuhas earned the badge Student (Grey)
_fabian_has earned the badge Teacher (Bronze)
akesoderqvisthas earned the badge Teacher (Grey)

Show all badges

30,463: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.