Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 6,700 Posts
  • 24,702 Replies
6700 Posts
M
marshwetland
asked in Data
PDF transformation problems

I'm struggling to transform some pdfs. I am using the PDFtoTEXT transformer as well as a textwriter, stringsearcher, maybe calling to python, and then writing it to a database. I'm flummoxed at the first step.Sometimes it'll write a pdf to a textfile. But often the pdf2text program box pops up. That's useless for automation. What I want is for it to read a whole folder of texts - found the place to specify that - and process each of them into a complex row in my database with many different values. The pdf contains a couple values in the headers and many more in a table-like layout. I will need a couple string parsing processes to get through all that. No idea how to get it to read the pdf name and put that in one cell in my db.But the data inspectors are useless. The interface says the transformation was successful - but nothing was written to the output.txt.So - issues:- how to process multiple texts- how to see what's going on so I know it's working properly

4
jakemolnar
6 years ago
P
peaches50
asked in Data
How do I create a working .dwg file from a paper copy of a drawing that I scanned and saved as a PDF?

How do I create a working .dwg file from a paper copy of a drawing that I scanned and saved as a PDF?

1
redgeographics
Evangelist
6 years ago
M
michuup
asked in Data
Convert osm pbf to shapefiles

hi, what I do wrong when convert osm pbf to shp? i try to create a simple workspace but i got nothing = and i try manual add reader and writer, and i have errors = can anyone help me?

4
danilo_fme
Evangelist
6 years ago
esaka
Participant
esakaParticipant
asked in Data
FME Server smallworld workbench error

Hi,FME Server is not able to lunch the workbench which is able to work correctly via desktop.If I select only one reader+writer that is able to work. However when I launch the whole reader-writer, than is getting error. I have attached the Smallworld-emacs error and the log file.My goal is that I would like to download the whole data from SMALLWORLD to SL3/FFS any different database format daily via fme server schedules. I have prepared a workbench you can find below. 1 million records include.

7
lars_de_vries
6 years ago
A
arka
asked in Data
TXT file+statistics

Hi,I have a TXT file (point cloud) containing 2 columns col1=X and col2=Y.I want to create groups every 1cm (according to X axis) and compute for each group Xmean, Ymean, Ymin and Ymax.I think it is necessary to create a point cloud and then create slice of points (every 1cm) but I don't know how to do this.Thank you for your help.

2
A
6 years ago
M
mvdorst
asked in Data
ECW spatial data: check if it's there and store it in postgis raster

Hi,I'm new to spatial data and ECW files. I've got a ECW file that needs to be inserted into a postgis raster database. All the proper extentions are installed on the database side. I currently load the file into a RasterTiler and then into a postgis writer. The rastertiler was needed otherwise it would not load the file into the database. I'm not sure when raster size I should use, but it's currently set to 256 by 256. But when my colleague tries to view the file from the postgis raster database with several different GEO applications, the error always says that spatial data is missing. So: how to I check if the source file has spatial data? Do I need to change something to the postgis raster writer? Or maybe to the RasterTiler transformer? Thanks so much! In advance for any help.  

1
fmelizard
Contributor
6 years ago
D
delac321
asked in Data
Convert from Esri shapefile to PostgreSQL database but result is missing geometry.

Hi, Im trying to convert my from Esri shapefile to PostgreSQL database, but the result is not good because the geometry is gone. Im using FME for the first time and dont know where is the problem. Please help!

4
david_r
Influencer
6 years ago
C
caddrafter
asked in Data
How to get Shape files to convert to DWG with elevations?

23
redgeographics
Evangelist
6 years ago
I
ilmachairas
asked in Data
ECW writer: This format does not support writing the RGB/RGBA bands in the raster with other extra bands.

I have an 8-bit raster image (jp2) which I need to convert to ecw format. A fatal error occurred and the message was "ECW writer: This format does not support writing the RGB/RGBA bands in the raster with other extra bands. Please remove the extra bands and try again". How can I fix it?

1
LizAtSafe
Safer
6 years ago
jhawks
Contributor
jhawksContributor
asked in Data
Kml View Setter: Is there a way to remove the Navigation Tree Name? It won't accept no value. I want to remove the X in attached screenshot.

2
jhawks
Contributor
6 years ago
W
wedea
asked in Data
OGC GeoPackage metadata: geometry registered as a common geometry type: "geometry"

Whenever I write features into a GeoPackage Table, this table is registered in the GPKG_GEOMETRY_COLUMNS table. FME registers all the tables I create with geometry_type_name: GEOMETRY. I expected that FME would register my table with point features as geometry type POINT, tables with polygon features as POLYGON, etc., as prescribed in the GeoPackage-specification. Tables registered as GEOMETRY are recognized by QGIS as a feature class with unknown feature type. Which makes sense.How do I enforce FME to register the correct geometry type for my tables, preferably in a workbench with a dynamic reader (PostGIS) and writer (GeoPackage)? Wim

4
W
6 years ago
G
gislogan01
asked in Data
How do i convert multiple feature classes to .kmls

I tried to convert multiple feature classes to .kml, and using a test filter assign color coding then out to a writer . but the end result is just one kml. how do i get a klm for each feature class.

1
danilo_fme
Evangelist
6 years ago
jhawks
Contributor
jhawksContributor
asked in Data
KMLViewSetter trouble getting it work, see workbench:

https://www.safe.com/transformers/kml-view-setter/I've been looking at the KMLViewSetter transformer, but when I set lat/long values in there it continues to open to the default location in Google Earth. I've tried using the values in the doc example, but it still opens to the default location.  I might be missing something - but has anyone got this to work and could help me out?FME(R) 2018.1.0.0 (20180321 - Build 18442 - WIN32

5
jhawks
Contributor
6 years ago
D
dkirouac
asked in Data
Error updating arcgis online feature service

When trying to update a hosted feature service (truncate,insert) that was creating from ArcGIS I get an error that the service name already exists. I have a feature service that I create with FME using the same data and I can update that service without any problem.Is there any reason why I can update the service created with FME but not the service created from ArcGIS Desktop? The properties on the services are the identical and owned by the same account.

5
lars_de_vries
6 years ago
W
wjloy
asked in Data
Process still runs after successful translation in Desktop 2017.1 writing to ESRI SDE db

Using this to grab data from an XML feed and writing to ArcGIS SDE database and the process doesn't stop after successful translation. Any help would be appreciated, thanks!!Same issue

2
W
6 years ago
yonasfme
yonasfme
asked in Data
The error number from ArcObjects is: '-2147155559'.

I'm loading data (450k polygons) from FGDB into SDE. Versioning is enabled.The Transaction Type is a Versioned Edit Session and my Writer Mode is Insert. I have Drop Table as No and Truncate Table as Yes. The writing is very slow and after running for 3 hrs and 43 min the transaction failed with the following error:An error occurred while attempting to start an edit operation. The error number from ArcObjects is: '-2147155559'. The error message from ArcObjects is: {Failure to access the DBMS server [08S01:[Microsoft][SQL Server Native Client 11.0]TCP Provider: The specified network name is no longer available. ] [sde.DEFAULT]}Here is the log file: Any idea why it is throwing that error?Thanks.

8
yonasfme
6 years ago
M
michael0312888
asked in Data
Adding custom parameters to an IFC Object

Hi, I would like to take a .IFC file and add some parameters to a 3D object. I have an extract of the coding used when exported from a software platform but I wanted to know if I could take an existing IFC into FME, Expose all of the objects within the file and add parameters to an object taken from a spreadsheet?#1615=IFCRELDEFINESBYPROPERTIES('9637335e-cf0f-59a1-8f9b-a375089be97f',#2,'Property Association','IfcPropertySet associated to element',(#33),#1609); #1616=IFCPROPERTYSET('1e82cc66-a22a-63d7-9d26-f8590c0c95ad',#2,'DWF - User attributes','',(#1617,#1618,#1619,#1620,#1621,#1622,#1623,#1624,#1625,#1626)); #1617=IFCPROPERTYSINGLEVALUE('User Attribute 01',$,IFCTEXT('Project X'),$); #1618=IFCPROPERTYSINGLEVALUE('User Attribute 02',$,IFCTEXT('L8'),$); #1619=IFCPROPERTYSINGLEVALUE('User Attribute 03',$,IFCTEXT('Staircase'),$); #1620=IFCPROPERTYSINGLEVALUE('User Attribute 04',$,IFCTE

1
daveatsafe
Safer
6 years ago
S
samhayashi
asked in Data
Feature holder not working

Hi,I have a workspace that makes an initial SQL database call to write to a table that generates an id key that subsequent database writers require. The problem is that the initial call doesn't seem to close/finish writing before the subsequent calls look for the id key. I have placed a feature holder before the subsequent calls but if the records fall below a certain number the process fails (and the initial table is not populated). Over a certain number or records the process is fine. Any ideas?Thanks!Sam

3
S
6 years ago
H
harknessandrew5
asked in Data
Problem converting Revit (RVZ) to Cesium 3D Tiles.

Hello, I am trying to convert a Revit model in RVZ format to a Cesium 3D tile. However when the transformation is run I get a warning that says "Geometries which cannot be converted to a triangulated mesh will not be written" for some of the geometry. Is there anyway to fix this or to tell way some of the geometry does work and some of it doesn't?

2
H
6 years ago
S
simon11
asked in Data
set extent when writing .dwg

Hi everyone. I write data using AutoCAD DWG/DXF writer. Everything works fine but after opening the file, users allways have to click "fit to view" (microstation) to see the data - and the ones that are not very familiar with microstation don't find the data at all. Is there the possibility to write the data's extent to the file? Maybe by using one of the various autocad_... format attributes? Thank you very much fot your help! Simon

4
lars_de_vries
6 years ago
F
frsisani
asked in Data
Georeferenced PDF

Hy I want to know if it is possible to georeferencered the PDF before to use the PDF reader to obtain in the output a DWG or Esri GeoDb with the correct coordinates system thxFrancesco

4
F
6 years ago
G
garydlester
asked in Data
Storing CAD data in postgres FME Cloud

I am trying to add geometry columns to a postgres instance on FME Cloud and I am getting this error.ERROR: function addgeometrycolumn(unknown, unknown, unknown, integer, unknown, integer) does not exist LINE 35: SELECT AddGeometryColumn('cad_qa','WATERLINES','geom',2277,'...Here is the select statement, it is from an FMEpedia github project,SELECT AddGeometryColumn('cad_qa','WATERLINES','geom',2277,'LINESTRING',2);

1
takashi
Contributor
6 years ago
lazarlubomir
Contributor
lazarlubomirContributor
asked in Data
Why is configuration file parameter lost in FeatureReader in FME desktop version 2018.0?

Hello,I need to work with OSM PBF, but in FeatureReader tranformer in version FME Desktop 2018.0, there is missing configuration file parameter (e.g. INI file) for OSM PBF. But in version 2017.1, as you can see below, the parameter is there...Why is this paramater missing? If it is purpose, how can I solve substitution of configuration file?Thank You so much!Lubo

6
jakemolnar
6 years ago
esaka
Participant
esakaParticipant
asked in Data
FME server does not recognize the custom coordinate system but I have

Hi,I have a FME Server and I would like to use jobs function. But the my workbanch is not working in the fme server. Normally it is able to work from fme dekstop. Server says that there is no defined Coordinate but I have. ITRF96 was added as custom. My question is how han I fix the problem.***********************************************************FME API version of module 'NULL' matches current internal version (3.8 20170315)MULTI_READER(SWORLDSWAF_5): Done reading 0 features from 2 readersCreating reader for format: Smallworld 4/5Trying to find a BUILTIN plugin for reader named `SWORLDSWAF'Trying to find a DYNAMIC plugin for reader named `SWORLDSWAF'FME Configuration: Source coordinate system for reader SWORLDSWAF_6[SWORLDSWAF] set to `ITRF96'Coordinate system named ITRF96 does not exist.Failed to get parameters for coordinate system `ITRF96' -- No definition was found for coordinate system `ITRF96'This FME edition does not recognize the `SWORLDSWAF'

3
esaka
Participant
6 years ago
R
richardherklots
asked in Data
assign variable for excel sheetname

I am reading in shape file and using attributepivoter to calculate stats. I then write the results to a separate excel sheet for each source file. After the attributepivoter I can no longer assign the source filename (fme_basename) to the sheet name in the writer

1
f.kemminje
Contributor
6 years ago

Badge winners

Show all badges
29,719
Posts
Terms & ConditionsCookie settings