Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 6,820 Posts
  • 25,126 Replies
6820 Posts
F
frsisani
asked in Data
CSv file

I have A csv file with more 10000000 records how can split into 5 smaller csv file (each with + o- 2000000 refcords) to performafter my actions ?

309
takashi
Contributor
6 years ago
N
nielsvhal
asked in Data
How to extract exact height from .gml file in a correct writer (in FME Workbench)?

am learning FME Workbench/ Data Inspector etc. But exactly I have a question, which I could use some help. My question is: I am working with a GML file. It has uploaded in FME Data Inspector. From this file, which includes BRepSolid 3D objects, I would like to get the exact heights (as an feature). Than I want to save this data as a shapefile/geojson or something which I can than use in Qgis. Untill now I have not had any succes. Can you give me some tips or links to tutorial(s) to learn this? Topics: heights / .gml file / into writer (for example shapefile)

9212
danilo_fme
Evangelist
6 years ago
sigtill
Contributor
sigtillContributor
asked in Data
3d Studio Max

Anyone have some tips working with FME moving detailed buildingdata to and from 3D Studio Max?https://www.autodesk.com/products/3ds-max/overview

210
whkarto
Contributor
6 years ago
N
nlaszlo1976
asked in Data
Unable to use user parameter in user attribute name with Oracle Non spatial writer

When I enter $(user_parameter) as user attribute name, it will be replaced to $_user_parameter_

50
takashi
Contributor
7 years ago
B
bill
asked in Data
FME reader for PDF

Is there a reader for PDF documents?  I would like to be able to use FME to batch convert a number of PDF documents into another image format, like JPEG, so that I can georeference the content.

5510
danilo_fme
Evangelist
7 years ago
I
isabell
asked in Data
Oracle Writer - Error Message

Hello!  Writing to an Oracle Spatial Database I get following error:  Oracle Writer: Abnormal channel cleanup required, likely due to previous error  What could be the problem?   Thanks for your help, regards  Isabell

490
fmelizard
Contributor
7 years ago
W
wilsonm2001
asked in Data
Excel to Shp Attributes

Hi GuysI am looking for a workflow to Create SHP file attributes from an excel spreadsheet. The problem I am having, is I can only see a way to extract column headings as Attributes. How do I take attribute titles from the cells below the column heading. I hope that makes sense....Basically, I have an Excel document with Standard Asset data that needs to be included in our SHP files according to discipline. So I have used FME to Test for "Subclass" & "Item_Name", which works great, then I want to extract that list in the "Attribute_name" column to SHP attributes.ThanksMartin

210
I
7 years ago
F
fme_blog
asked in Data
Writer Adobe Geospatial PDF: Feature Type name

Hello,  I'm using the Writer "Adobe Geospatil PDF" and I want to generate the Feature Type Name by using @Value(fme_basename).  The result (filename) is "@Value(fme_basename).pdf". Any idea? Thank you very much!Bernhard

60
danilo_fme
Evangelist
7 years ago
C
cj
asked in Data
How to read an ArcGIS Server map service?

Trying to read an ArcGIS Server (10.3) map service. There doesn't appear to be a a dedicated reader for this, unlike the ArcGIS Server feature services. Have also tried the WMS reader, with no luck. I want to ultimately write the output to a file geodatabase. How have other people achieved this work flow?

3410
C
7 years ago
fmeuser_gc
Contributor
fmeuser_gcContributor
asked in Data
Insufficient memory available usage

I get this error for only this scheduler job. All other jobs fine. Insufficient memory available -- error code was 2 - please read the FME Help section 'Adjusting Memory Resources' for workarounds.Nothing much to clean up in /temp folder. How can I make this job run?

660
M
7 years ago
B
borochri
asked in Data
FME Citrix XenApp - Quick Translator

I'm running Workbench 2016 - 32 bit on Citrix XenApp v 6.5. and use quick translator to export Smallworld 5.1 data to .dgn format. How do I configure the port in my .fmw file to use the port assigned to my Smallworld session.

70
B
7 years ago
R
robertdbuckley
asked in Data
Tiff to ECW problem due to BAND 0 being gray16

I have a number of 16bit RGB raster images which need to be converted to ECW format. The images are displayed perfectly in ArcGIS and have the following attributes.rows and columns: 1506, 2051 No Bands: 3 Format: TIFF Pixel depth: 16 Bit Compression LZWWhen I load the Tiff in FME 2017 and inspect it, it is rendered black with the following information:rows and columns: 959, 250 BAND 0 (Gray 16) BAND 1 (UINT 16) BAND 2 (UINT16)My translation to ecw fails due to "Unsupported band interpretation 'GRAY16'". How can I resolve this?

320
helmoet
7 years ago
R
reachmj
asked in Data
Update filegeoDB table field

Hi,I am trying to update a field value of a ESRI filegeodb table (v10.2.1).I have a table called 'Test' with several columns.For example the table contains 100 records with some voltage value ranging from 1 - 100I want to update these record's 'classification' field depends on my filter condition.I would like to read this filegeoDB and filtering the records and trying to update the same database table's classification field (not the entire row) with matching column.If its an oracle DB i can do this either by using DBUpdater or SQLExecute.Any clue or hints will be much appreciated...Thanks,Mari...

60
takashi
Contributor
7 years ago
surbhi
Contributor
surbhiContributor
asked in Data
DateTimeConverter - FME Server

I am using the DateTimeConverter in a workbench to convert date and time from an Oracle database to an ArcGIS Online feature service. The autodetect feature works in the workbench and the translation is successful. However, when I upload the workbench to the server, the DateTimeConverter is unable to autodetect the date/time value from the input and the translation fails. Has anyone faced and resolved this situation?

60
surbhi
Contributor
7 years ago
M
mortenag
asked in Data
Reading Multiple text files

I have an attribute called text_lined_data that contains 6 data columns. How do i extract that information into 6 columns and line one as header?

130
jdh
Contributor
7 years ago
havmoejbv
Contributor
havmoejbvContributor
asked in Data
Text field definitions truncated in reader or writer?

I'm having a bit of an issue with text fields being truncated, and I can't figure out why...The fields are all text fields of varying length, with writer definitions copied from reader, and for some reason they all come to the writer truncated to 4 or 5 character's length?!This is how the read attribute info looks (reader is GDMMAPPERQUADRI):...and here's the writer (Writer is GEODATABASE_FILE):Note now the attribute LEDNINGSNETTVERKSTYPE is changed from length 13 to length 5. This behaviour seems consistent for most attributes, but not all (like OBJTYPE in the example).I tested a different writer, just to see (ESRI Shape) and it's the same there, also doesn't matter if I port directly from reader to writer or if I mess round with the data inbetween. Is it the reader that "sends the wrong signals", despite the correct attribute definitions being listed?

4814
david_r
Evangelist
7 years ago
C
chappell
asked in Data
Unable to expose attribute in FFS file

I have an FFS file (created from a v7 DGN). This file has an attribute named "multi_writer_id" that contains the FFS file name. I can see this attribute in the data inspector but am unable to expose it with the AttributeExposer. I want to fan out the writer according to this attribute but because it cannot find the attribute, the result is a file named "NULL".Any insight into what's happening?

70
jdh
Contributor
7 years ago
S
saqibamin
asked in Data
Pick List in Excel Template

I have an Excel Writer writing outputs of a workspace into a spreadsheet, I have also provided this writer with the location of an Excel Template which also happens to be an xlsx file as the extension of the writer and template need to be the same. In my template file I have a picklist in one of the columns which contain different values, this was enabled in the Data Validation menu of Excel. The picklist works as expected in the Template, after saving and running the workspace the output has all the correct values in the spreadsheet, however the column which should have picklists doesn't contain these and only has the column name. How can I enable this to carry through from the template to the actual writer?

260
S
7 years ago
farfar
Contributor
farfarContributor
asked in Data
How to intercepte verify if shp file is empty?

Hello,My fmw used a shp file reader. If this file is empty, ican't get error. Have you any idea to intercept that the file is empty? Thanks an advance.

30
farfar
Contributor
7 years ago
runneals
Contributor
runnealsContributor
asked in Data
Blob to Geodatabase

I have FME reading attachments from AGOL and writing them to a FGDB or SDE GDB. The problem that I'm having now is that FME isn't writing the blobs to the file geodatabase in a way that esri can handle them.The first screenshot is a directly downloaded database from AGOL. The second screenshot is from the database that I reloaded data with FME. The first screenshot allows you to view attachments, while the second screenshot doesn't allow me to view attachments.Thoughts @Mark2AtSafe?

1070
lars_de_vries
7 years ago
V
vishnuedakkat93
asked in Data
is it possible to transform a cylindrical hollow pipe into citygml as a hollow structure?

10
V
7 years ago
T
thehimanshu
asked in Data
Fatal error after termination. Why is that?

Here's the output:  Terminator(TestFactory): Terminator: Termination Message: 'PARCEL_LIMIT_EXCEEDED'Terminator: Termination Message: 'PARCEL_LIMIT_EXCEEDED'Bridge failed to output feature on tag `PYOUTPUT'f_218(PythonFactory): PythonFactory failed to process feature=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-Feature output statistics for `FFS' writer using keyword `W_1':=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features Written=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-==============================================================================Total Features Written 0=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-Successfully closed POSTGRES database reader... Last line repeated 5 times ...Closing the Geodatabase reader... Last line r

480
R
7 years ago
A
asuxwq1991
asked in Data
Transform GDB model to Cesium 3d tiles

I'm trying to convert my GDB model, which is modeled in City Engine, to Cesium 3d tiles. Both reader and writer are implied with default settings. The transformation process goes smooth, I found that the output models are grouped in different data set. So every time I click on one model in Cesium, a group of models are triggered and all the model share the same attributes.What I am looking for is to keep the original amount of models after transformation, so they are independent and hold their own attributes. What settings are needed to make it work for me?

690
A
7 years ago
redgeographics
Celebrity
redgeographicsCelebrity
asked in Data
Reaching out in French

Hi,Can somebody who speaks French reach out to @ferjanibarour (email: ferjanibarour@gmail.com), he's been asking questions here and has also contacted me directly. @david_r maybe? Or somebody French-speaking from Safe.The problem is that his questions are very generic and I fear there's a big language barrier. I recommended him to contact Veremes but apparently he hasn't had a response yet.

20
david_r
Evangelist
7 years ago
A
azhar
asked in Data
FME Server Running Failed on esrireprojector

Dear FME Community   Could you please advice me on this error..FYI, i'm already develop the workbench for coordinate transformation and its running successful on the desktop version. once i'm upload into FME server, the error message as follow  "EsriReprojector: Reproject: Could not reproject the geometry of the preceeding feature: Reprojector: Invalid reprojection parameters"  2014-10-07 15:50:27|   1.9|  0.0|INFORM|The OGC definition of the FME coordinate system '_NonEarth_Meter_1' is 'PROJCS["Kertau_RSO_Malaya_Meters",GEOGCS["GCS_Kertau",DATUM["D_Kertau",SPHEROID["Everest_1830_Modified",6377304.063,300.8017]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]],PROJECTION["Rectified_Skew_Orthomorphic_Natural_Origin"],PARAMETER["False_Easting",804671.2996],PARAMETER["False_Northing",0.0],PARAMETER["Scale_Factor",0.99984],PARAMETER["Azimuth"

200
richardatsafe
Safer
7 years ago

Badge winners

Show all badges
30,426
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.