Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,703 Posts
24,707 Replies

When you subscribe we will email you when there is a new topic in this category

6703 Posts

Recently active

Most replies Most views Newest first

Empty tables when writing

Hi FME Community I have encountered an issue that I cannot find the solution for. I have a Reader -> Writer setup. Reading from a MSSQL db and writing to a Postgres. When reading the table and making a preview, everything looks as it should be. Then I run the transport and looking at the preview of the writer after a successfull termination of the task. And this is what I see Even though I've made a Scheme called 'dbo'. and the DB-connection setup is successfully connected. The table isn't to be found in the PG-db. I've encountered this a couple of times, especially when writing to databases, however I cannot find any consistency in when it will or won't populate the tables. I've tried to make a transformer inbetween, sometimes it works, sometimes it won't. Sincerely

I would like to generate some columns and rows with even and odd numbers

Hello.I have a next situation.I own a list in Excel with the streets of a certain area of Romania (Bacau County)I take the example this streets : AGUDULUI, ALBA IULIA and ALECU RUSSOOn AGUDULUI Street I have the even numbers from 2 to 10 on one side of the street and on the other side of the street are the odd numbers from 5 to 13.Tabel 1.Where:MIN_EVEN – the lowest even number on the streetMAX_EVEN – the highest even number on the streetDCOUNT_EVEN – the number of even numbers appears on the streetMIN-ODD - the lowest odd number on the streetMAX_ODD – the highest odd number on the streetDCOUN_ODD- the number of odd numbers on the streetTabel 2.I would like to create some lines and columns (as I put in Table 2 – but may look different) and I wish to populate with the even numbers also with the odd numbers.Thank you very much.Sorin Duru

How to remove boundary which is fillup with solid in google earth?

Hi, I am new to FME and am excited to get started. I have a task that should me simple, however I am not sure how to go about it. Here i attached one picture where the White color is full of my study area. I do not want to see this color. I have to inform that i make a boundary to my dxf file when it is converted in kml file may thats why it is full of White color in my study area beacuse other part is not fyllup with white color.Do you have some good solutions?Thanks!

brandonguoContributor

ECW reader: Failed to retrieve data from the source dataset

Fail when converting ecw file. Got error message after FFS writer: Completed 100% of intermediate processing____________________________________________________________FFS writer: Completed 0.18% of intermediate processing... Last line repeated 3 times ...ECW reader: Failed to retrieve data from the source datasetStored 1 feature(s) to FME feature store file `J:\\FME_TEMP\\wb-cache--PNXtVL\\Main_EsriReprojector -1 3 fo 0 REPROJECTED 0 66d791aea5c163f33c7ab04cb5e7a95a424ee21e.ffsupdating'Saving spatial index into file 'J:\\FME_TEMP\\wb-cache--PNXtVL\\Main_EsriReprojector -1 3 fo 0 REPROJECTED 0 66d791aea5c163f33c7ab04cb5e7a95a424ee21e.fsi'Finished saving spatial index into file 'J:\\FME_TEMP\\wb-cache--PNXtVL\\Main_EsriReprojector -1 3 fo 0 REPROJECTED 0 66d791aea5c163f33c7ab04cb5e7a95a424ee21e.fsi'EsriReprojector_REPROJECTED Feature Recorder -1 2147614723 (RecorderFactory): Failed to write feature data to `J:\\FME_TEMP\\wb-cache--PNXtVL\\Main_EsriReprojector -

How to define some values in Excel Header with attributes?

Hello, I create a workspace from DWG to an Excel File with a Template File. I fullfill columns CODE, X, Y and Numero. I wish to complete in the header the values below with attribute I have from a Block in DWG : - N° mesurage - Affaire(s) - Commune de - SectionCan you help me to make this or can you give me an other way? Thank you Best Regards

dor1411993Contributor

Problem with the Autodesk AutoCAD Map 3D Object Data reader

Hello everyone,I've had a problem with Object Data readerfor a few days now.There is a file with objectdata on it that I want to process, and keep it as AutoCAD Map 3D Object DataThe problem is that no matter what I do, he always gives me this error message:Even if I'm not doing anything in the process, just passing from reader to writer.Does anyone have a clue what it could be?Attached is the DWG file I want to process.Thanks!

Vertex problems in my Dwg output file in Writer under FME 2018

Hello, When I open my Dwg file in autocad I notice that I no longer have any vertex in my output Dwg file after performing the transformations, can you help me recover them? here is my FME file if you could correct it for me or add the transformers necessary for it to work. thank you in advance

CAD to CityGML LoD0 and LoD1

Hi everyone, I'm a new user of FME. i'm trying to create a CityGML LoD0 and LoD1 based on a study area in DWG and point cloud data.I have followed the steps in the links below that are related to my task:https://knowledge.safe.com/questions/56991/citygml-file-with-lod1-and-lod2.htmlhttps://knowledge.safe.com/articles/1353/point-cloud-to-3d-terrain-model-with-buildings-dwg.htmlI can preview the data before the writer and it looks OK, with the footprint and the solids highlighting when one feature is selected but the writer is giving me the error: CityGML Writer: Geometry conversion error - Unable to convert the 'IFMEAggregate' into a single 'IFMESolid' geometry, because the aggregate/multi-geometry has '2' components. CityGML Writer: Unable to convert the 'IFMEAggregate' geometry to match its 'lod1Solid' citygml_lod_name trait. The legal geometries for 'lod1Solid' are {IFMECompositeSolid, IFMECSGSolid, IFMEBox, IFMEBRepSolid, IFMEE

LineString to MultiLineString -> Postgis

Hi there, I'd like to insert data into a postgis datebase. The destination table is already created. Unfortunatly, the translation fails due to a geometry problem : Bulk copy failed on table 'az.eu_collecteur' using delimiter ':'. Error was 'ERREUR: Geometry type (LineString) does not match column type (MultiLineString) CONTEXT: COPY eu_collecteur, ligne 1, colonne geom : Â« 010200002015550000020000007B14AEC7C07C2041AE47E17ABE0403410681...' A fatal error has occurred. Check the logfile above for details How can I transforme my source data form LineString to MultiLineString ? Any ideas ? thank's in adavance.

bwnInfluencer

GEODATABASE_SDE Dynamic Reader - Reading Long Data Types as Text?

Just spotted this problem in my corporate data extraction workflow.So it is pretty straightforward, a dynamic ESRI Geodatabase SDE FeatureReader that dynamically reads the schema of the Target Feature Classes/Tables from the SDE server.However, it appears to struggle when there is a Domain on the Field. Where the option to "Resolve" the Domain to a separate "_Resolved" attribute is used that contains the Domain Description values, it instead reads the Schema for the relevant base field as TEXT rather than as LONG (meaning both Base attribute and the Resolved attribute get a TEXT data type assigned in the Schema Feature)That creates an issue when flowing that to a Dynamic FeatureWriter which uses the (incorrect) Schema Feature Data Type to write it out to a Text field rather than a Long.Anyone got any Workarounds? I'm thinking the only way to do it is to manually override the Data Type Attributes in the Schema Feature by doing a separate Schema Reader to override

Extracting LAS by elevation of points.

Hi everyone, I'd like to divide (extract) my point cloud data (LAS, forest) by elevation of points, e.g. one dataset would be points from 0-2 meters, 2-5, 5-10, etc., please share a good and simple tool in FME, thanks in advance!

Raster of surface (buildings) to point cloud extruded to ground

Hi, I guess the title is pretty self explanatory, here's some screenshots.Went from this surface model, that has been clipped by shapefile of buildings with average Z value of pixels within each of polygonsto this... (tilted view)and need to extrude the point cloud to preferably ground or at least a fixed value that will go through the ground (might clip them later, not really necessary). Basically trying to to "extend sides to ground" function from Google Earth Pro but with point cloud (I do have the terrain DEM as well, doing this approach because I don't want vegetation in my final result and the terrain DEM has better resolution)I'm pretty new to FME, so simpler, more begginner-ish solutions would probably be better.

Reading ECW version 3 and writing ECW version 2

I am reading a large ECW version 3 file into FME and then clip it. After this I want to write in to an ECW version 2. Everytime when I do this I get the following warning: ECW writer: Existing value for creation option 'ECW_FORMAT_VERSION' was '2'. Overwriting with the new value '3'.Is there any way I can turn off, the automatic overwriting of the version number? I really need the final output to be an ECW version 2.Thanks in advance!

sigtillContributor

FMECloud - disk space usage

UPDATE: The error was not any hidden files in FMECloud - but rather that the process using AzureFileStorageConnector downloaded a whole FOLDER instead of individual files. So instead of downloading a file of size 0,5 GB - it downloaded all the files in that folder (50GB). Havent figured out why yet, but might be something between the screen and the person sitting in front of the computer. I have a FMECloud instance with 100GB Primary disk, and it seems according to the Dashboard that 97GB is in use. I can only find roughly 60GB in the DATA-folder. And FME Cloud seems to run the cleanup. So i wonder where the missing 40GB of data is. The projects uses a lot of raster-data, so I wonder if they are cached somewhere, or if the FFS is somewhere. But cant seem to figure out what to empty.Moving to a larger instance might be a solution, but Backup 100 GB, download, start new instance 200 GB and restore takes some time....Would be GREAT to be able to RESIZE the PRIMARY and Secondary disk of F

jsprattParticipant

PostGIS writer: converts 3D geometry to 2D on existing table

When attempting to use an existing table in a PostGIS database, the PostGIS writer is coercing my 3D geometry objects into 2D. I have not seen this issue with a PostGIS writer that uses automatic table creation and the data type for the geom column is defined as GEOMETRY in both cases.I have seen 2 different warnings regarding this:POSTGIS Writer: PostGIS existing table has a 2D constraint, changing input data into 2D datacoerced to 2D in table 'cad.cad_geom'Why are the objects being coerced?Are there writer settings to prevent this from happening?Here is the table definition:CREATE TABLE IF NOT EXISTS cad.cad_geom( id BIGSERIAL PRIMARY KEY, created TIMESTAMPTZ DEFAULT CURRENT_TIMESTAMP, updated TIMESTAMPTZ DEFAULT CURRENT_TIMESTAMP, xchg_ts TIMESTAMPTZ DEFAULT NULL, _refid BIGINT DEFAULT NULL, autocad_block_name TEXT , autocad_block_number INTEGER, autocad_entity_handle TEXT, au

Citygml LoD2 from shapefile with floor, wall and roof features

Hi all,I'm trying to create a workflow for creating LoD2 CityGML from a shapefile of building footprints (and forcing a height attribute) and I am struggling with few issues. I would like to have the buildings composed of wall, roof and floor surfaces but I haven't been able to work out how to compose the surfaces within a single building while also generating the relevant semantic feature types for these surfaces. I'm aiming for something similar to what I want is the LoD2 sample in CityGML 2.0 examples: http://schemas.opengis.net/citygml/examples/2.0/building/Building_LOD2-EPSG25832.gmlSo far, I am simply offsetting a the shapefile to create floor and roof geometries. I also generate a UUID for an gml_id (for the Building) which I thought I could reference from the roof and floor surfaces LoD2 features in order to nest them. However, upon running the workspace, it appears only the Building feature is written out and the RoofSurface and FloorSurface features are ignored.Ca

How to work properly with kml

Hi guys, I do have an issue working with KML on FME. 1) I have a shp file with loads of features and I would like to transform each one of them in one specific kml file. The pic below show us the features I have:I do want to transform them into individual kml files , with an specific name ( i have this information on the file). And I also need that the kml looks like this: I couldn´t manage to make them hollow like this. Can anyone help me?

fmelizardContributor

Teradata Format Greyed Out?

I did everything right to set up the Teradata format in FME. I followed closely the documentation here: https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/teradata_jdbc_spatial/teradata_jdbc_spatial.htm. However, when I start FME, I'm still not able to use the Teradata format. What gives?

Issues with writing to versioned ArcSDE geodatabase

Having a couple of problems writing to a versioned ArcSDE Geodatabase: 1. When trying to import an existing feature type from the Esri Geodatabase (ArcSDE Geodatabase) writer I can connect to the geodatabase successfully and browse to the existing version to select the table I want to write to, but when I attempt to add the feature I get an ArcObjects error that the version is not found. I can import features successfully from sde.Default but none of the versions. This occurs when using a direction connection with OS Authentication, but I can import features when using an sde connection file that specifies the version, but it’s not ideal and I’d like to determine why I’m having issues. 2. When using the ArcSDE Geodatabase reader with the option to create a child version and then do a reconcile and post + delete the child state options on the ArcSDE Geodatabase writer, the edits and the reconcile and post are successful but I get an error when the translation attempts to delete the

Transparency issue while transforming OBJ to GLTF.

I tried converting a OBJ to GLTF.It got converted properly.But the gltf output is transparent.the mtl of OBJ is:newmtl textureNs 26.4d 1illum 2Kd 1 1 1Ka 0.2 0.2 0.2Ks 0 0 0map_Kd nzl_akl_003.png and the gltf output material is :"materials" : { "mat_0" : { "name" : "texture", "extensions" : { "KHR_materials_common" : { "technique" : "PHONG", "values" : { "ambient" : [ 0.2, 0.2, 0.2, 1 ], "diffuse" : "t_0", "specular" : [ 0, 0, 0, 1 ], "shininess" : 128 }, "transparent" : true } } },The transparency of the gltf is set true by default.How to change this while conversion.I dont want the model to be tr

Autocad map od reader entity id attribute being dropped

I have a workbench that I have been using for several days. all of the sudden when I open the workbench it will not run. I discovered that the reader does not show the exposed autocad_od_entity_key available any longer.if i go to a new workbench and pull in the same data the field does appear.

souryanaContributor

DWG to SHP with associated attributes

Hi, I would like to convert a dwg file to shp file. The problem is that it contains a lot of attribute for each object. I want to convert the dwg file to shp where each object have the associated attribute value. Please see picture below. for example, "CJ" originate from a layer in CAD. I want that layer to have it own column in the attribute table for the SHP file.

Postgres Database not being written to

Hi guys! I'm new to FME. So far the software seems great but I'm having an issue with the data in my database persisting. I have a setup where I've created a CSV reader connected to a Postgres writer. When I run it, everything is ran fine without errors. In the visual preview it shows that the Postgres database has been written to. HOWEVER, when I do a Select * From database in a separate SQL command line, nothing is showing up in my tables. Its as if its not legitimately writing into the database. The connections are right, and this is happening on a local Postgres database I have running. I'm thinking there may be a step I missed? I did this all pretty straight-forward without tinkering with customizations. If anyone could assist or point me to a step-by-step guide for achieving this I'd really appreciate it. I have found similar guides on youtube but nothing for exactly CSV to Postgres. Thanks all!

Shared surfaces in CityGML

Hello there, I'm quite new to FME, and I'm trying to achieve an effective CityGML model of an historical city center in order to carry out energy analysis at urban scale.After some hard work, I managed to transform my Shape file into CityGML LOD2 by merging a set of tutorials and best practices, and the result is satisfying. But at the end of the process I still have a huge dubt: in my final model there is no trace of shared surfaces between buildings, which are extremely important for computation in my case. Building models are in fact "extruded" one by one, with no knowledge of their boundary conditions.I didn't find any reference about this problem, is there someone who could please help me?Thanks,Cristina

XML flatten - holding parent ID

Hi I have a problem in FME desktop 2019.2 that i haven't been able to solve for a while. I have an XML response from one server API and i need to restructure it to Post it to another server on a regular time interval. I am having trouble flattening the XML out and holding the relationship to the parent. Sounds like a common question. I can see many people asking similar questions in the forum however I cannot apply the logic to solve my problem. I assume the solution lies somewhere in the reader or flatten settings. The number of children per entry varies as you will see in the example.In summary:Input is an xml file. I have created an example attached.I need to split this into 2 tables. The first is the client information. The second is the contacts. And the relationship needs to be maintained. I was hoping to use the <client> <name> as the unique key in both tables.Output required is 2 tables or XML files.I would really appreciate any help.

1
...
69
70
71
72
73
74
75
...
269

Page 72 / 269

Badge winners

jpgapdfhas earned the badge Student (Grey)
jpgapdfhas earned the badge Spanish Speaker
jpgapdfhas earned the badge English Speaker
ainohellehas earned the badge Welcome Back
otto-fghas earned the badge Welcome Back

Show all badges

29,733: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK