- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,811 Posts
25,090 Replies

When you subscribe we will email you when there is a new topic in this category

6811 Posts

IFC layer type in Autocad

Hey everybody,recently I'm getting into converting 2d autocad plans into a simplified 3d model. So far I'm able to create a model. Now i have checked the tutorial of @daveatsafe in converting a dwg to ifc with rooms but I'm still having a question.How do I write the autocad layer property to an ifc file that I use in BIM dwg. Because at this moment whatever I'm trying I'm getting all the entities on layer 0.Thanks in advance,Andreas

260

4 years ago

rbovardContributor

asked in Data

Why the File Copy writer doesn't log an error when the file doesn't exist?

Hi there!Do you know why the File Copy writer doesn't log an error when the source file doesn't exist?It only logs an warning:File Copy Writer: Ignoring the destination filename '<file>' because the source dataset '<path\to\file>' was not a file.It was problematic in my case because I monitore only the errors in the log files... :/Thanks in advance for your feedback,Rémi

Creatig arc with pythoncaller

Hi everyone, I'm trying to create polygons with arcs (airspace) from aixm 4.5 data. I found this extremely useful workspace from @takashi i here: https://knowledge.safe.com/questions/56273/how-to-create-a-good-geometry-with-coordinates-xy.htmlbut I'm having troubles with the pythoncaller to create arcs. While it works pretty well on some data subset (ead_identifier contains _EI) for others I get a "math domain error"(ead_identifier contains _EG) and I can't figure out why.Any help would be appreciated

4 years ago

diogosanto

asked in Data

Update a Postgres database from Excel Spreadsheet once a day

Hi everyone! I am new to the FME World and I am testing the following scenario:Take a spreadsheet with lots of fields as input of several tables in a Postgres database. This unload should occur once a day.Has anyone expertise on this?Using FME Workbench 2019.1, my approach is to place the xlsx file as a reader. Then, use an attribute manager to remove certain fields and leave only those that are required for a specific table abc. After, I add an Postgres writer to to receive such information.Is this a good approach? How/where do I drive the "insert" to a specific table? How it the scheduler implemented (if possible)?Thanks a lot!

910

4 years ago

takashiContributor

asked in Data

MSWORD Writer: Is there a way to control Paragraph Spacing?

Hello,FME 2020.0.1.0 build 20218 Win64I'm trying to create MS Word documents with the MSWORD writer. Everything is good for now, except Paragraph Spacing.Usually we prefer to set "Compact" or "No Paragraph Space" in any documents, but the MSWORD writer seems to always set "Open".-- from a web page in the Microsoft siteI know that the Paragraph Spacing setting in the base document would be propagated to the destination document if you set the Base Document parameter in the writer, but in the current project I don't want to use a base document.Is there a way to control the Paragraph Spacing without using Base Document?

Reading BLOBs from Access DB

Hi,I have attachments (pdf, jpg, doc, txt) which are stored in Access DB as BLOBs.I tried to use template from link below to extract files. Files have been exported but I cannot open any of them. Except of *txt or *doc where I have only a binary information, like "4D5343..."https://hub.safe.com/publishers/safe-lab/templates/read-blobs-from-a-database-and-write-out-files In AttributeFileWriter I used 'Binary (fme-binary)' encoding for JPGs and 'UTF-8' for txt, doc and pdf.For JPGs I tried also use a RasterReplacer (JPEG format) to decode a binary attribute, but all records were rejected.I'm using FME 2019.1 What am I missing? Thanks in advance!

If RVT file reading fully supported yet?

Hello, new to FME here,I have to convert an RVT file to a point cloud file (x, y, z, r, g, b), but I haven't been able to extract color. I know this should be really simple, but I haven't been able to find much of anything on the RevitNativeReader. I saw a couple posts from 2019 that said the format was still in development, but I figure color has to be available somehow. I've been able to chuck the RVT features into a PointCloudCombiner and extract coordinates, but how would I get the color of each point? Do I need to manually map materials to colors? My output file says everything is black, so something must be going wrong.

4 years ago

kenant

asked in Data

FME Server 2019.1 Active Directory 'An error occurred while communicating with directory server (8) ... The server requires binds to turn on integrity checking if SSL\\TLS are not already active in the connection'

Hi all,I have been having an issue in an evaluation copy of FME Server 2019.1, where I have been attempting to connect to an Active Directory instance but have been getting 'An error occurred while communicating with directory server (8)'.I've included some logging below (with domains and URIs removed>. I've not been able to find any resources which address this issue - is there any kind of configuration in FME Server that I've missed?Mon-20-Apr-2020 05:36:42.672 PM INFORM RequestHandler-Thread 401933 : Successful login by user admin Mon-20-Apr-2020 05:36:42.714 PM INFORM pool-5-thread-1 408078 : (Active Directory) Connecting using directory configuration "<domain>"... Mon-20-Apr-2020 05:36:42.720 PM INFORM pool-5-thread-1 408001 : (Active Directory) Connecting to an available server in ( <domain.name.local>:389 )... Mon-20-Apr-2020 05:36:42.727 PM INFORM pool-5-thread-1 408002 : (Active Directory) Successfully connec

490

4 years ago

jstamContributor

asked in Data

Socrata writer using calendar_date writes the schema but not the data. Changing it to text it works, but is not a date.

I am trying to upload to our Open Data site powered by Socrata. I did enough research that I saw I would need to change the data to something Socrata would accept. But if I tell the writer it is a 'calendar_date' field, the schema is uploaded, but no records are created.

4 years ago

lucas

asked in Data

Change the layers of a Dwg file on FME 2018

Hello, I have a dwg file in Reader with existing layers. I would like to know if you know how to match the Dwg file in Writer again. I use ShemaMapper this to have worked, however in output Writer I always have the same layers. Please help me if you know a solution.

Merge a GeoTIFF and a CityGML file into a single SketchUp file

Hello,I'm trying to merge a GeoTIFF orthopotography file and a CityGML file with into a single SketchUp file.With FME Workbench, I have visually the result I want in SketchUp: Do you have an idea of how to do this?Thank you in advance!

How to export WFS files to Blender? Tried OBJ and FBX.

I'm in a serious dead end - whatever I do, I can't export files with FME that would show in Blender. I have tried to export both in OBJ and FBX, but they don't appear. I can import the file, but nothing shows. My original file is in WFS format and looks just like it is suppose to in the FME data inspector. When I create a writer it makes the files and they appear in the folders they are suppose to. However when I try to open them with Blender, Unity or with Autocad I can't see any buildings that I exported. I can just see the contollers, looks like empty game/3d object. Can someone share their workflow when importing to blender 2.8? Is there some tickbox or selection that I should use? Oh the same file OBJ file I have managed to open with 3D Builder, but the 3D builder asks me to locate every singe texture surface (over 20 in one element) separately. Does this give any hints what I'm doing wrong with OBJ conversion? I only used the 3d builder for testing and I nee

310

4 years ago

fmeuser_gcContributor

asked in Data

Attribute definition names truncated in SHAPE file writer

Workspace has just ESRI Geodatabase reader and SHAPE file writer (FME 2019 version) as I'm trying to write to a shapefile.In Shapefile writer, few attribute definition names are being shortened(truncated) but retains the same data type(as reader). Tried to rename those shortened attributes(in writer), but still it reverts to shortened version. Thereby causing difference in schema definition between reader and writer.This is the case for all different types of Attribute Definitions - Automatic, Manual, Copy from Reader..I think I've tried possible workarounds, but still same issue. Any thoughts please? Thanks!

What is the purpose of the extra xsi_nil attributes from a GeoServer WFS source?

Can anyone explain the purpose of the extra xsi_nil attributes that accompany a Web Feature Service (WFS) data source?For example, when I create a WFS reader in FME for the topp:states demo layer of a stock GeoServer, the resulting table schema in my FME workspace includes extra attributes - one for each native attribute - named <attribute>_xsi_nil. Here's a screenshot highlighting the fields in question:The data type for all of these xsi_nil fields is xml_boolean. This happens for all WFS layers I consume from a GeoServer.What is the purpose of these extra fields?And is there a way to configure the reader - or the GeoServer layer - to not cause these extra fields to be created?Thanks

763

4 years ago

fmeuser_gcContributor

asked in Data

Uploading a Zipped shapefile to SFTP server on a schedule

Hi,I'm working on creating a workspace with ESRI Geodb reader(or Feature reader) and writer for creating zipped shapefiles (with dynamic naming convention to zipped shapefile like yyyymmddhh_export for every run on schedule). The idea here is to have 'yyyymmddhh' dynamically updated for filenames whenever it is created on a schedule.Finally upload those files to SFTP server on a schedule.I've tried this in FME 2019.2 with using FeatureWriter and ZipArchive transformers, but not quite there yet. Finally to upload to SFTP, not sure if FTPCaller is better option or Automation with 'Upload to SFTP' action is viable options. Please suggest if any ideas. Thanks!

4 years ago

chemichael

asked in Data

Empty tables when writing

Hi FME Community I have encountered an issue that I cannot find the solution for. I have a Reader -> Writer setup. Reading from a MSSQL db and writing to a Postgres. When reading the table and making a preview, everything looks as it should be. Then I run the transport and looking at the preview of the writer after a successfull termination of the task. And this is what I see Even though I've made a Scheme called 'dbo'. and the DB-connection setup is successfully connected. The table isn't to be found in the PG-db. I've encountered this a couple of times, especially when writing to databases, however I cannot find any consistency in when it will or won't populate the tables. I've tried to make a transformer inbetween, sometimes it works, sometimes it won't. Sincerely

I would like to generate some columns and rows with even and odd numbers

Hello.I have a next situation.I own a list in Excel with the streets of a certain area of Romania (Bacau County)I take the example this streets : AGUDULUI, ALBA IULIA and ALECU RUSSOOn AGUDULUI Street I have the even numbers from 2 to 10 on one side of the street and on the other side of the street are the odd numbers from 5 to 13.Tabel 1.Where:MIN_EVEN – the lowest even number on the streetMAX_EVEN – the highest even number on the streetDCOUNT_EVEN – the number of even numbers appears on the streetMIN-ODD - the lowest odd number on the streetMAX_ODD – the highest odd number on the streetDCOUN_ODD- the number of odd numbers on the streetTabel 2.I would like to create some lines and columns (as I put in Table 2 – but may look different) and I wish to populate with the even numbers also with the odd numbers.Thank you very much.Sorin Duru

How to remove boundary which is fillup with solid in google earth?

Hi, I am new to FME and am excited to get started. I have a task that should me simple, however I am not sure how to go about it. Here i attached one picture where the White color is full of my study area. I do not want to see this color. I have to inform that i make a boundary to my dxf file when it is converted in kml file may thats why it is full of White color in my study area beacuse other part is not fyllup with white color.Do you have some good solutions?Thanks!

4 years ago

brandonguoContributor

asked in Data

ECW reader: Failed to retrieve data from the source dataset

Fail when converting ecw file. Got error message after FFS writer: Completed 100% of intermediate processing____________________________________________________________FFS writer: Completed 0.18% of intermediate processing... Last line repeated 3 times ...ECW reader: Failed to retrieve data from the source datasetStored 1 feature(s) to FME feature store file `J:\\FME_TEMP\\wb-cache--PNXtVL\\Main_EsriReprojector -1 3 fo 0 REPROJECTED 0 66d791aea5c163f33c7ab04cb5e7a95a424ee21e.ffsupdating'Saving spatial index into file 'J:\\FME_TEMP\\wb-cache--PNXtVL\\Main_EsriReprojector -1 3 fo 0 REPROJECTED 0 66d791aea5c163f33c7ab04cb5e7a95a424ee21e.fsi'Finished saving spatial index into file 'J:\\FME_TEMP\\wb-cache--PNXtVL\\Main_EsriReprojector -1 3 fo 0 REPROJECTED 0 66d791aea5c163f33c7ab04cb5e7a95a424ee21e.fsi'EsriReprojector_REPROJECTED Feature Recorder -1 2147614723 (RecorderFactory): Failed to write feature data to `J:\\FME_TEMP\\wb-cache--PNXtVL\\Main_EsriReprojector -

How to define some values in Excel Header with attributes?

Hello, I create a workspace from DWG to an Excel File with a Template File. I fullfill columns CODE, X, Y and Numero. I wish to complete in the header the values below with attribute I have from a Block in DWG : - N° mesurage - Affaire(s) - Commune de - SectionCan you help me to make this or can you give me an other way? Thank you Best Regards

110

4 years ago

dor1411993Contributor

asked in Data

Problem with the Autodesk AutoCAD Map 3D Object Data reader

Hello everyone,I've had a problem with Object Data readerfor a few days now.There is a file with objectdata on it that I want to process, and keep it as AutoCAD Map 3D Object DataThe problem is that no matter what I do, he always gives me this error message:Even if I'm not doing anything in the process, just passing from reader to writer.Does anyone have a clue what it could be?Attached is the DWG file I want to process.Thanks!

Vertex problems in my Dwg output file in Writer under FME 2018

Hello, When I open my Dwg file in autocad I notice that I no longer have any vertex in my output Dwg file after performing the transformations, can you help me recover them? here is my FME file if you could correct it for me or add the transformers necessary for it to work. thank you in advance

4 years ago

mamaieron

asked in Data

CAD to CityGML LoD0 and LoD1

Hi everyone, I'm a new user of FME. i'm trying to create a CityGML LoD0 and LoD1 based on a study area in DWG and point cloud data.I have followed the steps in the links below that are related to my task:https://knowledge.safe.com/questions/56991/citygml-file-with-lod1-and-lod2.htmlhttps://knowledge.safe.com/articles/1353/point-cloud-to-3d-terrain-model-with-buildings-dwg.htmlI can preview the data before the writer and it looks OK, with the footprint and the solids highlighting when one feature is selected but the writer is giving me the error: CityGML Writer: Geometry conversion error - Unable to convert the 'IFMEAggregate' into a single 'IFMESolid' geometry, because the aggregate/multi-geometry has '2' components. CityGML Writer: Unable to convert the 'IFMEAggregate' geometry to match its 'lod1Solid' citygml_lod_name trait. The legal geometries for 'lod1Solid' are {IFMECompositeSolid, IFMECSGSolid, IFMEBox, IFMEBRepSolid, IFMEE

LineString to MultiLineString -> Postgis

Hi there, I'd like to insert data into a postgis datebase. The destination table is already created. Unfortunatly, the translation fails due to a geometry problem : Bulk copy failed on table 'az.eu_collecteur' using delimiter ':'. Error was 'ERREUR: Geometry type (LineString) does not match column type (MultiLineString) CONTEXT: COPY eu_collecteur, ligne 1, colonne geom : Â« 010200002015550000020000007B14AEC7C07C2041AE47E17ABE0403410681...' A fatal error has occurred. Check the logfile above for details How can I transforme my source data form LineString to MultiLineString ? Any ideas ? thank's in adavance.

1934

4 years ago

bwnEvangelist

asked in Data

GEODATABASE_SDE Dynamic Reader - Reading Long Data Types as Text?

Just spotted this problem in my corporate data extraction workflow.So it is pretty straightforward, a dynamic ESRI Geodatabase SDE FeatureReader that dynamically reads the schema of the Target Feature Classes/Tables from the SDE server.However, it appears to struggle when there is a Domain on the Field. Where the option to "Resolve" the Domain to a separate "_Resolved" attribute is used that contains the Domain Description values, it instead reads the Schema for the relevant base field as TEXT rather than as LONG (meaning both Base attribute and the Resolved attribute get a TEXT data type assigned in the Schema Feature)That creates an issue when flowing that to a Dynamic FeatureWriter which uses the (incorrect) Schema Feature Data Type to write it out to a Text field rather than a Long.Anyone got any Workarounds? I'm thinking the only way to do it is to manually override the Data Type Attributes in the Schema Feature by doing a separate Schema Reader to override

120

4 years ago

Page 76 / 273

Badge winners

kjsmith1has earned the badge Welcome Back
edwardhas earned the badge FME Flow Authoring Training
serignederhas earned the badge Integrate Data with the FME Platform Training
thiago.brigagaohas earned the badge FME Certified Professional
g.mutluhas earned the badge FME Flow Certified Professional

Show all badges

30,371: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.