- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,780 Posts
24,933 Replies

When you subscribe we will email you when there is a new topic in this category

6780 Posts

Recently active

Most replies Most views Newest first

dor1411993Contributor

asked in Data

Transpose a Table

Hello!I know there are quite a few posts on the subject, but despite everything, I could not apply the solutions to my information.I have a worksheet that produces an ffs file for me, attached, (I changed the names in Hebrew to letters and numbers..)The file represents a neighborhood by type of consumption and amount of water consumed in it.my output is this: How can I Transpose it into this:(The number 1288.64 as a generic representative of consumption..)I would really appreciate your help!The excel file here represents an idea, at the end I write the FFS file for other formats..

2623

1 year ago

ingallaContributor

asked in Data

UK EPC Certificate Download API

In the UK we are able to download energy performance certificates from the following government website. Energy Performance of Buildings Data England and Wales (opendatacommunities.org)Unfortunately you need to register to gain access but its very straightforward.Within there is access to an api, which I have tried to use within FME to automate the downloading of these certificates for a local authority area, but always get a failure.Can anyone else connect to this API and download certificates and if so how. Sorry i cant paste the API but it changes for each user... Regards

20816

1 year ago

harmenContributor

asked in Data

Create a CityGML Bridge with BridgeParts

I'm looking for some help with creating a Bridge in CityGML with two BridgeParts. Those BridgeParts can consists of one or more other objecttypes like BridgeConstructionElements. I've tried many things, but I can not figure out how to create the hierarchy of all the components in CityGML...Of course using the gml_id and gml_parent_id to connect elements, but unfortunately this somehow doesn't work out the right way. Anyone ?Like to share the final solution! What I like to see is a hierarchy:one bridgeconsists of two bridgepartswhereas different bridge elements like constructionelements can be found in both 'bridge' and the two bridgeparts So, something like this (simplified of course):<Bridge gml_id: BRIDGE> Bridgepart gml_id = part_1 gml_parent_id = BRIDGE BridgeConstructionElement gml_id = 563456 gml_parent_id = part_1 BridgeConstructionElement gml_id = 373648 gml_parent_id = part_1 BridgeConstructionElement gml_id = 238656 gml_parent_id = part_1 BridgePart gml_id = p

Converting a LAS to FBX

I have a LAS point cloud dataset that i want to urn into a nice mesh surface,the area is 1kmx1km. it has some high-rise buildings. using the workflow below. I've tried thinning the point cloud and ive also tried playing with the parameters in the TIN generator but it doesn't come through very nicely. any advice? I was thinking it ditch FME and use something else for this conversion?iwould like to use this mesh in unreal engine if the conversion goes well

1001

1 year ago

aegmanContributor

asked in Data

Geopackage Dynamic Writer error - unsupported type 'mediumint'

Hi, I'm trying to dynamically write some features to a Geopackage, but constantly get the error `OGCGEOPACKAGE writer: OGCGEOPACKAGE writer: For feature type 'd_y_n', primary key attribute 'fid' has unsupported type 'mediumint'. Primary key must have type 'int'`. I'm reading the schema and features with a FeatureReader, from a PostGIS database. Dynamic writers for other formats seem to be working fine (obviously not tried them all!). And I've tried manually changing the schema in the workbench (by altering the native type attribute), which also doesn't work. If I manually set the output schema it works, but I can't do that... Any ideas how I could resolve this issue? (Using FME 2021.2 on MacOS)

feature dataset - use schema reader. expose name

say I have a GDB, with a feature dataset fruit (gdb) apples (feature dataset)coreslicesusing the schema reader, how can I expose the feature dataset name of apples?exposing all of the attributes in schema reader will not expose the name of the actual feature dataset within apples. I can get all the other attributes using list exploder.but can't get the feature dataset name.anyone know how?

AutoCAD block outputs are different between Flow and Form

I've built an AutoCAD based automation in FME Form and use blocks with text for some of the output features. The text aligns how it was designed in the block in the FME Form output. However, when running in FME Flow the text shifts.If I move the block slightly, select Reset Bl;ock or edit the text in AutoCAD then it snaps back to the correctly designed position.I'm using the same template dwg in FME Form and FME Flow.

1 year ago

arthyContributor

asked in Data

How automatize the data extraction from Primavera?

I would like to integrate and automatize Primavera data in FME.I don't see any reader that accept primavera.How should I proceed to reach my goal?

1 year ago

bhagyashrisingh

asked in Data

Can we write Arcgis Pro file formats ( aprx) with the help of FME.

632

1 year ago

milo89Enthusiast

asked in Data

Extracting MultiTracks from Google KMZs

I've recently been provided with a large number of relatively small KMZ files which contain track data recorded by field staff using GPS. This is usually a simple extraction process, however the data is now being provided as a gx:MultiTrack within the KMZ file.(More Info - https://developers.google.com/kml/documentation/kmlreference#gxmultitrack)When using FME, it processes the features as if they have no geometry. Currently I'm reading the data in as an xml and extracting the coordinates to build line features as a work around, but not sure it's the best way.Has anyone dealt with MultiTracks before using FME and have any tips or tricks to extract the geometry cleanly? Thanks in advance.

193

1 year ago

jackydContributor

asked in Data

Black Multipatch Features

HI, I am copying Multipatch features from one file GDB to another, but when i do this they rendered and solid black features when viewed in ESRI This Instead of this Any thoughts on what is happening? Thanks Jacky

3912

1 year ago

arthyContributor

asked in Data

How to extract Coded Domain Definitions from a geodatabase?

I would like to extract the coded domnain definition from a geodabase.There is already an article about it here. However, when dowloading the ETL extract-domains-from-geodatabase-gdb-py34.fmw, I couldn't run it with my 2021 FME version.FME_BEGIN_TCL script returned error on execution. Error message was: ' FME 2021.2.6.0 (20220727 - Build 21821 - WIN64) FME Database Edition (floating) Permanent License. Machine host name is: 237146PT Operating System: Microsoft Windows 10 64-bit (Build 19045) Copyright (c) 1994 - 2021, Safe Software Inc. Safe Software Inc.GEODATABASE_FILE reader: An unknown exception occurredProgram TerminatingTranslation FAILED.child process exited abnormally'. TCL script was: 'lappend sysString $FME_MacroValues(FME_HOME_UNIX)/fme;lappend sysString {Generate};lappend sysString {GEODATABASE_FILE};lappend sysString {NULL};lap

3214

1 year ago

bark0sContributor

asked in Data

Directory and File Pathnames - multiple file extensions?

Is it possible to search for multiple file extensions in the one directory and file pathnames reader simultaneously?Path Filter:* - returns all files*.dgn - returns all dgn files*.dgn,*.shp - returns 0 resultsCan someone please help me with the correct syntax for multiple file extensions in Path Filter?

Read GeoPDF as a single PDF and not split into rows.

Hello all,I am reading a scanned PDF image of a county and I would like it to read as a single file. It appears to be reading it as 7 different files, which will output into 7 different TIFFs. Does anyone know how to fix this problem and make it read as a single PDF image?

Hi, I have a non spatial SQL command that I want to use in FME. Is there a way to plug it in without 1. making it a view in SSMS, or 2. without using a sql executor transformer?

I tried pasting my SQL command in the feature reader, but it keeps bringing in everything from that database or schema.

115

1 year ago

nic_ranContributor

asked in Data

Extract layer definitions from AutoCAD DWT template

I have an AutoCAD DWT template file and I would like to extract all of the layer definitions (e.g. line style, weight, colour, etc.). The DWT file does not contain any objects (i.e. no lines, points, blocks, etc.), so FME does not have any features to process. Is there any way that I can extract the layer definitions?I've tried using the schema reader and I can use that to get all the layer names, but not the associated linestyles, etc.My end goal is that I need to validate supplied CAD files against the standard layer definitions defined in the template file and I was hoping to extract the template layer definitions into a spreadsheet or database so that I could use that to do the validation. Perhaps I'm going about this the wrong way? Is there a way that I can use FME to validate that a DWG matches a template DWT definition?

724

1 year ago

fdwContributor

asked in Data

Tableau Hyper writers errors on 'COPY-IN cancelled'

Recently I tried to write a few million non-spatial features to a Hyper writer. At some point (around 11.000 features) in committing the features to the file (create if needed on a new non-existent file) it errors. With the debugging option in the log I was able to figure out that a 'COPY-IN' statement is executed I think.When I look at the documentation https://tableau.github.io/hyper-db/docs/sql/command/ no such statement is supported. Am I correct here? Features per transaction is set at 1000. Bulk insert: Yes. Changing these makes no difference. When limiting the features that pass to the writer it will write the file correctly. Like say about 50.000 no problem. I am using FME(R) 2022.2.2.0 (20230106 - Build 22782 - WIN64) Is this a bug? Should I upgrade to a newer version? RAM is not a problem, disk space isn't either.

Hello. I´m Topo79.I'm trying to export through pdf_rasterized_pages to an GeoTiff in its real coordinates but it's imposible. I've transformed a gdb into Adobe Illustrator, ffs and GeoPDF at once, but from GeoPDF to georreferenced GeoTiff it isn't posible.Thanks a lot ;)

Image with transparency to PDF

Hi, I’m trying to add into a pdf (PDF2D) an image. I have created it as a png with transparent background. However when the pdf is created the background is black. I have tried different things but can’t figure it out how to remove the black background. This is what I’m doing: CreatorRasterReaderRasterGeoreferencerPDFStylerPDFPageFormatterPDF2D Writer I played with the PDFStyler but it doesn’t change the result. Can somebody guide me? Thanks,

SQL Connection Where statement with multiple parameters

Currently we have the following where clause for the database connection which works well: Need to add additional parameter which is [transactiondate]= CONVERT (date, GETDATE()) . Tried the following but no results returned:[PartDate]= CONVERT (date, GETDATE()) AND [transactiondate]= CONVERT (date, GETDATE()).Ran in SQL and for sure there are data based on the above where statement. Please let me know what did i do wrong. Thanks.

1 year ago

andrewbnzContributor

asked in Data

Suppress warning about FME data type "nvarchar_max" versus SQL "nvarchar(max)"

Does anyone know if it's possible to suppress or otherwise fix the following warning which comes up when writing features to an MS SQL server database? The column in the database is "nvarchar(max)" but FME always flags this warning when the workspace runs, because it uses "nvarchar_max". It's only a warning, but when we then deploy this to FME Server/Flow - we regularly check the job logs and these always show the exclamation icon - so just an annoyance as it's not actually an issue.

Is SAP HANA Spatial/Non-Spatial connector available?

Hello, We have a situation using SAP HANA Spatial and we would like to be able to access data held in SAP HANA database tables. We know that native reader/writer does this but I understand from customer that in such cases, we will loose guaranty for SAP from provider.Second option is JDBC driver (or it is mandatory for first option???). In conclusion, my question is if there is any other SAP connector already developed (which can connect to client accessing SAP database). Thank you.

How can I specify a projection for a mongodb destination ?

Mongodb supports EPSG 4326 by default you can specify a custom crs : https://www.mongodb.com/docs/manual/reference/operator/query/geometry/ My workflow is simple : geopackage to mongodb. I tried : Specify source and destination projection : no effect (data are in 4326 in mongo)Extract geometry (projected in 2154) and store in attribute geometry2 but there is no json type (or even geometry type). Extract geometry and write it in a geometry attribute : fme returns an error.

182

1 year ago

geovisionContributor

asked in Data

ZIP file from API with csv files and renaming them

I'm using a HTTP caller to download a ZIP file from a API. After that I'm using the ZipExtractor transformer to extract a number of csv files from the ZIP file to a folder and then a FeatureReader reads the files and so on. Only problem I'm having is that the CSV files change from time to time. They all start with the time of the export followed by the filename. So every time that happends I have to go back to the FeatureReader, select the files again and reconnect the files to their appropriatie transformers. Is there a way to rename the files after the ZipExtractor ? I have found some topics using the Directory and File Pathnames Reader with the File Copy writer but I cannot get that to work. Any help would be greatly appreciated.

444

1 year ago

redgeographicsCelebrity

asked in Data

UTF in Microstation DGN

I'm trying to write texts to Microstation and having trouble getting certain characters across, specifically ü and ç but there may be others. They are present in the source data and inside FME right up to the point where they enter the writer. I'm pretty sure it's an encoding issue, but can't seem to set UTF-8 on the Microstation writer. Any ideas on what I can do to get those characters into DGN?

601

1 year ago

Page 26 / 272

Badge winners

verohhas earned the badge Teacher (Grey)
verohhas earned the badge Welcome Back
aaronhas earned the badge English Speaker
aaronhas earned the badge Welcome Back
spalroberthas earned the badge Student (Grey)

Show all badges

30,126: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.