- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,816 Posts
25,096 Replies

When you subscribe we will email you when there is a new topic in this category

6816 Posts

How to create Attribute of Road Geometry

Anybody have idea about Geometry characteristics of road each 10 meters with Fields of Geometry table with output Shapefile1)Road2)Segment3)Length- in meters4)Shoulder- in decimeters5)Carriageway- in decimeters6)Additional lane- in decimeters7)Slow lane- in decimeters8)Platform- in decimeters9)Median- in meters10)No of lanes11)Slope- % of a pavement12)Camber- Cross slope (%) of platform13)Radius of curvature14)Geographical coordinates(lat & long)15)UTM coordinates(x,y,z)

150

4 years ago

jugoslaviaaSupporter

asked in Data

Is it possible to disable FFS file?

Hi all, I would like to ask whether it is possible to disable the generation of the FFS file. I am running into some storage problems. Therefore, I would like to disable the FFS if it is possible. Thanks in advance.

Reading from xml with one to many relationships and writing to spreadsheet

I am trying to read an xml file with a nested structure and output the results to a spreadsheet. I am using an identifier (effectively a primary key) and a number of attributes for which each identifier may have none, one or more than 1 value for the other attributes. Using list exploder I have managed to get the right output for the identifiers with multiple values, and the rejected output contains the values I want for the rest of the identifiers, but when I try to direct the output to a single spreadsheet I get only the indentifiers from the rejected values, and none of the rest of the attribute values. What am I doing wrong?

4 years ago

gvatin

asked in Data

Error on MongoDB3 connection test

While using the MongoDB3 Database connections to replace older MongoDB connection, I have this error log showing with the "Test..." button. This error also displays when a query is made on FME Desktop : the query works, features are correctly selected and used, but the error still exists without stopping the process.MONGODB3 reader: EstablishFeatureDefn(): not authorized on MY_DB_NAME to execute command { find: "system.views", filter: {}, batchSize: 2000, limit: 2000, $db: "MY_DB_NAME", $readPreference: { mode: "primaryPreferred" }, lsid: { id: UUID("a797ca3f-a6d9-4739-aa15-e6c2c5f71a6b") } }: generic server errorMy Mongo user is admin of the DB, I can't see why there is unauthorized action? Thanks for the info!I use FME 2019.2.1.0 (20191202 - Build 19813 - WIN64)Mongo version is 4.0.13

What are ffs files?Are these necessary to keep?

There are around 50 to 100 FME workspace translations running on my server. All these translations generate log files which I keep for 3 days. Along with log file FME also generates ffs files which consumes lot of space on server. Does it affect my performance time? One translation created 1 gb ffs file in temp folder creating space issues on server and affecting other translations.

Reading a segment of json that is geojson

I have a json where part of the json is in geojson.The "polygons" attribute is just pure geojson multipolygon.I'd like to able to read all the json structure but leave the polygons structure as a string and convert that to spatial data.I've tried jsonflattener and exploders + listconcatenator/featurereader with no luck.I know I can do something with python, but would rather not.I've attached a sample file if anyone would like to give it a try

AutoCAD 3D file adding extra lines in surface

When I bring in a 3D DWG file to make some bulk edits, FME is adding a lot of extra lines in the surface of the structures, triangulating vertices etc, these remain in a .dwg export. Is there away to clean this up so it presents correctly inside AutoCAD. Original FME DWG export Many Thanks

4 years ago

lotte_v

asked in Data

Image exceeds license ECW writer - FME 2020

I am trying to mosaic several ECW images together into one large file in the latest release of FME 2020. It is a very large file, according to FME it has a raster size of 1360000 row(s) and 1184000 column(s). And after the mosaic transformer has finished I get the following errors:ERROR - ECW writer: Could not open compression task Output image size exceeds license ERROR - ECW writer: Failed to write dataset 'G:\\test\\test.ecw'. This may occur if you have insufficient privileges to write this file, or if insufficient disk space is availableIs there indeed a size limit with certain licenses? I couldn't find anything about this. There is also no reason why it would complain about privilidges or disk space for the output folder, as there should be more than enough space available on the disk.How can I solve this error?

How to get the NAME of the FID field of a GeoPackage?

We made copies of our feature class tables and copied them over to several GeoPackages. Now I want to use the geopackages in a FME workspace to import data to the same table again.First step therefore is to validate the GPKG table to the DB table to make sure that the structure and fields are correct and dtermine the correct db table.To accomplish this, I use a dynamic reader and collect all field names (attribute{}.name), concatenae them and compare the resultin strings with the concatenated string of the db table.This generally works as expected but unfortunately the FID column is missing in the attribute{}.name list from the GPKG reader. I know that there is the geopackage_fid attribute but that attribute only holds the value and not the name of the FID column.is there a way to get the name of the fid field of a GPKG?

743

4 years ago

alex2044Contributor

asked in Data

Azure Synapse the new SQL Data Warehouse Platform from Microsoft

This image below shows Microsoft's recommended configuration for a BI and Analytics integrated storage solution. Azure Synapse Analytics is the new thing in town, the new MS SQL Data warehouse. The most expensive thing in this configuration is the Azure Data Factory. Our institution already has an FME Server. The question is can we replace Data Factory for FME? and has anyone in the community have made successful implementation of FME in this type of scenario?

Create attributes in multiple .dwg files (not blocks)

Dear fme users, I'm here to ask your most valuable help. I have hundreds of .dwg files in a directory and I need to process all of them adding 6 attributes to each drawing, the values of these attributes must be taken from the file name. I managed to build a workflow that assigns the attribute values to 6 columns but I can't figure out how to convert this values as recognized attributes by the output file produced with a standard writer.Small example:Input file:name: ATTRIBUTE1_ATTRIBUTE2.dwgno attributesOutput file:same nametwo attributes: number one - ATTRIBUTE1 number two - ATTRIBUTE2Thanks a lot for your help.

240

4 years ago

oliver.morrisContributor

asked in Data

sql server jdbc writer slow

HiI am trying to write to sql server rds on amazon using the jdbc writer, it is really slow. What options do I have to make this any faster. Currently it is inserting 1000 records to a 4 column (all strings) table @20s intervals. using sql server import export wizard is about 50x faster.Thank you

360

4 years ago

aaronContributor

asked in Data

Need score attribute from ArcGIS Online geocoding results

I am using the ArcGIS Online geocoding service inside the Geocoder transformer. The transformer successfully returns results but the "score" attribute does not appear in the Inspector. The "score" attribute comes with the JSON results from the ArcGIS Rest API and I need the values to filter out low scoring geocoding results. Is there a way to expose this? I assume FME is filtering it out along with many other attributes in the resulting JSON. I am using FME 2018.1.1.2 (build 18586 - Win32).

HTMLReportGenerator add checkboxes

Hey everyone, I am trying to create a report that contains a list of errors. I would like to add checkboxes next to each error as an easy way to keep up to date on what errors have been addressed. Is there a way to do this? I have looked into the Custom HTML, but I'm a little confused on how the ReportGenerator adds the attribute to the HTML statements.Any help would be greatly appreciated. Thanks!

4 years ago

khaleel

asked in Data

Convert from IFC to Citygml

Hi there, I'm currently working on my master thesis which is about urban building energy modelling, I am using the university campus as a case study and just wondering whether it's possible to convert the model from cityengine to citygml format as i don't have technical background. Or, is it better to model simple geometry on Revit and import an IFC file into FME then convert it into citygml format. Many thanks

SqlExecutor not handling Geopackage spatial queries

Trying to query tables from a GeoPackage file with st_intersections() function availabe for spatialite. When I run the SqlExecutor , I have an error logged :GEOPACKAGE reader: In ExecuteSQL(): sqlite3_prepare_v2(select grid_id,geom from grid where st_intersects((Select geom from var_fuelt17),grid.geom) group by grid_id): no such function: st_intersectsTried to use Spatialite Database format pointing to geopackage file but run into issue.All spatial functions are working in QGIS or using spatialite 4.3 command line tools.Any ways to make it work ?

Oracle Spatial Object Reader VS SQLCreator when reading geometry

Hi,I've received an FME workbench from a colleague which uses an SQLCreator to read an Oracle Spatial database. I wanted to recreate the steps by reading from the database using the Oracle Spatial Object Reader, however when inspecting the same tables and features there seems to be no geometry related to (some of the) objects.The weird thing is one table does show geometry, and others don't. I have also tried reading the database using an SQLExecutor as well as a FeatureReader and these two also don't read any geometry.Does anyone know what might cause this problem/difference between transformers and readers, and knows how to solve it?Thanks in advance.

BigQuery Reader geometry field

When using the GoogleBigQueryConnector transformer, I can see my geometry field 'geo' that I created. When I use the Google BigQuery reader, the field 'geo' shows up, but using an inspector connected to the reader, all records show <missing> in the 'geo' field.Is this a known issue? If so, how can I get around this? I'm hoping to get geometry features from the reader. Thank you in advance!

Is there a way to create a roof for 3D building model?

I need to put on Roofs on my 3D building models (Polygons with z z height information) .. is there a way to do it in FME? Maybe somehow by calculating the middle line of the polygons?

Hallo everybody,I'm trying to export an valid CityGML building into a GeoPackage. In the result, I get a bunch of line segments representing the Groundsurfaces and Roofsurfaces with hight. All surfaces / polygones are lost.I tryed to filter the geometry, so only surfaces go to the writer. Same result.Does anyone have an idea how to export 3D buildings into Geopackage?

How do I convert Segy to Tiff? Can I convert Segy to Tiff with FME?

I need to convert Segy to Tiff. Does anyone know how to do this with FME?

How to tranform json results into shapefile?

In the following snippet (which has been reduced in length from the above file) are the results from a web api. I need to create a point for every coordinate pair and add the relevant attribute data to the point table. I am having problems due to the ID of each feature e.g. "535412" which envelopes the other attributes. How can I manipulate the json file to be able to write a shapefile with the attributes as fields?{ "Results": [ "535412": { "Standortbescheinigungsnummer": "021296", "PostalischeAdresse": "Gstraße 8, 35560 Musterort", "Standortbescheinigungsdokumente": { "AktuellsteStandortbescheinigungsdokumente": { "STOB": "15ba5116-be92-4c61-8a72-22d605b70f", "TD": "e3452231-0f4f-4d10-8b38-40386acd1a" } }, "KOORD_NORD_DEZ": 53.117221, "KOORD_OST_DEZ": 9.791388 }, "545123"

710

4 years ago

timboberooskyContributor

asked in Data

FME 2012 vs 2019 - AutoCAD feature types and Self Intersections

Hello.This is a two-parter question, I hope that is ok. This is a bit of a long post, but both questions are related. And I'll start by saying I don't know much about AutoCAD but..Question #1: I have a question about the Autodesk AutoCAD DWG/DXF reader at FME 2012 vs FME 2019. I know this is a very big leap in terms of software versions, but we're doing an upgrade at the moment so I am going through updating scripts. Where I can, I've been updating transformers to the newest versions. What I've noticed, is that the same dataset read by FME 2012 identifies fme_type / autocad_entity areas and ellipses differently than FME 2019. For example (using the exact same dataset):FME 2012 reads this feature as autocad_entity = autocad_polygon / fme_type = fme_area:But FME 2019 reads the exact same feature as autocad_entity = autocad_ellipse / fme_type = fme_ellipse:I guess I'm just trying to confirm whether this makes sense - I'm assuming geometry handling has been impr

200

4 years ago

tim_woodContributor

asked in Data

Securing ArcSDE connection files on FME Server

See https://knowledge.safe.com/questions/38060/sde-connection-files-and-fme-server.htmlI might be OK with read only ArcSDE connection files being in a shared area, but ones with write access need to be restricted. So new system share may be the answer.If I have a Workspace with a read only ArcSDE connection and a write ArcSDE connection, I can't seem to choose separate locations on server for each one - they both have to go in the same place (that's using FME 2018). So it looks like I will have to create a Workspace with the read only connection file and publish that to upload it to the shared area, then use that in Workspace with the write connection file stored locally.Is there no way to load ArcSDE connection files into the shared area outside of Workspace publishing? Can you just copy the files to the appropriate folder on the FME Server server?

How extract specific element in HTML Table

Hello, I want to get the value from <a> tag in the following HTML table, someone has an idea how can I get it? I tested HTML extractor, FeatureReader, but don't return me "Website". Thks<table id="myTable"> <tr> <td>hello</td> <td>it's me!</td> </tr> <tr> <td>it's just a table <a class ="myClass" href="https://example.com">Website</a></td> <td>with two columns</td> </tr></table>

27917

4 years ago

Page 82 / 273

Badge winners

paddyhas earned the badge Welcome Back
mpsimshas earned the badge Integrate Spatial Data
mpsimshas earned the badge Integrate Data with the FME Platform Training
mpsimshas earned the badge FME Form Basic Training
mpsimshas earned the badge FME Form Advanced Training

Show all badges

30,386: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.