- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,820 Posts
25,126 Replies

When you subscribe we will email you when there is a new topic in this category

6820 Posts

Reading Openstreetmap and writing it right back loses tags?

I have a set of nodes on this format:<node lat="56.07686365" lon="12.11483240" id="800000002" changeset="1" timestamp="2017-09-10T20:50:35.826Z" version="1"> <tag k="ActiveFrom" v="1900-01-01T02:00:00.000000000Z"/> <tag k="ActiveTo" v="3000-01-01T01:59:59.000000000Z"/> <tag k="ProductionPointCategory" v="4"/></node>When I read them in to the OSM reader as basic nodes, I get a list of tag{}.k and tag{}.v. I want to do some light filtering on this data, mainly checking if they exist in another dataset.Thereafter, I want to write them back to the same format that they came from. However, if I just connect the reader straight to the writer, it doesn't write out any of the content of the tag-list. I have to expose all the attributes that I want to be written, which seems like a backwards idea since the information is already there in the key-part of the tag-list.Is there a way to get the writer to write the contents of the tag-list, without me manually expos

I am Testing for matches json.ID against SDE db sde.ID. The problem is no matches yet there are 26 matches in the test case. I think I have a data typing error. The sde.ID is VARCHAR2 (30 Byte) and I assume the json.ID is data source json. ANyway to covert to get a matchup??

Access database to DWG

Since I am new to FME I have no idea if this is even possible. I have an Access database that contains projects that are related to specific AutoCAD drawing located in the project folder. I want to create a KML file showing not only place markers (with attribute table in it) for each project but also DWG route. Place markers are easy to do, already done it but I am having trouble figuring out how to implement AutoCAD drawings. Is it possible to do it through Access database , or I have to use separate Reader for DWG files.Thank you

FME Google Sheets Writer failing?

Hi There!We are having issues with the Google Sheets Writer timing out and failing. I worked with someone in Support & they were really helpful - but we didn't solve it. My boss was wondering - could it be a firewall issue on our side, and if so what ports need to be opened up to communicate? Thanks so much! Christen

6 years ago

paulmascaro

asked in Data

Are there plans for Civil 3D Survey Database support?

Hi, I'm new to FME and I'm wondering if FME supports connections to Civil 3D survey databases? This would be helpful for syncing attributes in a projects survey database with other databases. More specifically point data in survey databases for my needs.I know Autodesk added a survey api in 2017 and they've upgraded the file type of the survey database in 2018. Project survey databases reside in the project folder and use data shortcuts in Civil 3D to connect the database to the projects drawings. The database is a Microsoft® SQL Server® Compact 3.5 database. New and converted survey database files for 2018 have the file extensions SDBX and SDXX.

6 years ago

maxbuiaus

asked in Data

How to convert 3d gis to IFC with FME!

I have a 3D gis file need to be converted to IFC format to analyse in Ansys. I had tried with FME, however the output files always has no geometry in it. How can I make it? Thank you

Error: No DEF line could be found for feature type

Hi,I have an FME Workbench that is writing to a dynamic schema.I have set the fme_feature_type and fme_feature_type_name explicitly using an AttributeCreator, but I keep getting this error when trying to write to an Excel spreadsheet:XLSX Writer: No DEF line could be found for feature type Does anyone have any ideas as to what this error means and how to solve it?I also get the following warning prior to the error, if this helps:Cannot define schema for 'RP_100CC' as the feature does not contain schema information, and schema source is set to 'Schema from Schema Feature'. Please verify writer feature type configuration. I am using FME Desktop 2017.1 64 Bit.Thanks

FME Server cannot read JPEG

I am using a FeatureReader to read specific JPEG images, on desktop it works fine, brings in the JPEG. Once i publish this to FME server i get:JPEG reader: file '"\\pathname\\filename.JPG"' cannot be located. Please ensure the file exists and is accessibleI know that the path\\filename are correct, and i can go onto the server and access this location and image without any problems.Any ideas why it can't access it when running the workspace on server though?Just to also add each image has a .jpg, .jgw and a .xml part to it.

1100

6 years ago

f.kemminjeContributor

asked in Data

how can i write to two databases symultaneously

Hi Team,I have 7 million records coming out from source and i need to write to two databases simultaneously. why simultaneous:if i write one writer and the second writer will be waiting first one to complete. And in between memory issue comes and fme hangs or stops abruptly.so I need to write to two databases at a time. need serial connection to the writers.not parallel.can anyone please help me.

1330

6 years ago

matiasContributor

asked in Data

Orientation problem, transforming from 2,5D Esri Shape into IFC files

I have been Working with Esri Shape 2,5D and transforming them into IFC. I have follow the CADtoIFC example but i will like to have the buildings in ifcBuilding because i don't have any information about the wall, Slab or RoofI generate an Area(polygon) from a lines then use Extrude to get the height of the building, aggregate sam attributes to the Polygon, then use GeometryPropertySetter /Geometry Name="Body"the IFC file look like thisand just after Aggregator_5 in FME DATA Inspector look like thisAs you can see is missing one building and a part of the roof is wrong have anyone know how to fix this or what can be the problem?

How to create shapefiles for AutoCad

Currently using AutoCAD 2017. Have a customer who needs shapefiles for a county dwg. I know these can be created in AutoCAD Map. Do you have a software that does this? If so can you briefly tell me what is does? Also what is the cost?

100

6 years ago

btlContributor

asked in Data

Reading OSM and editing fme_map_features_config.xml

I want to modify which attributes I get when reading OSM data.For example I want to see the "generator:source" tag as an attribute in the power feature.I can add it as an atribute to all features by adding it to the list of attributes near the top of "fme_map_features_config.xml" as follows:<fme_osm_config> <add> <geom_type name="aggregate"></geom_type> <geom_type ..... <attribute name="id" type="string"></attribute> <attribute name="timestamp" type="string"></attribute> <attribute name ........my addition-> <attribute name="generator:source" type="string"></attribute>But there is a section further down for the power feature that looks like this: <key k="power"> <value v="cable"></value> <value v="cable_distribution_cabinet"></value> <value v="catenary_mast"></value> <value ...... </key>Can I edit this section so that "generator:source" appears as an attrib

6 years ago

sebastianolaf

asked in Data

Excel writer problem when writing data that has multiple lines

I have oracle table that needs to be exported to excelthe table has 1 column that has multiple lineExcel Writer is good enough to make it into 1 line automatically. But the 2 words that separated by New Line or Carriage Return became 1 word instead split it with single space.For Example an address Column:"Hello World"Excel Write put it in 1 cell "HelloWorld"no space between "Hello" and World" How to tell Excel Writer not to do that ?Expected Result "Hello World" with space in the middle

HI FMEI got this error while writing to Neo4J through JDBC, I thought it was supported ?https://www.safe.com/solutions/jdbc-support/Creating writer for format: JDBC (Java Database Connectivity)Trying to find a JAVA plugin for writer named `JDBC'FME Configuration: No destination coordinate system setUsing Java Writer Interface Version 2.0 (Oct 31, 2000) with module JDBC to write data to dataset `jdbc:neo4j:http:<solidus><solidus>localhost:7474<solidus>'Writer `JDBC_1' of type `JDBC' using group definition keyword `JDBC_1_DEF'JDBC Writer: Creating connection using connection string 'jdbc:neo4j:http://localhost:7474/' and properties '{user=neo4j, password=************}'JDBC Writer: If the desired JDBC driver was recently installed, restart FME and try againjava.sql.SQLException: No suitable driver found for jdbc:neo4j:http://localhost:7474/ at java.sql.DriverManager.getConnection(DriverManager.java:689)java.sql.SQLException: No suita

Making roofs and buildings LOD2 from point clouds (LAS)

Hello,I'm having some problems with making LOD2 roofs and buildings from my point clouds. I don't have much experience with FME yet, so some tutorials are hard to understand yet. The point cloud is areal and LAS format. I also have a DWG building outline file, but it does not include the height or elevation of the buildings. I have tried this tutorial, but I could'nt get it to work properly. I have tried the alternative method, but I have no idea where I should implement it. I really like some help with my project. I'm new at FME and don't really know a lot of the tools and tricks, but I'm eager to learn. Thanks in advance.

Smallworld 5 mapped Geometries

We are currently upgrading our Smallworld from 422 to 5.1.X and I am trying to get the existing FME 2014sp4 fmw files to work correctly. They will run (the text and lines translate) but it appears that the Smallworld mapped Geometries for our points that are in the fmw file are not recognized. I also tried creating a new simple fme workspace (In 2014sp4 and 2017.1.1.1) and when the reader comes back with a list of Smallworld geometries none of the mapped geometries are available. Are there any know problems with Mapped Geometries and Smallworld 5.1.X. Any help would be appreciated. Thanks

Hi, I would like to convert a Map info table file into a TIFF file but it doesn't work ! Can't you help me please

180

6 years ago

jpdenboerContributor

asked in Data

How to write point features to Blocks with Autocad_od writer

I've put a autocad template file with two test blocks, a Shapefile with points and a FMW-file in a . So I hope you can seen whats going wrong. I tried to export point features to blocks with autocad_od writer because I want to save other data as Object data. This does not work! When I use de realdwg writer it is still working right.What is wrong in the Autocad_od writer parameters?

6 years ago

maliodpalube

asked in Data

Loading AutoCAD reader

Hello, I am receiving an error when I try to load an ACAD reader. I have no idea what could be the problem.Starting translation... FME 2017.1.2.0 (20171213 - Build 17722 - WIN64) FME Database Edition (node locked-crc) Temporary License: 20 days left. Machine host name is: DESKTOP-7U34IIO Operating System: Microsoft Windows 10 64-bit (Build 16299) Copyright (c) 1994 - 2017, Safe Software Inc. Safe Software Inc.Creating reader for format: Autodesk AutoCAD DWG/DXFTrying to find a DYNAMIC plugin for reader named `ACAD'Loaded module 'ACAD' from file 'C:\\Program Files\\FME\\plugins/ACAD.dll'FME API version of module 'ACAD' matches current internal version (3.8 20170315)SOURCE_ACAD Reader: Using rich geometry.AutoCAD Reader: Error opening file 'C:\\Users\\ddeja\\Desktop\\Projekti\\Bijeljina\\IZVEDENO SAOBRAAJNICA.dwg' during

Filter WFS by both BBOX and attribute

Hi!I am using the wfs-reader in FME accessing the web feature service(wfs):http://slwgeo.artdata.slu.se:8080/geoserver/SLW/wfsFeauturetype: "AllSwedishOccurrences {All Swedish Occurrences}"I am trying to filter specific(e.g. "Margaritifera margaritifera" species in a municipality(Borås) Seems like I can´t get both criterias on the same time. Getcapabilities: http://slwgeo.artdata.slu.se:8080/geoserver/ows&VERSION;=1.0.0&SERVICE;=WFS&REQUEST;=GetCapabilitiesHow can I get scientificName Margaritifera margaritifera in municipality Borås by filtering in the WFS-reader? It would be ok to apply a bounding box on coordinates instead of using the attribute municipality Borås. I know some of xml, and I have been trying to find a solution,using the filter functions taught on Geoserver but now I reached a dead end. I have tried:<Filter><And><PropertyIsEqualTo><PropertyName>municipality</PropertyName><Literal>Borås</Literal&g

Assigning CRS to a feature class receiving spatial information from a raster

I have a feature class which already possesses a defined CRS. I am creating some polygon outlines from an Arc ASCII file and writing them to the feature class mentioned above. Also, i am reading a tiff image which contains the CRS information to be assigned to the feature class after the outlines have been loaded. So the goal now is to extract the CRS information from the tiff image(done) and assign it to the feature class to which the polygons are being written. How do we achieve it ? I am confused between the Reprojector and the Co-ordinateSystemSetter or is there any other way ?

JSONFlattener error (via GoogleGeocoder)

Hello,I have a custom workflow built around the GoogleGeocoder transformer available in the FME Store.My company recently upgraded the server from which I access FME Desktop (from Windows Server '08 to Windows Server '12), and now the workflow errors out on the JSONFlattener transformer piece of the GoogleGeocoder transformer.All my other custom workflows continue to work perfectly...Below is the exact error message I get. Has anybody encountered this error before? If so, how did you remedy it? 2018-01-22 12:50:12| 4.2| 0.0|ERROR |GoogleGeocoder_JSONFlattener(JSONQueryFactory): A JSON syntax error was found at line 3, column 133 2018-01-22 12:50:12| 4.2| 0.0|ERROR |GoogleGeocoder_JSONFlattener(JSONQueryFactory): The JSON data is incomplete: Unexpectedly encountered the end of JSON data 2018-01-22 12:50:12| 4.2| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details 2018-01-22 12:50:12| 4.2| 0.0|ERROR |A fatal error has occurred. Check the logfile abo

6 years ago

steverrrino

asked in Data

I wish to receive email with text from query (addresses). I am able to trigger a one time run of workspace and recieve text and notification. When i schedule same workspace i dont receive text but only notification?

6 years ago

mixedbredie

asked in Data

Split large CSV file into smaller files with header and footer rows

Hello,I have a CSV file with 70,000 records. It has a header row identified by 10 in the first column. The data rows have 20 in the first column and the footer row has a 99 in the first column. I can split out the three row types, do stuff to the data rows and then combined them all back together again in the correct order – 10, 20, 99.However, the output file is too big for our thirdparty import routine to handle so I need a way of chunking the data into files with, say, 5,000 records in each. Each file needs the original header row (4 columns), the 5000 data rows (15 columns) and an updated footer row (2 columns) with a 99 and a count of the number of data rows in it. The importer should be able to loop through these smaller files without taxing the underlying JVM.I have got it mostly working using a fanout on the dataset using @Count(fanout,1,10) which creates 10 folders with a CSV file in each. However the header row gets written to the first file and footer row only gets writ

I am having trouble with the color format going from a dwg to a geospatial pdf. My workspace is reading the paperspace from a dwg and writing a geospatial pdf. I need help with the color format on the output pdf.

6 years ago

Page 173 / 273

Badge winners

tatyana12has earned the badge Student (Grey)
david.van.dalenhas earned the badge FME Form Basic Training
logan.petershas earned the badge Integrate Data with the FME Platform Training
ivanbakkerhas earned the badge Student (Grey)
lrshas earned the badge FME Form Advanced Training

Show all badges

30,426: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.