- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,810 Posts
25,084 Replies

When you subscribe we will email you when there is a new topic in this category

6810 Posts

Use Azure based OAuth connection to connect to Snowflake

Has anyone successfully connected to Snowflake using OAuth? We have been using a local account to connect to Snowflake but have recently been requested to use an Azure based OAuth connection. We have an assigned client ID, key and refresh url available but need to understand how to make the calls. Thanks!

Minecraft block state?

Hi! I've built all of our municipality (including terrain, type of terrain, roads, water, bridges, tunnels, buildings, trees and railway) in FME. The kids keep complaining about the slow railway :) So now I've added powered rail on redstone to get faster trains. But the powered rail does not seem to be activated. If manually removing the powered rail and add again manually, the new powered rail get activated and the train goes fast. Is there a way to programmatically activate the powered rail in FME? I've tried using a block state parameter (which is supported in Minecraft) in addition to blockID and blockData. I called the parameter blockState, and set it to true, but FME does not seem to support that parameter. Can you add that support, or is there another way to programmatically activate the powered rail?Best regards, Ken Karlsson

240

3 years ago

lazarlubomirContributor

asked in Data

Any sample DGN for Bentley Map XFM Design (V8)Reader?

Hello, please, does anybody there any sample of DGN for Bentley Map XFM Design (V8) Reader? I cant find any sample on websites and one of potential customer wanna see how FME can work with XFM attributes in DGN. Thank You very very much for some sample data!Lubo

3 years ago

thijsknapenContributor

asked in Data

How to only select attribute names for 'Attribute_List' parameter?

Hi folks, In some cases I get into the situation that I want to perform an action on all of the exposed attributes in my workspace. For example, filtering features for which at least one attribute has a value (this idea is linked to the idea 'https://community.safe.com/s/idea/0874Q000000j0VfQAI/detail' and my comment in the idea 'https://community.safe.com/s/idea/0874Q000000j0G6QAI/detail'). It would be nice to be able to quickly select all of these exposed attributes. If I make a custom transformer that uses the 'Attribute_List' type of parameter (either comma or space delimited), I am able to specify multiple attributes to perform an action on. However, when I want to configure the value for this parameter in the main workspace, the 'Select <PARAM_NAME> Items' window popus up, and there I can choose both the attribute names (indicated with the orange attribute arrow), as well as the attribute values (i.e. also options for '@Value(<ATTR_NAM

760

3 years ago

dbaldacchino1Contributor

asked in Data

Writing Extended Entity data to DWG

I am trying to write extended data attached to AutoCAD entities such as lines (DWG file format) and am not finding examples on how to do this. I'm not finding the documentation particularly helpful in this regard. Does anyone know how to do this? See image below, thanks.

1460

3 years ago

r_hueskenContributor

asked in Data

Error writing to Postgis table with both 2D and 3D geometry columns

Hi, I have a postgis (12) table with 2 geometry columns. The first column is defined as geometry (geometry, 3857). The second column is defined as geometry (geometryZ, 3857). Consequently, the postgis geometry_columns view shows 2 entries, indicating 2 dimensions for the first column, and 3 dimensions for the second column. When writing 3D data to this table, I select the 3D column in the writer properties. This gives a warning in the log: POSTGIS Writer: PostGIS existing table has a 2D constraint My data is forced to 2D, but this is not accepted by Postgis, and my translation fails. When I remove the 2D geometry column form my table, all 3D data is inserted without errors.Apart from just using the 3D column and forcing all data to 3D in FME and then back again to 2D in my application, I do not see another solution. Is there another way to work around this? I'm using FME FME(R) 2020.1.0.1 (20200710 - Build 20596 - WIN64) Thanks,

Dose FME require Arcgis Pro or Server in order to be able to write in file geodatabase?

3 years ago

fikusasContributor

asked in Data

Random Password Generator: password always starts with letter

How can I force that first symbol of generated passwords always be letter? I'm using this:import fmeobjectsimport randomimport string def processFeature(feature): length = int(FME_MacroValues['Lenght']) letters = 'abcdefghjkmnpqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ' digits = '123456789' symbols = '!#$%*+-:;<=>?' all = letters + digits + symbols temp = random.sample(all,length) password = "".join(temp) feature.setAttribute('Password', password)

How to proper save raster to jpeg-format

Hi, I'd like to save raster to the JPEG format. The raster includes an alpha band. In order to save to JPEG the alpha band needs to be removed. When the alpha band is there the background appears white in FME Inspector. When I remove the alpha band the background turns black. That's also the background color when I save the raster to JPEG. How can I work around this problem and make the background white when I save to JPEG? With the alpha band. White background.Without the alpha band. The background turns black. I don't want that.

Why did i get wrong raster extent from clipper transformer when i use shape file as clipper and raster as clipee? I 'v used fme from arcgis pro v.2.5

When I clip raster by shape file by using clppper transformer I 'v used it in fme from arcgis pro v.2.5. I notice that the output raster extent could not exactly same as of shape file. They are not identical. Please someone kindly describe me and clue some resolution about this problems.

Writing geotif with PixelIsPoint Header

How do i set FME Workbench to write a GeoTiff with the PixelIsPoint header? Every setting i try writes a world file with the coördinates of the middle of the top left corner pixel and a model tie point with the top left corner of the top left pixel and a PixelIsArea header. QGis and Arcgis pro show the correct position with the current settings but Autodesk seems to shift the file half a pixel. I tried to fix this with the "Ignore Raster Type Key" setting or the "Write esri compatible coordinate system". I tried setting the RasterCellOrigin to 0,0 or 0.5,0.5 But all files seem the same. Loading an ASC file looks correct. This file contains the lower left corner of the file. Center of the attached files is 155000 463000

174

3 years ago

gazzaContributor

asked in Data

How to read a CSV file with inconsistent line endings.

I've been given a CSV file that has a mixture of line ending types, some are LF and some are CR. The first line is blank with a LF, followed by a header line with a CR then all the data records which are terminated with LF's. The CSV reader is thinking the terminator is LF so thinks the header line is both lines 2 and 3 which is messing it up. Other than reading the file in as a whole and changing the CR to LF, saving it and reading it in again does anyone know how to read this in?

Can someone convert a Revit / IFC file into an ArcGIS Pro file ( .gdb file) for me. I don't have an ArcGIS pro licensed account to do this.

I need this for my post-graduation project and I would be very grateful to you guys if you can do this for me😥 😥

3 years ago

dantikab

asked in Data

The IFC reader does not support 'IfcSweptDiskSolid'..??

Greetings, One of the sales pitches for FME is that it handles IFC well. Safe also recommends IFC as the transport format from Revit to FME.Imagine my surprise when I get the following message when trying to parse a file containing IFC rebar elements:"The IFC reader does not support the following type: 'IfcSweptDiskSolid'. All instances of this type will be skipped" So, in other words FME has poorer support for IFC than many open source converters? Is this correct or is there any way to augment or rectify this situation?If so FME will remain a viable tool for us, otherwise we'll have to move elsewhere. Thanks in advance!

Convert trajectory CSV to GPX from Mobile Mapper

Hi, I have a trajectory file with GPS time and coordinates from Mobile Mapper Ladybug camera and want to convert to .gpx file. The structure of .gpx seems to require quite a few additional attributes. Anyone has any ideas or suggestions of how to process CSV?Regards,Maksym

330

3 years ago

oliver.morrisContributor

asked in Data

WFS in feature reader - Ignore GetFeature Error

Translation from dxf file to MapInfo creates only one layer, the last one even if it can see all of them.

I have the new version. The old one used to do it easily.

3 years ago

henrikandersson

asked in Data

Frequent problems reading PDF documents as raster

Hi, I often get this messeage when I try to read PDF documents (floor plans) as raster. When I try to read the same PDFs as vector it works fine. But I just want to read the PDFs as raster because I want to convert the PDF documents to the PNG-format. How can I avoid this message? My estimate is that I can only read approximately 25% of the PDF documents I would like to read. I use the featureReader to read the "Adobe Geospatial PDF"-format. The log says: Merged 0 schema features read from 1 datasets into 0 resulting feature typesUniversalReader -- readSchema resulted in 0 schema features being returned

3 years ago

campbellfleury

asked in Data

elasticsearch 7 - removal of mapping types

Hi there,I use FME Desktop to bulk-load to elasticsearch. I'm building a new application based on elasticsearch 7.1.1 but mapping types were removed ahead of this version;https://www.elastic.co/guide/en/elasticsearch/reference/current/removal-of-types.htmlAre there plans to update the reader/writer to be compatible with elasticsearch 7?Thanks,Campbell

3 years ago

vuppel_ce19539

asked in Data

How do I convert an IFC file into an ArcGIS file?

Should I use any transformers? Can someone help me with the exact inputs I have to give to the software to convert a Revit/IFC file into ArcGIS file

Is there a quick way to rename files?

I have a folder containing hundreds of tif and related extension files e.g. NS26.tif, NS26.aux and NS26.rrd. I want to rename them adding a suffix i.e. NS26_c.tif, NS26_c.aux etc. I can manage this using filecopy to the existing folder but because the filename has changed overwrite won't work so I end up with new and old in same folder. Any suggestions?

89314

3 years ago

spidermanContributor

asked in Data

How could i read two polygon from one reader non spatial

i would like read two polygon from one reader not only one so what should i write in WHERE CLAUSE to read two polygons at the same time to execute both ofthem together .i am not expert in sql ,i am still beginner .could some one help me ? Thanks in advance

3 years ago

jneujens

asked in Data

PythonCreator feature type in GeoJSON writer error

I am using a 'PythonCreator' and 'PythonCaller' transformer to create a series of SQL select statements. The latter are used in a 'SQL Executor' transformer to read many features from an oracle db. Eventually, these features have to be written to .json files. Because I initially used the PythonCreator, all the feature have 'fme_feature_type' set to 'PythonCreator'. When using the GEOJSON writer in FME Desktop 2017.0 (build 17259, 64 bit) , this results in an error message: 'Unknown feature type 'PythonCreator' passed to the JSON writer'. Other writers (SDF, shape, excel, etc.) work fine.If I use an attribute manager to set the 'fme_feature_type' attribute to other values, the writer works fine. Could anyone explain why the writer has problems with an fme_feature_type named PythonCreator? I could not find an answer in the documentation on the GEOJSON writer; so that is why I am asking it on this platform.

How to read all Paper Spaces from Acad file?

How can I read all Paper Spaces from Acad file? I can set 'Read Selected Paper Spaces' parameter, but I need something generic like using * character.@takashi

460

3 years ago

agelfertContributor

asked in Data

Has something changed in FME 2020 when reading zipped File Geodatabases (GDB format)?

I'm in the process of migrating a number of workbenches/workspaces from 2018 to 2020. Many of these were created years ago in much older versions of FME. So I'm meticulously going through an updating all elements in the workbench, then running it in Desktop and finally publishing to Server 2020. Running into very few issues but I can't get Desktop 2020 to read zipped GDB using the GDB reader. Where it does so in 2018, it fails in 2020. Unable to connect to the File Geodatabase at 'path..../GDBName.zip'. Make sure the correct filename was specified, and that the geodatabase wasn't saved with a newer version of ArcGIS than the one installed locally. The error number from ArcObjects is: '-2147024893'. The error message from ArcObjects is: {}A fatal error has occurred. Check the logfile above for detailsIt will read the GDB just fine if I manually unzip it in the same location. So it's not permissions or issues with a bad GDB. Anyway, I can come up with a workaround - just wondering if th

450

3 years ago

Page 55 / 273

Badge winners

n1zj2cxlviehas earned the badge Student (Grey)
deepakeshas earned the badge Expert (Grey)
deepakeshas earned the badge Teacher (Grey)
deepakeshas earned the badge Student (Grey)
kaliyanihas earned the badge Expert (Grey)

Show all badges

30,455: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.