- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,779 Posts
24,923 Replies

When you subscribe we will email you when there is a new topic in this category

6779 Posts

Recently active

Most replies Most views Newest first

robertoContributor

asked in Data

SSO cross domain users

Hi all,I’ve a question regarding single sign on into FME Server.I’ve installed FME Server on a domain (let’s call it “Domain A”) and I’ve configured the SSO for the users in the Domain A. I’ve tried to log in on a client using right domain A account and then, using Internet Explorer, I’ve logged into FME Server in SSO mode and It works fine.Now I have another domain (let’s call it “Domain B”) trusted with Domain A in bidirectional mode.In FME Server I added the connection to the Domain B’s Active Directory and imported the users from this domain.I tried to log in on a client using right Domain B account and then, using Internet Explorer, I logged into FME Server in SSO mode but it not works.The returned message is “You are not authorized to access this web application”Can someone tell me if I need to set principal name, using the setspn command, also in the Domain B?Thanks in advanceRoberto

Can the tool migrate data from Documentum to SharePoint with metadata?

We have a migration project kicking off and the team here is already using fme for Documentum. I want to know if the tool has the capability to perform a migration from Documentum to SharePoint Online whilst maintaining metadata and structure from the source.

Writing in an Autocad extended data

Hi ! I have a problem with Autocad extended data. I added a "data property set" in my ACAD file with an attribute named "UAID". I found it in my extended data properties on Autocad.I would like to find it when in FME in order to write in the "UAID" field a unique number that is read from an Excel. I don't know where can I find the UAID, can anyone help me ?

Geodatabase error 2147467259 Could not read Field

Guys,something wrong is going on. I was changing existing working workspace to pointing to new geodatabase zip file, which also has new table structure. Modified new workspace is working fine on my PC under FME Workbench. But if I publish it on FME Server I'm getting the error (see below) for each attribute that we are not reading from geo tables. And since original database is huge after few minutes FME Server stops the job without any failure message and building core dump files on FME Server machine.Error messages that we are getting:Geodatabase Error (-2147467259): General function failure. Could not read Field `column_name' in Table `Table_name'Does somebody know where the issue can be?Appreciate any help!Thanks.

DonutBuilder: Two Polygons on different heights, incorrect donut – random heights assignment

I am writing a CityGML file by reading the LOD2 3D building models from the DGN file.While reading the DGN, grouped holes are exploded, i.e. “Expand Unnamed (Group Hole) Cells: Yes” and then DonutBuilder is used to re-build the required geometry, i.e. grouped holes. However, rebuilding the grouped holes with the DonutBuilder for the polygons at different heights does not work properly and seems to randomly assign the Z from either the top or bottom or some from bottom and some from top. Please see screen grabs below showing building superstructures:The part that re-builds polygon cutouts is as follows: I used the Group By: “igds_cell_name_sequence_number” from the original DGN grouped hole cells that got expanded when read in order to rebuild them again with DonutBuilder. I tried different Z Modes but it did not help to prevent from incorrect group hole building It seems to be random, in some cases it will built a correct geometry, in other, it will do the incorrect “unexpected” geomet

6 years ago

mickael

asked in Data

How does FME attributes work with OSM tags ?

Hello,I am trying to work with data from OpenStreetMap, and I have an issue with retrieving tags. The only tags I get are the ones related to 1st level types. Other attributes appear in the inspector right panel, but I cannot access it from in my workflow. So what is the difference between attributes from the Table View and the Feature Information ? Is there any way to access those specific features information from the Workbench ? Strangely enough, when I check the "Determine feature by scanning the entire dataset", all tags also appears in the Inspector Table View (with a lot of missing values). But I cannot use that option from my main workflow, as my dataset is an URL (returning an OSM XML file). So far, I am only looking for a few attibutes on a few elements, like the "layer" value for highways (which indicates if they are underground and above or below other highways). Any help would be much appreciated, as this is very important for my work :)

PDF transformation problems

I'm struggling to transform some pdfs. I am using the PDFtoTEXT transformer as well as a textwriter, stringsearcher, maybe calling to python, and then writing it to a database. I'm flummoxed at the first step.Sometimes it'll write a pdf to a textfile. But often the pdf2text program box pops up. That's useless for automation. What I want is for it to read a whole folder of texts - found the place to specify that - and process each of them into a complex row in my database with many different values. The pdf contains a couple values in the headers and many more in a table-like layout. I will need a couple string parsing processes to get through all that. No idea how to get it to read the pdf name and put that in one cell in my db.But the data inspectors are useless. The interface says the transformation was successful - but nothing was written to the output.txt.So - issues:- how to process multiple texts- how to see what's going on so I know it's working properly

How do I create a working .dwg file from a paper copy of a drawing that I scanned and saved as a PDF?

6 years ago

michuup

asked in Data

Convert osm pbf to shapefiles

hi, what I do wrong when convert osm pbf to shp? i try to create a simple workspace but i got nothing = and i try manual add reader and writer, and i have errors = can anyone help me?

954

6 years ago

esakaParticipant

asked in Data

FME Server smallworld workbench error

Hi,FME Server is not able to lunch the workbench which is able to work correctly via desktop.If I select only one reader+writer that is able to work. However when I launch the whole reader-writer, than is getting error. I have attached the Smallworld-emacs error and the log file.My goal is that I would like to download the whole data from SMALLWORLD to SL3/FFS any different database format daily via fme server schedules. I have prepared a workbench you can find below. 1 million records include.

Hi,I have a TXT file (point cloud) containing 2 columns col1=X and col2=Y.I want to create groups every 1cm (according to X axis) and compute for each group Xmean, Ymean, Ymin and Ymax.I think it is necessary to create a point cloud and then create slice of points (every 1cm) but I don't know how to do this.Thank you for your help.

6 years ago

mvdorst

asked in Data

ECW spatial data: check if it's there and store it in postgis raster

Hi,I'm new to spatial data and ECW files. I've got a ECW file that needs to be inserted into a postgis raster database. All the proper extentions are installed on the database side. I currently load the file into a RasterTiler and then into a postgis writer. The rastertiler was needed otherwise it would not load the file into the database. I'm not sure when raster size I should use, but it's currently set to 256 by 256. But when my colleague tries to view the file from the postgis raster database with several different GEO applications, the error always says that spatial data is missing. So: how to I check if the source file has spatial data? Do I need to change something to the postgis raster writer? Or maybe to the RasterTiler transformer? Thanks so much! In advance for any help.

Convert from Esri shapefile to PostgreSQL database but result is missing geometry.

Hi, Im trying to convert my from Esri shapefile to PostgreSQL database, but the result is not good because the geometry is gone. Im using FME for the first time and dont know where is the problem. Please help!

How to get Shape files to convert to DWG with elevations?

ECW writer: This format does not support writing the RGB/RGBA bands in the raster with other extra bands.

I have an 8-bit raster image (jp2) which I need to convert to ecw format. A fatal error occurred and the message was "ECW writer: This format does not support writing the RGB/RGBA bands in the raster with other extra bands. Please remove the extra bands and try again". How can I fix it?

411

6 years ago

jhawksContributor

asked in Data

Kml View Setter: Is there a way to remove the Navigation Tree Name? It won't accept no value. I want to remove the X in attached screenshot.

6 years ago

wedea

asked in Data

OGC GeoPackage metadata: geometry registered as a common geometry type: "geometry"

Whenever I write features into a GeoPackage Table, this table is registered in the GPKG_GEOMETRY_COLUMNS table. FME registers all the tables I create with geometry_type_name: GEOMETRY. I expected that FME would register my table with point features as geometry type POINT, tables with polygon features as POLYGON, etc., as prescribed in the GeoPackage-specification. Tables registered as GEOMETRY are recognized by QGIS as a feature class with unknown feature type. Which makes sense.How do I enforce FME to register the correct geometry type for my tables, preferably in a workbench with a dynamic reader (PostGIS) and writer (GeoPackage)? Wim

How do i convert multiple feature classes to .kmls

I tried to convert multiple feature classes to .kml, and using a test filter assign color coding then out to a writer . but the end result is just one kml. how do i get a klm for each feature class.

6 years ago

jhawksContributor

asked in Data

KMLViewSetter trouble getting it work, see workbench:

https://www.safe.com/transformers/kml-view-setter/I've been looking at the KMLViewSetter transformer, but when I set lat/long values in there it continues to open to the default location in Google Earth. I've tried using the values in the doc example, but it still opens to the default location. I might be missing something - but has anyone got this to work and could help me out?FME(R) 2018.1.0.0 (20180321 - Build 18442 - WIN32

6 years ago

dkirouac

asked in Data

Error updating arcgis online feature service

When trying to update a hosted feature service (truncate,insert) that was creating from ArcGIS I get an error that the service name already exists. I have a feature service that I create with FME using the same data and I can update that service without any problem.Is there any reason why I can update the service created with FME but not the service created from ArcGIS Desktop? The properties on the services are the identical and owned by the same account.

Process still runs after successful translation in Desktop 2017.1 writing to ESRI SDE db

Using this to grab data from an XML feed and writing to ArcGIS SDE database and the process doesn't stop after successful translation. Any help would be appreciated, thanks!!Same issue

6 years ago

yonasfme

asked in Data

The error number from ArcObjects is: '-2147155559'.

I'm loading data (450k polygons) from FGDB into SDE. Versioning is enabled.The Transaction Type is a Versioned Edit Session and my Writer Mode is Insert. I have Drop Table as No and Truncate Table as Yes. The writing is very slow and after running for 3 hrs and 43 min the transaction failed with the following error:An error occurred while attempting to start an edit operation. The error number from ArcObjects is: '-2147155559'. The error message from ArcObjects is: {Failure to access the DBMS server [08S01:[Microsoft][SQL Server Native Client 11.0]TCP Provider: The specified network name is no longer available. ] [sde.DEFAULT]}Here is the log file: Any idea why it is throwing that error?Thanks.

Adding custom parameters to an IFC Object

Hi, I would like to take a .IFC file and add some parameters to a 3D object. I have an extract of the coding used when exported from a software platform but I wanted to know if I could take an existing IFC into FME, Expose all of the objects within the file and add parameters to an object taken from a spreadsheet?#1615=IFCRELDEFINESBYPROPERTIES('9637335e-cf0f-59a1-8f9b-a375089be97f',#2,'Property Association','IfcPropertySet associated to element',(#33),#1609); #1616=IFCPROPERTYSET('1e82cc66-a22a-63d7-9d26-f8590c0c95ad',#2,'DWF - User attributes','',(#1617,#1618,#1619,#1620,#1621,#1622,#1623,#1624,#1625,#1626)); #1617=IFCPROPERTYSINGLEVALUE('User Attribute 01',$,IFCTEXT('Project X'),$); #1618=IFCPROPERTYSINGLEVALUE('User Attribute 02',$,IFCTEXT('L8'),$); #1619=IFCPROPERTYSINGLEVALUE('User Attribute 03',$,IFCTEXT('Staircase'),$); #1620=IFCPROPERTYSINGLEVALUE('User Attribute 04',$,IFCTE

Feature holder not working

Hi,I have a workspace that makes an initial SQL database call to write to a table that generates an id key that subsequent database writers require. The problem is that the initial call doesn't seem to close/finish writing before the subsequent calls look for the id key. I have placed a feature holder before the subsequent calls but if the records fall below a certain number the process fails (and the initial table is not populated). Over a certain number or records the process is fine. Any ideas?Thanks!Sam

Problem converting Revit (RVZ) to Cesium 3D Tiles.

Hello, I am trying to convert a Revit model in RVZ format to a Cesium 3D tile. However when the transformation is run I get a warning that says "Geometries which cannot be converted to a triangulated mesh will not be written" for some of the geometry. Is there anyway to fix this or to tell way some of the geometry does work and some of it doesn't?

112

6 years ago

Page 164 / 272

Badge winners

buraskyhas earned the badge English Speaker
buraskyhas earned the badge Welcome Back
lazarlubomirhas earned the badge Student (Bronze)
lazarlubomirhas earned the badge Student (Grey)
lazarlubomirhas earned the badge Teacher (Silver)

Show all badges

30,108: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.