- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,779 Posts
24,930 Replies

When you subscribe we will email you when there is a new topic in this category

6779 Posts

Recently active

Most replies Most views Newest first

captonssj

asked in Data

What software or extension do I need for connectin gfrom FME 64 bit to ArcFM 10.6.1a GeoDatabase (ESRI version 10.6.1) running on Oracle 19c? We know the 32 bit FME can connect with ArcFM using the Object Reader library but couldn't get 64 bit FME to

142

3 years ago

chriswilsonContributor

asked in Data

Issue writing to ArcGIS Online - error code 1000

I gather @runneals has also had this. Writing (truncating) to an ArcGIS Online feature service (that was created by FME) fails with the following error. WARN |ArcGIS Online Feature Service Writer: 'addResults' error for a feature in 'MAP_WS_POINT'. The error code from the server was '1000' and the message was: 'The type initializer for '' threw an exception.' 2021-01-25 23:34:13| 24.4| 0.2|WARN |... Last line repeated 999 times ... 2021-01-25 23:34:13| 24.4| 0.0|ERROR |ArcGIS Online Feature Service Writer: 10000 features successfully written to 'MAP_WS_POINT', but the server rejected the 1000 features in the last request due to errors Anyone else getting this? Have asked our vendor but just posting here for wider visibility. It came up for the first time last night.

Convert classified .mrr grid to polygons

I'm new to FME, but we brought it in to manage the new Mapinfo .mrr grids we were getting. I'm having a few problems getting my head around it though.I'm trying to contour a classified .mrr file, with One band (0) and two Palettes (0,1).I want to write polygons with the Palette 1 string values(eg. AAA-1, AAA-2, AAB-1, AAC-1) so I used RasterSelector to pick band 0 and Palette 1 the RasterToPolygonCoercer to create a .tab polygon file. It writes the polygons correctly but assigns BAND 0 value not the palette value.What do I need to do to expose the Palette value?Edit: I'm using RasterPaletteResolver on the grid but it seems to crash on a <Rejected> feature...Palette Keys -> Values : Band 3 : Palette 0 : 2195 -> AAA-1 Palette Keys -> Values : Band 3 : Palette 0 : 2196 -> AAB-1 =========================================================================== RasterPaletteResolver_<Rejected>(TeeFactory): RasterPaletteResolver_<Rejected>: Termination

FME 2020: How to bring the value of point layer into polygons with the “SpatialRelator” tool?

FME 2020: How to bring the value of point layer into polygons with the “SpatialRelator” tool? In the screenshot below, I wanted to bring the values of a particular field of point layer into polygons with the “SpatialRelator” tool but appears not to work. What could be the issue here?The data is attached

3 years ago

messagemauriContributor

asked in Data

Access a URL Zip file with shp file in it

I have an FME Desktop Workbench 2019, with a Reader transformer that reads a webstie zip file and its shapefile. When I run this manually on Desktop it works fine and it can obtain the shapefile and read it. I need to automate this to run daily. When I publish this workbench to FME Server and run it there, I get the following error: 49 ESRISHAPE Reader: Dataset `C:\\Users\\FME-SVC\\AppData\\Local\\Temp\\fmeengines\\CAL-FME-GIS_Engine1\\FME_TempFileStore_1611253240189_1116820\\PLA_RTF_SHP.zip' lacks the required extension `shp' What transformer can I use instead of the reader so it can work in FME Server? Or should I download the zip file with HTTPCaller, store it in the server and then attempt to read it from the server? But I need to read the shapefile in the zip file. Is there a process or method anyone is familiar with to automate this in FME Server? Thank you.

Read/Write Access to DWG Summary Info (DWG Properties)?

I managed to add SummaryInfo Comments (also known as DWG properties) to DWG files (created by FME Desktop) using ObjectDBX in a Windows Powershell post process and wonder if it is possible to do it directly in FME Desktop:$srcDir = "C:\DWG\infiles\"$tgtDir = "C:\DWG\outfiles\"$errorFile = 'C:\DWG\error.log'$comments = 'C:\DWG\comments.csv' $AutoCad = New-Object -ComObject Autocad.Application$AcadVer = $AutoCad.ActiveDocument.GetVariable("ACADVER")$AcadVer = $AcadVer.Split(".")[0]$DbxId = "ObjectDBX.AXDbDocument."+$AcadVer$Dbx = $AutoCAD.GetInterfaceObject($DbxId) foreach($line in Get-Content $comments -Encoding UTF8){ $data = $line.Split(";") Write-Host $data[0] try{ $Dbx.Open($srcDir+$data[0]+".dwg") $Dbx.SummaryInfo.Comments = $data[1] $Dbx.SaveAs($tgtDir+$data[0]+".dwg") } catch{ $error_msg = $srcDir+$data[0]+".dwg" Out-File -FilePath $errorFile -Append -InputObject $error_msg Write-Host "Error: ",$data[0] }}comments.csv:4233-15_1;Last Change - VA40:21.10.20204

190

3 years ago

ostojaContributor

asked in Data

"Error running translation" when writting data to ESRI ArcSDE table

I have a very basic workbench, which reads data from FFS files and should write around 15000 lines in the ESRI ArcSDE Table (SQL Server 2014). Unfortunately, when the workbench is ready to write the data in the table, I receive "Error running translation" with two BADNEWS issues in log which appear only in Debug mode:....ArcSDE release: '10.0'. Underlying database: 'SQL Server'A default z-value of '0' will be used for all 3D features where z-values are not providedGeodatabase Writer: Not simplifying geometries being written to the GeodatabaseError running translation......Kindly find complete log here The writer which I use is "Esri Geodatabase (ArcSDE Geodb)". The same behavior I have with writer "Esri Geodatabase (Personal Geodb)" but if I change the writer to pure Microsoft Access, I am able to write in the data. In the Win Event Viewer I can find two error messages each time I execute the test (sorry that it is in German)I am u

4910

3 years ago

r_hueskenContributor

asked in Data

Cannot read a TIN from a geopackage

Hi,I have a problem with adding a reader for a geopackage that contains a TIN. Adding the reader fails with the message: "No geometry mapping entry found for 'wkb_point' in metafile 'C:\\Program Files\\FME\\2020.1.0.1\\metafile\\OGCGEOPACKAGE.fmf'" Data is somewhat strange, since the layer identifiers are long (way over 30 positions) and contain spaces and minus signs. In QGIS, the data is displayed correctly though... Any idea what might be causing this error? The data is proprietary, so I can not share. I'm using FME 2020.1.0.1.

How to GeoServer to IFC?

Hey thereI don't know if this is the right place to ask but here we go anyways.I am trying to get data from a geoserver and transform 2D Data into 3D Data as an IFC. I am absolutely new to FME and I am struggeling to achieve anything. I tried that short example with AutoCAD to IFC Conversion: https://community.safe.com/s/article/autocad-to-ifc-conversion-example I Mean, it works fine, but I dont know what it does exactly. I somehow want to do the same, but instead of a AutoCAD building I want to transform some objects from a geoserver (electricity lines or other objects that are in 2D) into an IFC. Can someone give me some tips? Greetings,Philipp

3 years ago

kieranmg

asked in Data

Em dash - En dash UTF8 and all that Jazz

Hi Community,First post :)I have an IMAP publisher which downloads GML attachments. The files containing folder name is based on the email subject i believe. This seems to work perfectly when this file path is being processed by the Workspace subscriber. However, when the email subject contains an em/en dash character (i'm guessing anything not UTF8) the folder is then saved with the special replacement character in its name as shown.Once the workspace runs, it tries to use a JSONFeature to read the Topic message but the filepath is incorrect. FME log shows something like the following;XML Parser error: 'unable to open primary document entity '<FILEPATH>\\DBYD\\Incoming\\<FILENAME>_2??12_<FOLDERNAME>\\<FILENAME>_LLGDA94.GML'' Anyone any recommendations on how to deal with this please? Many thanksK

3 years ago

fmehippo

asked in Data

Is there a way of using the generated list of selected attributes 'values' created under the 'attribute accumulation' option of the PointOnAreaOverlayer Transformer to identify if a polygon feature contains the correct number of point features?

I have two inputs, a polygon shape file and a point shape file. The polygon shape file contains two area polygons, A and B. Each has a single, name attribute - A and B respectively. The point file contains 30 points and they also have a single name attribute, with attribute values ranging from A to E. Some of these points fall inside the polygons and others do not.As a rule, polygon A must only contain two A points and one E point while polygon B must only contain two B points and one E point. I input both shapefiles into PointOnAreaOverlayer transformer which filters out all points falling outside of the polygons. Within this transformer, I generate an attribute accumulation list on the Area outputs, with the selected attribute set to 'name'. Using listElementCounter, I can see if the correct number of points fall in each polygon - in this case 3. Using ListConcatenator, I can create an attribute listing the names of the points that fall in to the polygon, eg- A, A, E.I can

3 years ago

aneta

asked in Data

How to combine informations from the IfcPropertySet and PropertySetDefinition sections with the correct IFC object?

I try to import IFC file. I have a problem with combine informations from the IfcPropertySet and PropertySetDefinition sections. IfcPropertySet includes only: globalId, ifc_unique_Id and ifc_property_set_name. When I extructed elements from PropertySetDefinition section I see: ifc_property_set_name, ifc_properties.data_type, ifc_properties.name, ifc_properties.property_type.I don't see values for the name. What could be the reason for this?There is no id attribute. How do I connect these attributes with the right objects?

3 years ago

juanmahereSupporter

asked in Data

SHP and TAB have large differences on file size for same features. Why?

Hi,I may be missing some information regarding the TAB format, but I find quite inexplicable this behavior on file sizes: After creating a couple of layers, and sent to different formats (SHP and TAB) I appreciated that some of the brand new layers have large differences on sizes when comparing with same layers from a past delivery.Here are the figures from the 20th and 21st version of same layer: So, the new layer has decreased in vertexes, that's not peculiar, the strange thing is that with around 1k less vertexes SHP files decreased around 70MBs (0.001%) while TAB files decreased 141.000 MBs (55%). Is there any explanation for this? Thanks for your help!Juanma,

181

3 years ago

tomfContributor

asked in Data

Using functions such as @round() inside the XMLTemplater drops data

This is probably a simple question, but I'm having difficulty rounding values within the xml editor of the XMLTemplator.With the root template set to:<feature> <number>{fme:get-attribute("NUMBER")}</number></feature>The NUMBER value is written in the output. But when I use:<feature> <number>@round({fme:get-attribute("NUMBER")},3)</number></feature>or even:<feature> <number>@Evaluate(@round({fme:get-attribute("NUMBER")},3))</number></feature>the xml returned contains an empty string:<?xml version="1.0" encoding="UTF-8"?><feature> <number/></feature>I could round with an AttributeRounder prior to the XMLTemplater, but although that rounds the values in Visual Preview, the xml output can and does contain the floating point representation errors.I'm guessing this might be a syntax thing but I've had no joy yet implementing this in the editor.(FME 2020.1 b20620)

How do I translate "groups" into 3D tiles?

Hi. I am trying to take a 3D model that is build with several grouped geometries into components. Source format is flexible, but say I have an OBJ file with "g" lines in it that define groupings of parts of my model. I can't seem to see these groupings in FME or export them into 3D tiles - I get one single group for the entire output model.

3 years ago

checcosisaniContributor

asked in Data

CSS Selector

Hi guys i found alot of question about CSS selectorbut no answer to my case so I tried to post my question How can select the blue info <span>ISTITUZIONE TEMPORANEA DEL DIVIETO DI SOSTA PERMANENTE CON RIMOZIONE COATTA DEI VEICOLI IN UN TRATTO DI VIA DONATO BRAMANTE.</span> which CSS I have to use ? Sorry I'm new but the help need more more more examples from my point of view thx for support Francesco

3 years ago

annette2Contributor

asked in Data

Writing an Excel formula where Use attribute names as column positions is set to yes not working

Hi,I have a complex Excel report that we have worked on for half a year on and off as part of an ArcGIS Survey123 project. The users have requested a formula in the Excel. I am using attribute names as column positions and have not been able to get it working.I have tested it in an apart workspace:This works: This does not work: I get the error which I would expect: 2019-10-11 16:24:04| 2.5| 0.0|ERROR |Excel Writer: Column name 'Q.formula' for sheet 'Sheet1' could not be used as a column position. It either contains non-alphabetic characters or is beyond the maximum column of XFD for XLSX or IV for XLS If Q.formula is not present in the output feature class than the formula does not write either. Is there a way to write a formula to an Excel sheet using the Use attribute Names As Column Positions parameter = Yes?

1646

3 years ago

shivsParticipant

asked in Data

When i try to copy a table from a sde database to another sde database i get an error

When i try to copy a table from a sde database to another sde database i get the following warning."Could not find the features in the table 'tablename'. One possible reason is that a WHERE clause was specified that references a column/field that does not exist in the table. The error number from ArcObjects is: '-2147216086'. The error message from ArcObjects is: {Attribute column not found [tablename][STATE_ID = 797]" Also i get info "2021-01-11 17:05:12| 0.6| 0.0|INFORM|MULTI_READER(MULTI_READER): Will fail with first member reader failure" Can someone tell what am i doing wrong here ?

502

3 years ago

tsaryniukContributor

asked in Data

PostgreSQL 12 reading error

Hi all,There is a issue connecting to Postgresql 12.Error executing SQL command ('SELECT c.relhasoids AS oids FROM pg_class c INNER JOIN pg_namespace n ON n.oid = c.relnamespace WHERE ...... 'ERROR: column c.relhasoids does not existAccording to PostgreSQL 12 documentation, the "relhasoids" column has been removed from release 12.The error appears on both readers(PostgreSQL\PostGIS) and on different versions of FME Desktop: 18.1; 19.1; 20_beta.At the same time, the SQLCreator transformer reads the database without any problems.Has anyone else tested how FME works with new PostgreSQL 12?

Remove outliers of point clouds to extract the roof height

I have clipped point clouds of buildings and I would like to calculate the maximum height from these point clouds, but without chimneys and other small features. Is it possible to retrieve more detailed point cloud statistics which can be used for this? I am not looking for the median of average values of the point clouds, but really the maximum z-values of the roof constructions.

Esri Geodatabase (ArcSDE Geodb) writer is not updating features despite log indicating successful translation

My workspace compares data from an Oracle database and a versioned SQL Server backed Esri Geodatabase. The Oracle database contains mostly CAD and MapInfo data. It's the source of truth for the data. The SQL Server database is the destination where changes to the source should get written. I am using a change detector to determine if there are any differences between the features. The process generally works ok. The change detector populates the fme_db_operation attribute appropriately, and I'm using that to set the Feature Operation. My problem is that the process doesn't seem to update the features. The log indicates that it wrote the features and that the translation was successful. However, when I try to view the data in ArcGIS Pro, I'm not seeing the changes. If the process was successful, if I ran it again, I should see zero features that need to be updated. However, I get the same number of features that need to be updated over and over again. What could be ca

604

3 years ago

lifalin2016Contributor

asked in Data

Creating DGN v8 files with embedded attributes ?

Hi.Am I correct in assuming, that the DGNV8 writer cannot output neither tags nor XAttributes ?I found this tutorial on writing tags, but it doesn't seem to work: https://community.safe.com/s/article/writing-microstation-dgn-tags-with-fmeI then found this page, that says that both tags and XAttributes can be read, but not written: https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/igds/DGNV8_reader.htmCan or cannot ?

Oracle connection issue: 'DEC-MCS' is not recognized as a valid encoding name.

HiMy setup:Mac OS Big SurFME(R) 2020.2.1.0 (20201130 - Build 20806 - macosx)Oracle Client installed (Version 19.8.0.0.0) Connection is set up correctly (for example giving wrong username I get error: Error connecting to Oracle database: message was `ORA-01017: invalid username/password) And when giving correct credentials I get error:ORACLE_AUTONOMOUS_NONSPATIAL reader: 'DEC-MCS' is not recognized as a valid encoding name. Any ideas what to try?

Unexpected Input during conversion from IFC to CityGML

Good morning, i have to use the FME software for my master thesis work. I'm trying to convert an IFC file to CityGML to put it next in QGis. I'm using just the readers i need to use for my purpose (Ifcdoor, Ifcwindow, ecc..) but during the translation the Unexpected Input says i have three types of features which cannot be converted, and that stops the whole conversion. Do you have any idea on how and where to connect those features? Because i don't really need those features, but it seems like there is no way of let the software to not consider them.

Difference between DatabaseUpdater and Feature Operation in Writer

I'm wondering what the difference is between the DatabaseUpdater transformer and setting the Feature Operation to Update in a database writer.I know there is a lot of overlap is some of the transformers in FME so i'm wondering if one is better or if they'll do the same thing.

122

3 years ago

Page 55 / 272

Badge winners

lachlan.thas earned the badge Welcome Back
alanbchas earned the badge Student (Grey)
alanbchas earned the badge Teacher (Grey)
digit42has earned the badge Expert (Grey)
ccantuhas earned the badge Welcome Back

Show all badges

30,121: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.