- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,779 Posts
24,931 Replies

When you subscribe we will email you when there is a new topic in this category

6779 Posts

Recently active

Most replies Most views Newest first

chris_disguise

asked in Data

I need to convert a collection of GEOTIFFs to a format that can be uploaded to Cesium Ion with the spatial reference system intact.

I've been trying to convert them to PNGs and TFWs but with everything I've tried so far, Cesium tells me "Missing or invalid spatial reference system".

203

2 years ago

gisbradoklaEnthusiast

asked in Data

convert ascii format from TX RRC into usable data. (308 bytes per record, schema description with beginning, ending positions.

I have many files in this ascii format. The RRC has MAGNETIC TAPE USER GUIDE with field descriptions that contain beginning and ending positions. I have attempted to use the schema mapper with csv file that describes this but have yet to figure out how to make that work.please help,Files are located here. The file looks like this...The format description is like total bytes per record 308 bytes. MASTER FILE TAPE RECORD SEGMENT KEY NAME DESCRIPTION 01 DAROOT DA ROOT SEGMENT 02 DAPERMIT DA PERMIT MASTER SEGMENT 03 DAFIELD DA FIELD SEGMENT 04 DAFLDSPC DA FIELD SPECIFIC DATA SEGMENT 05 DAFLDBHL DA FIELD BOTTOM-HOLE LOCATION SEGMENT 06 DACANRES DA CANNED RESTRICTIONS 07 DACANFLD DA CANNED RESTRICT

491

2 years ago

daveapeggContributor

asked in Data

How can I stop the Dynamic GDB Writer from writing the "_resolved" attribute after resolving the domains?

I am writing to a Dynamic GDB writer using an existing GDB with Domains as the Schema Source. I am resolving the domains otherwise just the values come across, but it is also creating a new attribute called "attribute_resolved" which is then being written into the feature class in the GDB. I have tried to use an attribute remover and an attribute manager to remove these attributes prior to writing, but they still get written. Strangely these attributes don't exist in the Attributes To Remove dropdown list in the Writer. Any help would be greatly appreciated.

2 years ago

jiroContributor

asked in Data

Updating a Geopackage file issue

Hi,I need to update geospatial data in Geopackage format from a Google Sheet file that contains addresses to geocode that are updated regularly. The process of creating points via geocoding works very well. However, I need to create buffers around points based on an attribute of a field and use the existing Geopackage output file to add the update news. I also have to update the output file of the points in order to add the new entities to the Geopackage file by specifying in my output file the table to update. Unfortunately, when I run my workspace I get the following error message:OGCGEOPACKAGE writer: Requested feature type 'zone_buffer_300m' does not exist. OGCGEOPACKAGE writer does not have the ability to create new feature types. Create the feature type on the dataset before writingOGCGEOPACKAGE writer: A fatal error has occurred. Check the logfile above for details.Attached is a screenshot of the output file configuration settings window and the entire FME workspace.Tha

382

2 years ago

jhawksContributor

asked in Data

Missing DLL's in Server logs:

FME Server 2022.0.0.2 702022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\plugins/that_func.dll' : 'The specified module could not be found'712022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\that_func.dll' : 'The specified module could not be found'722022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\plugins/that.dll' : 'The specified module could not be found'732022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\that.dll' : 'The specified module could not be found'https://community.safe.com/s/article/Known-Issue-Instability-Running-Python-on-FME-2022-0-for-Windows-10-and-Windows-Server-2019-Version-1909-or-Older

152

2 years ago

juanmahereSupporter

asked in Data

ArcGIS Online Feature Service 'XXX_layer' does not support writer mode

Hi all,I'm encountering an issue while reading from a PostgreSQL DB and trying to write into a AGOL Feature Service. If I run using the FME Desktop 2021.2, the process run perfectly, reading and writing the Feature Service. When uploading the Workspace into FME Server (FME Server 2021.2.3 Build 21812 - linux-x64), and running it, the message is this one: ""2022-7-15 14:15:44 | ArcGIS Online Feature Service Writer: Feature Service 'xxx_layer' does not support writer mode ''. Its owner may have disabled inserting or editing features. Writes may fail if the current user is not the owner or administrator""Although telling me the correct of the Features were written. From AGOL, I've checked that is ENABLED the edition on features. Also, the FME Server has correctly Authorized. Is there something that I'm not having into account?Thanks,

731

2 years ago

tb09114Contributor

asked in Data

Usability of DGN seed files

Earlier I asked about writing out DGN files with coordinate system.That's apparently not possible until now. But I would like to know how I can use seed files to get at least the symbology of a seed file into the DGNV8 writer. I referenced the seed file in the settings part of the DGNV8I reference a cell file in the settings as well I read my data in, define the level names in an AttributeManager based on the input data, use the PROJReprojector, to adjust the input data to the coordinate system of the seed file, and connect to a dynamic DGNV8 writer. In the DGNV8 writer I am missing the possibility to state that colour, style and weight will be used on the level, and not the individual object in the level. The level and level overrides section in the writer I cannot understand. My output dgn consists of multiple levels, yet the settings seem to point at one level only.Hence, I do not know how to configure the writer correctly.Leaving the level settings part undefined, but setting

Problem when calculating volume with Reader Revit

Hello,For a job, i need to calculate the volume of a 3D object. The object has curve (its a piping)If I read the data with Revit Reader and calcul the volume, the volume is smaller than in Revit. (more than 1 cube meter)If I export the model in IFC the volume in quantity set in the same as in Revit, but if I I calculate the Volume, it's too smaller than in Revit but it's almost the same.I compared the export IFC and the the Revit file in Data Inspector. The number of facets is bigger in IFC than Revit.My question is : how i can increase the number of facet in the Reader Revit so that the definition of my object is more accurate?thank you for our help

jasperwisEnthusiast

Hi, I use a DGNStyler to set the color of line features.Color is set by RGB Color (Color Type = RGB). In the resulting DGN, the color of the line is replaced by the best matching color from the color table. Result (Color 59):Desired Result (204,0,0):Is there a way to get the desired result? Jasper

Create IfcOpeningElement in ifcWall

I'm not very advanced in FME and ifc-Conversion. I would like to place an IfcOpeningElement in a IfcWall (and afterwards place a window or door in it). With the excercise "AutoCAD to IFC Conversion Example" I was able to create my walls and openings. But I'm not able connect the two elements. I guess I need to create an IfcRelVoidsElement. But how can I get the corresponding RelatingBuildingElement and RelatedOpeningElement? From the geometries I get the relationship. But how can I link these to correct EXPRESS-ID (eg #23)? I will add a screenshot from my workbench and the (as txt-File) I get as result. It would be great if someone can help me! Thank you very much in advanced! Greetings from Switzerland

402

2 years ago

arnovananrooijContributor

asked in Data

How to get schema from FeatureReader when login username is schemaname

Hi,I'am trying to read a schema from an Oracle table through the FeatureReader. This works well for lets say TEMP.TABLE when the connection user is a different name than TEMP. When I connect using a user TEMP I don't get a schema. But after removing TEMP. the FeatureReader returns a schema. This if no problem when I know in advance which user is connecting, but in my case it's all dynamic. We use connection names and the user behind this connection can be the same as where the tables are stored.Is this a bug? Or does anyone have a solution? Thank you,Arno

2 years ago

siriosus

asked in Data

Can't read events from Azure EventHubs using AzureEventHubsConnector

Hello FME Community I'm getting following error when trying to read events from Azure EventHubs using AzureEventHubsConnector: Python Exception <TypeError>: Message data is not compatible with string type: 'generator' object has no attribute 'decode'All parameters were set correctly and events are actually passing through other clients. Thank you in advance!

How do I set up connection for trainingdatabase

Hi I am trying to set up the trainingdatabase and are using the correct credentials that is specified in course. host: postgis.train.safe.com, port 5432, DB fmedata User fmedata PW fmedata. When test i got no answer from server. Tested in cmd and it seems to be down?..

2 years ago

joeriContributor

asked in Data

Remove layer from PDF (flatten)

I'm using a geospatial pdf writer to export a map that was styled with a PDFPageFormatter. The PDF opens correctly in Adobe reader, but not in a webbrowser (Chrome/Firefox). After removing the layer by flattening the pdf (using an online tool or Ghostscript) opening the PDF in a webbrowser is possible. Is there a possibility in FME to flatten the PDF, the PDF-writer always demands a layer name... So writing without creating a layer is impossible.

1153

2 years ago

galigisEnthusiast

asked in Data

Read 'Element Information' from a DGN V8 file

Hi Community, How can I read / expose the element information from a DGN file? Need to be able to read General > Description as the following screenshot shows:I have already played around with the Reader DGN parameters (e.g. read tag attributes, Read XAttributes, etc) with no success. Any help would be much appreciated. Thank

12612

2 years ago

tb09114Contributor

asked in Data

Is there a way to access S57 data that are password restricted?

I have data in S57 format coming from the UK Hydrographic Office (UKHO) which I need to read into FME.When I try to read them in I get the following error message: DE4OS09G.000 isn't an S-57 data file, or catalog.Failed to obtain any schemas from reader 'S57' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. I tried to read them with FME 2022.0.0.2 (20220518 - Build 22343 - WIN64), and as I point out in the question, the access to the files is restricted. There is at least an UPN (User Permit Number) needed to read the data. I do have one, but no possibility in FME to make use of it.

How to prevent text to get stacked when writing to DGN

I've got a set of polygons from a PostGis DB and want to write them to DGN. On one level, I've got the polygons and on another level, named label, I want to put out a text string from an attribute. Some of the polygons have more than one entry here, which leads to stacked texts - I've used a centerpoint replacer, labelpointreplacer and dgnstyler. I guess when only having two or three entries, I could solve the problem by subtracting a fixed value from "igds_insertion_y", but I don't know how many entries will be there in advance and already encountered some cases where a polygon had 40 to 50 entries I have to write one below the other.

2 years ago

tb09114Contributor

asked in Data

How to write DGNV8 and get the right colors/styles/weights?

I am reading some data from a database in, using the DGNStyler I set the color type to color index, define the color index; and set the line style with weight and style.Than I am forcing all data through a 2DForcer and finally I am using a DGNV8 writer to write to disk. I guess the problem starts with me not being used to DGN and/or the viewer, but essentially I am not getting the styles I defined.As you can see, the color index is the same in both viewers, but the color shown differ from each other (The left should be a mirror of the right.). Also, the level weight should be 3, and was also as such defined in the DGNStyler.Overrides have I defined within the writer:but the overrides are entirely neglected. Finally, there is the thing with 3D vs 2D. I thought my file is generated as a 3D file because of my data and added the 2DForcer. However, that does not change anything on the output. Maybe that's just me not knowing my ways around in the viewer... However, I have to get the sty

2 years ago

michiedemContributor

asked in Data

Arcgis Pro aprx projectfile encoding

I would like to know what datasets we use. For this I would like to read the Arcgis Pro project files (.aprx). Does anyone know what encoding is used for this file type?

634

2 years ago

zhangwei1023Participant

asked in Data

boundingVolume and geometricError is not correct in cesium 3dtiles

when I write cesium 3dtiles ，then got a tileset.json 。The boundingVolume of the tile is smaller than the content boundingVolume 。And the geometricError of the tile almost is same 。

AWS Region Detection in S3Uploader

Hi all,We're attempting to use S3Uploader in FME 2015.1.1 and FME 2016.1 to upload data to a bucket in ap-southeast-2 (Sydney), but we're receiving an error from AWS that seems to indicate that FME is not uploading to ap-southeast-2.“The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint. (Service: Amazon S3; Status Code: 301; Error Code: PermanentRedirect;”Googling this error results in many bug reports from other software using AWS where they have forgotten to specify an AWS region, and it's defaulted to a different region than where their bucket resides.According to FME's documentation here, our AWS region should be automatically detected."As of build 2015.1.1, all AWS transformers support multiple regions. You don't have to do anything we automatically detect the region."We've been unable to find any further information about how the automatic detection works, or how

113

2 years ago

galigisEnthusiast

asked in Data

Create DWG leaders based on autocad_leader

Hi All, I'm trying to create DWG leaders based on the following post: https://community.safe.com/s/question/0D54Q000080hahzSAA/how-creat-autocadleaderbut couldn't get to work. I use autocad_leader settings as the post suggestsbut the leaders aren't coming through. Could anyone point me in the right direction on how to get the autocad_entity to work? I'm attaching a few screenshots of the workflow as well as the parameters. Thanks All :)

Writing too many records to ArcGIS Online.

Hi, I am having a problem with FME doing truncates/inserts to an ArcGIS Online hosted layer. Sometimes the number of records in AGOL is 1000 more than FME says it is writing. If I run FME again it is 2000 records too many, 3000 when run again. This is happening in Workbench and Server 2020.2 but does not happen all the time. Features per request in the writer is set to 1000. This has not been a problem writing to other formats and I have other FME services writing to other AGOL layers without issues. Thanks, David

311

2 years ago

charryContributor

asked in Data

put the 3D pipe on a straight line

I want to put the 3D pipe on a straight line, the PipeReplacer has thickness, I want to replace it with my own model, is there a good way, thank you，

Writing shp file data to an existing feature service in ArcGIS Online - error code '1000' - Data is null.

This is the error I'm getting- ArcGIS Online Feature Service Writer: 'addResults' error for a feature in 'Tracklogs'. The error code from the server was '1000' and the message was: 'Data is Null. This method or property cannot be called on Null values.'. The data has run successfully through the workspace until I try to write into the existing feature service in ArcGIS Online. As a side note, I made sure to Import Feature Types... The table looks populated to me. There aren't any empty rows, however there are some empty fields. I didn't think this would make the workspace abort though. In the visual preview, I can see the geometry has populated too. Thank you in advance for your help.

976

2 years ago

Page 38 / 272

Badge winners

majed_abdallahas earned the badge Integrate Data with the FME Platform Training
pbyhistorianhas earned the badge Student (Grey)
pbyhistorianhas earned the badge Teacher (Bronze)
pbyhistorianhas earned the badge Teacher (Grey)
kwanghohas earned the badge Welcome Back

Show all badges

30,126: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.