- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,708 Posts
24,712 Replies

When you subscribe we will email you when there is a new topic in this category

6708 Posts

Recently active

Most replies Most views Newest first

yasminvb

asked in Data

CSAR raster functionality to read/write measurement coordinate information (true position)

Hello, For a FME workflow involving hydrographic CSAR raster files both band and point coordinate information are present in the file. The point coordinate information is the location where the measurement to generate the raster file was taken. This is crucial information for a user.According to the help page of CSAR raster (CARIS Spatial Archive (CSAR) Raster Quick Facts (safe.com)) this GCP and Z-value information, which to my knowledge is the point measurement location, is not included in the functionality of the CSAR reader or writer. Is there a workaround available in FME to include this point information in the CSAR raster file ? It is important that is saved in the same manner as in the original file. If not,would it be possible to add this functionality in future releases ? Thank you!

1 year ago

carmijoContributor

asked in Data

Using ArcGIS Online federated/enterprise account to connect to basemaps in FME Data Inspector

I work for a city entity and have a federated login. I'd like to connect to ArcGIS Online in FME Data Inspector so that I can use a specific basemap. Is this possible? How can I format my credentials here?Thanks!

1 year ago

mohant

asked in Data

How to update shape files

Hi, I created shape files from spatial database for the use of our corporate software using fme. And I scheduled in Task manager to run this task daily to keep the files updated. But now I needed to keep them up-to-date checking database table for every half-an-hour. I'm looking for some help to update existing shape files (similar to update detector used in case to update database table) rather than delete and create each time. your help with is greatly appreciated.

1 year ago

rbrundritt

asked in Data

Invalid Cesium 3dtiles created by writer

We have tried using the Cesium 3dtile writer in Safe FME but have found that the generated tilejson and tiles are invalid when testing the data with Cesiums 3dtile validator. The primary issues are that the tilejson has the wrong version number, should be "1.0", but is "0.0". Additionally, none of the tiles have geometric error values in their metadata (its in the tilejson, but not in the individual tiles). Cesiums web SDK is pretty forgiving, but their Unreal Engine SDK is not, and won't load tiles created using this writer. Any ideas on how to resolve this? I followed this guide to create the tiles: Tutorial_FME_Cesium_3D_Tiles.pdf (ethz.ch)

1 year ago

boubcherContributor

asked in Data

Offset the center point of the segment perpendicular to the segment

I extracted the center point of a line segment, I need to offset this point from its original position on the line to a 10m distance from the line and should be perpendicular to the line

1 year ago

so_much_moreContributor

asked in Data

How to update dynamic readers (add or remove feature types?)

I am trying to create a simple dynamic workflow. But i struggle to understand how to add or remove feature types to the reader.For illustration i have created a database with 3 tables which are. I am reading them into my workbench using the "Single Merge Feature Type" option. The 3 tables can be seen under "Feature Types to Read"Immediately below it only the table1 listed under feature types. I am confused to why not all 3 tables are listed there?If i go to update the reader only table 1 is shown But if i run the workbench the dialog for Translation Parameter Values show all 3 tables I fail to see the logic behind this? How do I add or remove one feature type? Imagine I have 35 tables and I want to add or remove 1 of them from the reader. How do I do that?

1 year ago

muzhnastoContributor

asked in Data

Replacing textures

Hello friends. Help solve the problem of replacing the textures of a 3d object. I have an object to convert to gltf, textures of different formats are applied to the object and they need to be brought to the webp format (I understood how to do this part). But I don't understand how to use the Appearance Setter correctly. Any help is welcome.

1 year ago

gisbradoklaSupporter

asked in Data

extract geometry from autocad block AFTER READING WITH NO EXPLODE

I have a specific use case wher i need to read many dwg files. an dget several feature types from a specific layout (paperspace). 1 of the featuretypes i need to extract is autocad_insert. If i explode blocks on the reader I lose ALL layout information. specifically i need a closed polyline that is within the block. The insert point of the block is what i am going to have to use to place that polygon. so i will have to calculate the center of the polygon and use that to place it at the insert point of the block. I would be suprised if fme is not capable of deconstructing the block into it's components. i just hope it is a a logicial model. The block I am trying to gain access to is very simple. Just a polyline. nothing else.

1 year ago

_trent

asked in Data

Reading/Writing ArcGIS geodatabase Raster field data type

I have a feature class in a file geodatabase with a Raster data type field, whose values I want to write to an SDE feature class with an equivalent Raster field.When I use the GEODATABASE_FILE reader, the raster column is not listed in the resulting feature class. Likewise with the FILEGDB. To make sure I wasn't missing something I tried the GEODATABASE_FILE_RASTER_DATASET and GEODATABASE_FILE_RASTER_CATALOG readers, which, as expected, would not recognize the feature class.When I use the GEODATABASE_SDE writer the raster field is also omitted. Again, trying the raster readers, GEODATABASE_SDE_RASTER_CATALOG and GEODATABASE_SDE_RASTER_DATASET did not recognize the feature class.Does FME handle the ArcGIS geodatabase Raster field type? Using FME Version 2019.0.1.0 Build 19253

1 year ago

atle_hoidalen

asked in Data

IFC to IFC conversion while modyfing and/or adding properties

Hi!I am familiar with the consept of reading IFC and writing IFC in FME. I also have successfully created a workspace that can read various geometry formats and write to IFC with custom propertysets. Now I'm trying to create a workspace that can read IFC, modify or add propertysets and write back to IFC without breaking the structure of the IFC file. For example, I have a IFC with slabs. I want to add some propertysets to the slabs and write it back to slabs. I have seen the example where you can modify properties for spaces, but I'm having problems applying the workflows to IFC. All in all I think FME has potential for improvement in handling IFC-files in an intuitive way. Does anyone have any good examples of workflows for the described purpose that can be shared?

1 year ago

camwatsonContributor

asked in Data

Is there anyway I can force FME to utilize the ArcGIS Pro libraries rather than the ArcGIS Desktop libraries when both are installed?

I’m using FME 2020.2 (FME(R) 2020.2.0.0 (20201027 - Build 20787 - WIN64)) and I have ArcGIS Pro 2.6 and ArcGIS Desktop 10.4 (with 64 bit background geo-processing) installed. I have a File Geodatabase (FGDB) that FME is unable to read. The error I'm getting is : “It could have failed to open because it contains ArcGIS Pro-only features, for example Arcade expressions. If this is the case, please install ArcGIS Pro-compatible ArcGIS Sever and 64-bit FME." This FGDB contains a relatively new ESRI field type called contingent values on a feature class. ESRI notes this makes the FGDB incompatible with ArcMap and releases prior to ArcGIS Pro 2.3 and ArcGIS Enterprise 10.7.x. It appears that FME is defaulting to using the ArcGIS Desktop libraries rather than the newer ArcGIS Pro libraries when both application are installed. The only work around I have identified at this time is uninstalling ArcGIS Desktop. Once I do this FME will read the File Geodatabase without any errors

1 year ago

ileung_cnwContributor

asked in Data

Edit coded value domains for a feature layer in AGOL using PythonCaller?

I am receiving this error below when I try to retrieve the getJSON variable:Python Exception <Exception>: Unable to update feature service layer definition.Object reference not set to an instance of an object.(Error Code: 400)Error encountered while calling function `processFeature'PythonCaller_3 (PythonFactory): PythonFactory failed to process featurePythonCaller_3 (PythonFactory): A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsJSONFormatter (JSONFormatterFactory):This is the code in PythonCaller (simplified for readability):import fmeimport fmeobjectsfrom arcgis.gis import GIS def processFeature(feature): getJSON = feature.getAttribute('JSON') gis = GIS(profile='username') lyr = gis.content.get('item_id').layers for lyr in gis.content.get('item_id').layers: lyr.manager.update_definition(getJSON)I know getJSON is giving me issues because if I replace lyr.manager.update_definition(getJSON

1 year ago

dollargisParticipant

asked in Data

FME 2021 Compatibility with Postgres 14

We are using FME 2021 and planning to bump postgres version to 14.Are there known issues with that combination?I have tried to find a compatibility sheet for FME Desktop/Server and Postgres and/or other Software, but did not succeed.

1 year ago

imran

asked in Data

How to read texts from dwg file which is associated with SHX font

Hi,I am having a large set of DWG files in which all the texts are referenced to a native Autocad font file called XARB.SHX, when I try to read it through FME desktop the fme_text_string shows something which is unrecognizable as FME is referring windows fonts.I am unable to read the autocad (XARB) style applied to the text in dwg file.It will be very helpful If anyone can suggest me some workaround.Thanks in advance.IMRAN

1 year ago

ramachandra

asked in Data

Dynamic Blocks and Object Data using AutoCAD RealDWG writer?

Is it possible to write object data to a dynamic block with AutoCAD RealDWG writer?

1 year ago

greatdata

asked in Data

I've looked at many posts, but still don't see this answer. I have a Geodatabase that should be in EPSG:4326, but when I use Coordinate Extractor to try to derive the lat/long, I get numbers with 7 places to the left of the decimal point.

I've tried Attribute Reprojector, but that doesn't seem to help. I just need the lat/long.

1 year ago

manca_ent

asked in Data

Group features by week number

My dataset contains date attributes per day that work was completed. My output needs to have the count of attributes that fall within any given week - example week 40 has 25 attributes - going back to the start of the year. I'm new to working with dates in FME so any help would be appreciated.

1 year ago

tslack

asked in Data

Reconciling SDE Database in workspace using FeatureWriter

Hey guys, https://community.safe.com/s/question/0D54Q000080hBYOSA2/reconcile-and-post-issue Just following this here to reconcile our versioned ArcSDE in a workspace. I have the basic flow set up: Creator --> AttributeCreator --> Writer and i've set the parameters based on the thread above. My question on the writer is what geometry type and row selection information I need to fill in to get it to trigger? I didn't see this addressed in the two threads on this I found searching.Thanks

1 year ago

ranga_tolapiContributor

asked in Data

Question - Extracting a schema subset for dynamic schemas

Reference: Extracting a schema subset for dynamic schemas SCHEMASUBSET.zip contains 4 fds files, is there any difference each of them?All the 4 fds files when opened in FME Desktop, giving the below warning.@hollyatsafe

1 year ago

philip_wehrens

asked in Data

Published parameter "Folder (existing)" changes back slash to forward slash.

Occasionally the Folder (existing) parameter will change a backslash in the folder path to a forward slash when the feature is is shown in the table. This creates a major problem for reading, writing and comparing to this folder. Is there anyway to make sure this doesnt happen?

1 year ago

janrykrContributor

asked in Data

Looking For a Database Editing Tool

I am looking for suggestions for a user friendly database editing tool. A client of ours has a deliverable in Excel format. We feed data to it via FME from a SQL Server/SDE database. However the client does edits in the excel file and the edits never make it back to the database. I know, we can load the edited data back to the DB via FME again, but preferably, the users will edit the data directly in the database. The client is used to the editing functions in Excel so we need to offer them something very similar/easy to use. The data to be edited is a non-spatial table but related to a parent spatial object.The tool must have:Allow for bulk editing (replace drag functions in excel). Must be user friendly/no code. We have tried MS Access but it is too complex. From the user perspective they just need to:access and filter a subset of the data eyeball the values and add comments in one column.Good to have:Track editor idRead and write by FME We are flexible on the database so if there is

1 year ago

tb09114Contributor

asked in Data

How to publish a choice parameter from script?

I need to have a choice parameter offering all the database tables of a specific database for the user to choose from before running the workspace.I do have the Python code ready, and created a scripted parameter, returning a list of all table names.I referenced the scripted parameter as input for the choice parameter, but that only gives me a dropdownbox with the name of the parameter linked to it. Is it possible to populate a choice parameter from a Python script (scripted parameter), and if so how?

2 years ago

pmcphersonContributor

asked in Data

Has anyone experimented with connecting to "Databricks on AWS" data sources? If so, which reader format or transformer should be used to make the connection and browse the available data?

2 years ago

carmijoContributor

asked in Data

Writing Vector Data for Use with OpenCV

What format can I write to using FME so that my vector data can be read/processed with OpenCV?I'm in the early stages of an image segmentation project to identify impervious cover data from aerial imagery but we're having some early issues getting my vector impervious cover data into a format that my computer science counterpart can use in OpenCV. It seems like XML or GeoJSON would work, but I don't have any experience with OpenCV. Any ideas?

2 years ago

christine1215

asked in Data

GoogledriveConnector doesn't read files, only folder

Hi,I want to read google sheets with FME, in order to update AGOL feature service.On my Google drive, I have a folder "HEBERGEMENTS", with 9 spreadsheets.In FME, I defined a Google Drive Connection, and I use the GoogleDriveConnector. I can access to the folder HEBERGEMENTS, but when I run the connector, it reads nothing...Is there a option to see files ?I don't understand...Because the goal of that is to run my workspace with a batch.Thank you very much for your help !Christine

2 years ago

Page 32 / 269

Badge winners

gvasseurhas earned the badge FME Flow Authoring Training
cpaggiolohas earned the badge Welcome Back
martti.vaalihas earned the badge Student (Grey)
will.jones4has earned the badge FME Certified Professional
gisgeekhas earned the badge Welcome Back

Show all badges

29,743: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.