- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,757 Posts
24,855 Replies

When you subscribe we will email you when there is a new topic in this category

6757 Posts

Recently active

Most replies Most views Newest first

rmpayabyContributor

asked in Data

Issues with UTF-8 after upgrading to FME Form 2024.1

Hello, I have recently upgraded FME Form 2024.1. I tried to run a project, but I immediately got the following error message: “FME failed to restore the process locale to UTF-8. A non-UTF-8 process locale may cause undefined behavior.” Is there any quic fix for this issue?

531

1 month ago

venki.valleriObserver

asked in Data

Transaction Rollback on multiple writers

Hi, Is it possible to rollback all the inserts been made to database through multiple writers(Oracle/Esri) if one of the writers fail?

280

1 month ago

youssefContributor

asked in Data

Writing AIXM 5.X geometry

Hello guys,i am a little desperate in my attempt to write data from our oracle spatial database to AIXM gml. I already watched the Overcoming the Complexities of AIXM with Model Based Data Integration - FME by Safe Software webinar and also read this artical https://support.safe.com/hc/en-us/articles/25407686750477-AIXM-4-5-and-5-1-Reading-Writing-and-Validation-EU-Airports-Demo. discussing the matter. I even downloaded the demo workspaces to try to figure out why exactly mine is not working but without any result yet. I will attach my workspace , a log-file of a successful translation and the resulting gml file to this post and i hope that someone can make out the issues.Dont wonder about the Geometry-Extracter and Geometry-Replacer transformer i use in the workspace, i have already tried it without them and thought they could help, but also with no result.Thank you guys for reading this and helping me out in advance, it is very much appreciated!

Writer Error Geodatabase Error (-2147219884)

HelloCould not able to write “Esri Geodatabase (File Geodb Open API)” facing Error Geodatabase Error (-2147219884): this so frustrating form last 2 days i am suffering from this issue.

253

1 month ago

gboquinContributor

asked in Data

issues with feature writer in fme server 2018

Team: I have been developing some processes in fme server 2018 and have an issue that I am not sure how to troubleshoot. The work bench is pretty simple, read access, sort some things, a couple of joins and then push the data into a clean database that has the same schema as the source data via a feature writer instead of an access writer in the workbench—this forces me to use a 2 step approach as I have some SQL executors port processing.The feature writer works in desktop but not on server. Initially, I thought it was a permissions issue, but then I broke the process—to a 2-step approach—each process worked fine independent of each other. The log below contains the information related to the issue that I had with the first approach—handling everything in 1 process. I was basically pushing records to a couple of clean preexisting tables. I don’t have a project number for support, I will be happy to talk to any of you later tonight to see if we can solve this to make sure its not a p

2292

1 month ago

pinkopoContributor

asked in Data

Bulk process in change detectio

Hi guys,im working on a data loading workbench for our sql sde database. when applying change detection before writting into database, is there a way it can be dynamic and detect changes in group? Like original dataset a comparing to update dataset a, and b to b with key and compare field listed in a sheet? Thanks guys!

604

1 month ago

k_landerContributor

asked in Data

Accessing .e57 raster properties

Hi All, I am trying to reproject some .e57 files containing LiDAR scans and oriented imagery collected with a terrestrial scanner. Reprojecting the point cloud is straightforward, but I am having some trouble with the imagery.I can see in the Feature Information window that the image locations seems to be stored in the e57_translation_x, y, and z Geometry Traits (Geometry->Raster->Geometry Traits), here’s a screenshot from Data Inspector:I’m working from a local coordinate system, hence the low translation values.My goal (I think) is to extract these translation values, reproject them in the same way I’m reprojecting the point cloud, and then write the new values back in to these traits, but I’m not sure how to access these trait values, and was wondering if anyone had experience with this. Thanks for looking!

412

1 month ago

1seanContributor

asked in Data

How to Convert the Last Character to Lowercase if it's an Uppercase Letter in FME?

Hello everyone,I'm looking for a way to check if the ending character of a string attribute is an uppercase letter, and if so, convert it to lowercase. For example:Foo1K → Foo1k BAR4 → BAR4 BAZ → BAzWhat's the best way to accomplish this in FME? Are there any specific transformers or approaches that I should use to achieve this result?

p15rajanContributor

Hello there, How can I read a tsv file in FME? Do we need to use csv format only:? Thanks,Siva

332

1 month ago

doug_herrickContributor

asked in Data

FME can't read SpeedZones shapefile

I have a shapefile that can’t be read by FME Workbench 2024.1.1 or 2022.2.3. The copied log is attached.The “Speed Zones” shapefile comes from https://opendata.transport.nsw.gov.au/dataset/speed-zones where you have to login and download the "Speed Zones data" as a ZIP file. Once unzipped you get the standard 4 files.When I load the shapefile into QGIS, it shows the following properties: 434MB MultiLineString 442,943 features EPSG:3308 - GDA94 / NSW Lambert Fields: Type Text (string) 200 length Status Text (string) 200 length Direction Text (string) 200 length Speed Text (string) 200 lengthThe only issue I can see is that there is no unique identifier field but I didn’t think that was an issue for FME. Any suggestions on how to read this file into FME?ThanksDoug

647

1 month ago

mr_fmeEnthusiast

asked in Data

Standard Deviation calculations

Hi,I have an NDVI raster and need to clip it with many polygons. After that, I need to calculate the standard deviation for each piece of the raster (clipped by the polygons), and in the end, I need to correctly assign the deviation value to the attributes of the corresponding polygon. Thank´s

311

1 month ago

arnold_bijlsmaContributor

asked in Data

Geodatabase Error (-2147219884): The Field already exists

Not a question, but just an issue I thought worth sharing. When converting my data to a geodatabase, I kept getting the following error message: "Geodatabase Error (-2147219884): The Field already exists". Not a very helpful error message and googling this didn't help much.It turned out that my sewer pipe input file had a field named 'shape', and geodatabases don't like that! Using the AttributeRenamer to change the field to 'shape1', everything then went tickety-boo!

52417

1 month ago

david_Contributor

asked in Data

Read dinamically any Excel file without header

Is there any way to read dynamically any excel file and that the header are simply the column name A, B, C, D...Through a Reader I can read any Excel file but the problem is that it always takes the first row as the header.Thank you!

303

1 month ago

skotnicamParticipant

asked in Data

FME 2021.0.3.2 crashes on macOS 14.6.1

Hello,I am running on macOS 14.6.1 and I use FME 2021.0.3.2 which stopped working from today. It crashes after “Initializing Main Window”. I am attaching the relevant part (I hope) of the crash report. Has anyone run into the same problem?(Data inspector and Quick translator work, only Workbench crushes)Thank you! Notes:PC register does not match crashing frame (0x0 vs 0x7FF89317AA78)Crashed Thread: 0 CrBrowserMain Dispatch queue: com.apple.main-threadException Type: EXC_CRASH (SIGABRT)Exception Codes: 0x0000000000000000, 0x0000000000000000Termination Reason: Namespace SIGNAL, Code 6 Abort trap: 6Terminating Process: FME Workbench [1810]Application Specific Information:abort() calledError Formulating Crash Report:PC register does not match crashing frame (0x0 vs 0x7FF89317AA78)Thread 0 Crashed:: CrBrowserMain Dispatch queue: com.apple.main-thread0 ??? 0x7ff89317aa78 ???1 libsystem_kernel.dylib 0x7ff802e92db6 __pt

471

1 month ago

axcel.fmeContributor

asked in Data

Substring operation incorrect in several cases

Dear all,I’m spending a lot of time trying to sort out an issue with a substring operation but I cannot see my results are not correct in several places.In FME workbench 2024.0, I use the the AttributeManager to read a substring from the attribute _response_body and to write it to the attribute info. The response body is the result from a reverse geo-coding with OpenStreetMap and I want to extract the location for the given coordinates. To extract the relevant part, I use the following sequence of String operators:1) Take everything left of </result>2) From this, take everything right of address_rank3) From this, take everything right of >The actual (unfortunately complicated) condition statement which I’m using is:@Right(@Right(@Left(@Value(_response_body),@FindString(@Value(_response_body),</result>)-1),@StringLength(@Left(@Value(_response_body),@FindString(@Value(_response_body),</result>)-1))-@FindString(@Value(_response_body),address_rank)),@StringLength(@Righ

556

1 month ago

joku041199Participant

asked in Data

Only loading in Raster data based on Area of Interest (from a GeometryReplacer and User Parameters)

Hello, I am using FME 2022.2 and I’m trying to load in Raster data, based on an Area of Interest (AOI), specified by the end-user in FME Server (yes my organization is not using FME Flow yet, but the old FME Server). We have a few big Raster datasets on a local drive (of the entire Netherlands), which are loaded in as regular Readers. Then, using a Creator and GeometryReplacer, the end-user can specify an AOI (using a User Parameter), and the Rasters are then clipped in the Workspace using a Clipper. However, this means that the big Raster datasets need to be loaded/processed every single time the Workspace is ran, which is bad for performance. What I want, is that the Raster data is loaded into the Workspace, but only the data which intersects the AOI, specified by the end-user. I tried using a FeatureReader and use the AOI from the end-user as trigger to load in the Raster data. However, for some reason, the entire Raster dataset is loaded every time, instead of only the Raster data

382

1 month ago

raabsterContributor

asked in Data

Can't get workspacerunner to run as expected

Hi!So, I have a workbench that takes a shapefile and an excel file as input, does some magic and outputs an excelfile. The workbench works as expected. So far so good. Se image below. Now, I have a number of shapefiles that I want to process in the same way, so I figured a workspacerunner would be a good solution, instead of replaceing the input shapefile in the image above.So in a second workbech, I take a PATH as reader, filters out my shapefiles and into the workspacerunner (see img below). Everything seem to be working - but only the shapefile that has the same filename (test.shp in the images) gets treated properly.So in this example, test.shp get an output excel file that seems fine, but the other two does not. Any ideas of why that is? My guess is that I’m doing something wrong 😅 I can’t share the workbenches I’m afraid. Cheers!

323

1 month ago

mr_fmeEnthusiast

asked in Data

Get attribute value in Python Caller

Hi,I'm programming in Python using FME Desktop, specifically using the Python Caller transformer. I'm trying to use a variable called test in my script, where test should have the value assigned to the attribute _creation_instance. I'm declaring it as follows: test = feature.getAttribute('_creation_instance'), but I'm getting the following error:Python Exception <NameError>: name 'feature' is not defined How can I properly get the value from _creation_instance? Thank´s

683

1 month ago

lambertusEnthusiast

asked in Data

Looping a set of varying user parameters

Hi, I have a workbench which is fed by a set of user parameters. It produces a dataset of 10.000+ buildings for a chosen municipality and extraction date. Is it possible to create an input which loops through these user parameters:Userparameter 1: CityUserparameter 2: Extraction dateRun City Date 1 A 2020-01-01 2 B 2020-01-01 3 C 2020-01-01 Workbench should behave like first run City A with first date, than City B with 2nd date, than City C with third date

mr_fmeEnthusiast

Hi, Sometimes after running some workspaces, the process freezes at the point shown below: The workspace doesn't run anymore. It can stay like this for hours and not progress... Has this happened to anyone else?

572

1 month ago

lambertusEnthusiast

asked in Data

Assign street codes - spatial order

I have a dataset with 3000 polygons represting streets. Each street is divided into subparts and need a unique code to be assgined. The first part refers to the streetname and is the same for each subpart, 2nd part is a unique counter.Image below shows my current (top) and wanted situation (bottom part).Any support is appreciated!

PostGIS dynamic writer forces lowercase attribute (column) names

As is stated in the title. However I need column names to be created exactly as they are, for example I have incoming attribute "OGC_ANGLE.uom" and even though I have Lower Case Attribute Names unchecked,tables in database have column names are created lowercase ("OGC_ANGLE.uom" becomes ogc_angle_uom) - this is a problem, if I read those tables and try to use xsd to create gml again, as these attributes are unknown to the xsd, therefore failing creation of the gml. I could manually rename those columns, however I would need to rename those columns every time xsd file changes, which is why I need to do this dynamically in the first place, as those xsd files are going to be updated quite often... And it seems that the dynamic PostGIS writer ignores Table Qualifier, it always creates tables in default schema, unless I specify schema in Table Name (schema.@Value(fme_feature_type))

Can FME write to an Excel table?

I have got some beautiful Excel templates containing tables (not normal ranges). It's quite easy to write to a named range within Excel but I haven't figured out how to write to a Table. Does anyone know how to do so?

904

2 months ago

helmoetzContributor

asked in Data

CS:MAP GRID Fallback used on non existing coordinate

Hi, my workspace reads WFS and gives me the warning“CS-MAP: Coordinate (approx) 3E:47N outside grid file coverage; fallback used”It seems to run fine any further, just I like to know where this message comes from, since this coordinate nowhere pops up on neither GetFeature nor GetCapabilities request. Indeed the approx coordinate does not fit within the dutch Grid, but it does not seem to come from the WFS source? My FME version is 2022.2.4

424

2 months ago

rudy_vContributor

asked in Data

Error running translation - reading SQL Server Spatial data on Flow and Form - 2024.1

Hi I am doing migration testing from 2023.1.2 and 2024.0.3. It seems to completely fails on 2024.1.I have tested it on 2023.1.2 and 2024.0.3, worked perfect - no issues.It fails on FME Flow and FME Form on the server - but works OK on my local PCon the server - oldeb 2019, clr 2019, are installed, as with .net 4.7, 4.8 andIt is just a simple sql server spatial reader - and a bit of reprojection - it fails on reading the reading the dataCheersRudy

1175

2 months ago

Page 5 / 271

Badge winners

aaronp_osnihas earned the badge Welcome Back
scottdiggitydoghas earned the badge Webinar Watcher (Grey)
scottdiggitydoghas earned the badge Welcome Back
ecthelionhas earned the badge Webinar Watcher (Sapphire)
brinkehas earned the badge Webinar Watcher (Silver)

Show all badges

29,977: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.