- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,681 Posts
50,725 Replies

When you subscribe we will email you when there is a new topic in this category

12681 Posts

Recently active

Most replies Most views Newest first

jobvdnoortContributor

asked in Transformers

Chartgenerator show labels next to points?

Hi, Can someone help me with the Chartgenerator transformer. As a result I plot a pdf that looks like this: The only thing that I would like to do is to plot the values of the points as text labels next to the points. Like what was done before in EXCEL. Can anyone here help me to get labels next to my points? Thanks in advance.

592

4 months ago

filipforsbergObserver

asked in Transformers

Extract images from a scanned PDF and overlay on

Hello, I’m a beginner to FME and need help with how to exctract the images from a scanned pdf to fit with the OCR text I got from Tesseract. The idea is to create new pdf files from the scanned ones where you can copy the text and so on, and I also want to keep the original layout of the text and images. I have attached two images to illustrate what I mean. One is of the original scanned pdf and the other is my OCR extracted text and where I want to put the images. Also attached is my workspace. Thanks!

581

4 months ago

vmtngContributor

asked in Transformers

I'm getting an error in an Excel spreadsheet - Removed Feature: Named range - written by XSLXW from a template. Where exactly does it come from?

Hi, I have a workspace that writes a XLSX from a template. The source features come from Smallworld (there's also a very simple Excel spreadsheet that is joined in the process). I can run it in FME Desktop 2018 (32) + Smallworld 4.3 with no problem. But when I run it in FME Desktop 2021 (64) + Smallworld 5.2, the resulting XLSX seems to be corrupted. While starting Excel, I get a message: "We found a problem with some content in... <file name>. Do you want us to try to recover as much as we can? If you trust the source of this workbook, click Yes". After clicking Yes, Excel does its recovery thing, and tells me "Removed Feature: Named range from /xl/workbook.xml part (Workbook)". To rule out an Excel problem, I opened both output files (FME 2018 and FME 2021) in the same computer, and got the errors only in the FME 2021/Smallworld 5 file. I also see these warnings in the FME log when I run it in FME 2021 / Smallworld 5: Excel Reader: Found named range &#39

4593

4 months ago

beetrizContributor

asked in Transformers

Delete attachments from AGOL using the API and httpcaller FME2019

Hello,We are trying to manage changing attachments on a feature layer on ArcGIS Online using FME. We can successfully read, compare, and add attachments using a combination of HTTP Callers and Python Callers. However, we are having difficulties deleting attachments that are no longer relevant. The easy solution would be to delete the entire record but we are trying to avoid that.Has anyone had success at using the deleteAttachments POST request outlined in the ESRI’s api guide.https://developers.arcgis.com/rest/services-reference/enterprise/delete-attachments/Or has anyone found another way of managing attachments?Thanks,

582

4 months ago

arthyContributor

asked in Transformers

How to Export Revit file to IFC?

Hello,I would like to export all the layers of a revit file to an ifc model.I used the ETL described here. Here are the layers of the input revit fileAnd the obtained layers of the output IFC file.The only layers that I'm getting rigth are:Architectural.DoorsArchitectural.RailingsArchitectural.RoofsArchitectural.StairsARchitectural.WallsThe other layers of the revit input file are missing in the output ifc file while I used the same logic to build them.What did I miss?

462

4 months ago

stevelawdisParticipant

asked in Transformers

ESRI PDF Attachments Exported as PDF

I’m trying to write a PDF, currently attached to a GIS point feature class, to a PDF file. Preference being that this would be an additional page to another. I currently have a FeatureReader accessing the Attribute Table for the feature class. I have tried using the Adobe PDF GeoSpatial Writer but I am not getting anything but a blank PDF document. Is there a transformer or set of transformers that handles this specific workflow? The Data attribute on the Attachments table contains the original PDF document’s information.Thank you all,

913

4 months ago

galigisEnthusiast

asked in Transformers

Issue trying to write an ESRI GDB Relationship

Hi All,I’m trying to write an existing ESRI GDB relationship 1:1. I have watched a few of the FME articles material here https://support.safe.com/hc/en-us/articles/25407490028813-Writing-Geodatabase-Relationship-Classes but can’t get it to work. Here is the scenario:I have created the relationship (1:1) manually in ArcPro as the relations can’t be created using FME. The relation is one to one and needs to be done by Title_Number field. I have also created the relevant fields after reading the article above, here is an screenshot of the AttributeCreator: Here is an screenshot of the relationship in ArcGIS:Also here is an screenshot of the FeatureWriter settings to write the relation in the template GDB: And finally the error in FME after trying to write the relation: Attempting to write a non-relationship feature to relationship class 'rel_NPS_CCOD'. Ensure the 'geodb_type' is set to a valid relationship class type Any idea how to make it to work?Thanks

917

4 months ago

ridleyjContributor

asked in Transformers

Generic feature reader to access a JPEG via URL within an attribute has no network authentication option.

Using generic feature reader to access a JPEG via a URL, that is an attachment for an ArcGIS Portal feature layer and requires authentication: this works well when explicitly stating the URL as the Dataset as the reader has the option to network authenticate in this mode. However, when the URL is supplied within an attribute, the reader has no authentication option and so the self same JPEG as above will fail with the message : 2022-06-29 16:47:51| 0.1| 0.0|ERROR |JPEG reader: `\\AppData\\Local\\Temp\\1\\wbrun_1656380366772_18540\\fmetmp_4\\TempFS_1656478070812_2916\\4' exists but could not be opened. File contents may be invalid, or the file format may not be supported2022-06-29 16:47:51| 0.1| 0.0|ERROR |JPEG reader: Failed to open the dataset '\\AppData\\Local\\Temp\\1\\wbrun_1656380366772_18540\\fmetmp_4\\TempFS_1656478070812_2916\\4'. Please ensure source data is valid and correct reader is selected2022-06-29 16:47:51| 0.1| 0.0|ERROR |A fatal error has occurred. Check t

223

4 months ago

naveenContributor

asked in Transformers

Anchor snapping and overlapping points

Hello All, I hope you all are doing well. I am trying to figure this out - I have to align points on the lines without overlapping with each other. I have used Anchorsnapper(segment snapping..group by line global id). I have passed lines to anchors and points to candidates. The results have some overlapping points (using matcher). To disperse along the line, using sampler and offsetting by 5 ...and still some points are overlapped...so tried to -5 offset the points and then snap to line. I am still ending up with some overlapping points. Is there a better way to achieve this?Any help would be appreciated. Thanks,Naveen

563

4 months ago

stuarmitagehomeContributor

asked in Transformers

Move values from one column to create column names

Hi, and of course “HELP!” 😁I need to take some values in a column and create column names from them, taking the associated values with them.My starting table looks like this (note this is in Excel, but the table exists within an FME workflow, I am just showing it like this to make it easier to understand… hopefully!!!!!): Asset_ID is my unique identifier. You will see there are either 3 or 4 duplicates of that number.Column B “CHAR_TYPE_CD” has the values I want to turn into new column headings, combined with the existing column headings in C, D, and E.This is ultimately what I want it to look like: Note The values from the original Column B are transposed and combined with the previous column names. There are 4 individual attribute values in the original column B, namely:CM-ELCNT; CM-GRPNG; CM-VOLVL; and CM-VNOriginal column C “EFFDT” now becomes “EFFDT CM-ELCNT”Original column D “CHAR_VAL” now becomes “CHAR_VAL CM-ELCNT”Original column E “SRCH_CHAR_VAL” now becomes “SRCH_CHAR_VAL C

494

4 months ago

joySupporter

asked in Transformers

Is there an environment variable for the R interpreter?

Hello everyone,I was wondering if there is an environment variable available for the R interpreter.If I look at the following post, there appears to be an environment variable for python, but not for R.It would be nice that the R interpreter would be able to look at a certain folder on the C disk for example and when there is different version of R, then the R interpreter would automatically change it.For now, I manually changed the interpreter, however ideally I would like during an update of R, that the R interpreter would automatically change the R interepreter.Does anyone know whether that is possible or might be possible in the near future?

241

4 months ago

kattContributor

asked in Transformers

SQL Executor - Oracle Spatial Object with two tables having a geometry

Hello,I am using the SQL Executor to read two tables from oracle using a join.I would like to use Oracle Spatial Object as Format to have the geometry included.This is my sql query:select a.nm, a.fid, b.mlpst, b.featfrom t_csm ajoin t_fl bon a.clss=b.clssBoth table a and b have a geometry (GEOM). When I use SQL Executor - Oracle Spatial Object, how can I know the geometry of which table will be used ? I want it to be the geometry of table b but I don’t how to specify it. The geometries of these two tables are not the same and my next transformer is the neighborfinder so it makes a big different if I use the geometry of table a or table b.Thanks for your help.

221

4 months ago

richard_che

asked in Transformers

Create Randomized Points within a Polygon based Attributes values

Hi,I have 100 polygons that state the population within each polygon, I'm essentially trying to break it down 1 stage below where I have that population essentially scattered across the polygon boundary in the form of points to then get a rough estimation of the population in small selections (and not for the entire polygon) I saw a question asked very similar to what I need where I have the population value in a field and I would like to add that as an input into the RandomPointGenerator (however this transformer does not accept inputs (aside from the fixed value you state), and this does not seem to have been changed in the 5 years since raising this question). Someone had mentioned the use of workspace runner, but I am not sure how to incorporate that into what I'm trying to do.

2817

4 months ago

adele_jContributor

asked in Transformers

Coordinate System Gallery Inaccessible through Transformers (2024.0.1.0)

Hi all,When using a FeatureReader, FeatureWriter, or any other transformers, I can’t seem to access the Coordinate System Gallery. However this doesn’t seem to impact readers or writers (when accessed through parameters anyway).Excel ReaderReprojector (note that Source Coordinate System does use the Coordinate System Gallery)I’m currently using FME via Data Interoperability through ArcGIS, is this a limitation of the extension? Or have I missed a setting to use the gallery in all cases?Cheers for any help.

774

4 months ago

j.m-vismaContributor

asked in Transformers

Is there a better way to use the HTTPCaller for Multipart/ form data?

I am using the HTTPCaller to interact with an API, for that I use the setting Multipart/ Form Data. This is the way another user got the Endpoint to work for them and I just always used it. This works pretty well, the API does what I want, the connection is stable, but there is one problem. Sometimes it takes a lot of time to configure the Multipart-part.For some jobs I need to configure dozens of parameters, this leads to a lot of typing, proofreading, etc. For this particular endpoint I don't just need to give parameters about the object I want to edit (some inspection), but also something like a table definition. The row (row_id) and the value, for each attribute of my dataset. Since this API endpoint doesn't like it when I send in null values as values, I need to run several configurations of the same HTTPCaller one that drops each variation of Null values in the dataset. Now I was wondering if I could somehow build the whole statement about the rows and their values with something

332

4 months ago

imaric0503Observer

asked in Transformers

Read and write feature one by one

Greetings, I should read and write features one by one, namely in the feature reader I have a condition by which I retrieve data from the database, more precisely the ID. But every time I should first write a feature in the database that gets a new ID, and when reading the conditions for the second time, it should select that new ID, and not immediately select that first ID for me. how to create this?

412

4 months ago

csaba.szabadkaiObserver

asked in Transformers

Parallel lines

Hi!I have a shapefile with a lot of lines with the same geometry, but different data. They are the fibers of an optical cable.How can I shift them parallelly to each other?

604

4 months ago

jasperwisEnthusiast

asked in Transformers

DWG: writing custom hatches (pat files) on a Linux/Kubernetes FME Flow

Hi,I would like to write custom hatches in a DWG file. But our FME Flow is deployed with Kubernetes.So the OS is Linux.Since the RealDWG writer is only available on Windows, I will need to use the other DWG writer (Acad).Where should I put these .pat files to write these custom hatches successfully?The documentations says:The ACAD format writer will look for custom hatch patterns in custom <filename>.pat files located in folder specified by the ACAD operating system environment variable, or in the related folder for any installed AutoCAD product.On windows, I have tried to create an “ACAD” environmental variable, pointing to a folder where I placed my .pat files. But no result.Secondly, will this be possible on a Kubernetes FME Flow?Thank you in advance Jasper

270

4 months ago

nicholasContributor

asked in Transformers

FeatureReader fails to recognise Attributes in CSV file

FeatureReader does not recognise attributesHello all, I am having problems with a FeatureReader that does not recognize the attribute columns of a CSV file.The background is, I regularly download the GNAF dataset from Geoscape Geocoded National Address File (G-NAF) | Datasets | data.gov.au - betaThe GNAF arrives as a zip file containing a large number of CSV files. I only need five of them.I have built a Directory and File Pathnames Reader that returns all of the CSV files, which I then filter down to just the five that I want.I am attempting (but failing) to build a FeatureReader that reads the CSV file.I should point out that the CSV file is actually a pipe-separated-value file. The separator is a pipe “|” and the file extension is “.psv” But I have confirmed that a normal CSV reader does successfully read the psv file.Now, the FeatureReader is successfully reading the correct number of features. And FME automatically recognises that two of the columns are LONGITUDE and LATITUDE and

481

4 months ago

sameerContributor

asked in Transformers

SQLExecutor outputs NULL as value {NULL} - Possible Bug

Current Version: 2024.0.3.0 (20240603 - Build 24220) Since upgrading from 2023 to 2024, some weird behaviours have happened.Some critical workflows have not been outputting the correct information on our public facing website.In this case, I’m referring to the Building Control (BC) header on that page after you type in an address.Instead of stating that there was a BC information against a property, it would say no information found.Whilst investigating I found the following: The result of SQL Query was outputting NULL values as a string value called {NULL}.Never seen that before. Therefore, the Conditional Value was returning the wrong information. i.e. If xxx IS NULL and xyz HAS A VALUE….Subsequently I had to add a StringReplacer to fix this anomaly for now. SQL StatementWITH bc_html_aggAS(SELECT blpu_uprn, ARRAY_AGG(bc_html) AS bc_html FROM myproperty.buildc_html_temp GROUP BY blpu_uprn ORDER BY blpu_uprn)Select Distinct(bc_html_agg.blpu_uprn), b.address_string, bc_html_ag

574

4 months ago

jbriant

asked in Transformers

RealDWG custom hatches on FME Flow

Hi,I want to write a RealDWG using custom hatches on FME Flow.When working on FME Form, we put the hatch files in <FME install folder>/plugins/realdwg/Support and it works. But when uploading the workspace to FME Flow, where should these files be placed? Is there a designated location for them in the Resources?Any help appreciated.Cheers,Julien

985

4 months ago

timnil00Contributor

asked in Transformers

How to find attributes in GIS that is not in my excel file?

Hello!I have a GIS layer with a field named “yttyp” wich contains all various of attributes since its a text type.I also have an Excel-file with allowed attributes. How can i check if there is unallowed attributes in my GIS layer that is not in my Excel-file, and list them in a new excel-file. I have tried change detector, listsearcher, featureMerger but i dont get it to work.

342

4 months ago

_fabian_Contributor

asked in Transformers

Use ODATA Reader to read nested complex types (arrays)

I’m trying to retrieve data from a nested JSON response of an ODATA Feed.For testing, I try to access the “Emails” property of this ODATA example service: https://services.odata.org/V4/(S(hg4u5ox0x0r2rjva5qwwra05))/TripPinServiceRW/PeopleThe JSON structure is as follows:{ "@odata.id": "http://services.odata.org/V4/(S(hg4u5ox0x0r2rjva5qwwra05))/TripPinServiceRW/People('russellwhyte')", "@odata.etag": "W/\"08DC9753B5381A6D\"", "@odata.editLink": "http://services.odata.org/V4/(S(hg4u5ox0x0r2rjva5qwwra05))/TripPinServiceRW/People('russellwhyte')", "UserName": "russellwhyte", "FirstName": "Russell", "LastName": "Whyte", "Emails": [ "Russell@example.com", "Russell@contoso.com" ], "AddressInfo": [ { "Address": "187 Suffolk Ln.", "City": { "CountryRegion": "United States", "Name": "Boise", "Region": "ID" } } ], "Gender": "Male", "Concurrency": 6385516329

542

4 months ago

rzel24Contributor

posted in Transformers

Deleting Files from a Google Share Drive (GoogleDriveConnector & HTTPCaller)

Hello all,Since I wasn’t able to find anything in the FME documentation about this and despite reading hundreds of community posts, I wanted to share what I’ve learned about using the GoogleDriveConnector transformer to delete files in Google Drive Shared Drives and Shared Folders.When using the GoogleDriveConnector in FME to delete files you need to make sure you have the right access. Shared Folders and Shared Drives have different types of access levels. For Shared Folders you have "Editor", "Commenter", "Viewer". If you want to be able to "Delete" files from these folders you will have to have an "Editor" level access right to the folder and the files.For Shared Drives, the access levels are "Manager", "Content Manager", "Contributor", "Commenter" and "Viewer".Due to the restrictions on the Shared Drive, its folders, and the difference in the actions each access levels can have, if you want to delete files from a Folder in a Share Drive folder you will need to have "Manager" level

510

4 months ago

scarterContributor

asked in Transformers

Setting up a Web Connection for the AzureBlobStorageConnector transformer

Hello Forum, I need to start uploading data to a MS Azure Blob Storage account set up by our IT service providers.I have a Creator connected to a FeatureReader which is reading in the source file. The FeatureReader is connected to an AzureBlobStorageConnector transformer.But I first need to set up a new Web Connection through FME Options… I asked our IT provider for the Access Key ID and Secret Access Key of the Azure Blob Storage. They responded by saying that I should just use my standard network username (for the Access Key ID) and my standard network password (for the Secret Access Key). This really doesn’t sound right to me. I was expecting Access Key ID and Secret Access Key for the Azure Blob Storage. As I’ve not used Azure Blob before I don’t know what an Access Key ID and Secret Access Key would look like, but I’m sure it’s not my network username and password! Has anyone had successful experience with using the AzureBlobStorageConnector? If so, what did the Access Key ID and

314

4 months ago

Page 15 / 508

Badge winners

dubosedfmehas earned the badge Student (Grey)
dubosedfmehas earned the badge Expert (Grey)
dubosedfmehas earned the badge Teacher (Grey)
kjetilpetterssohas earned the badge Welcome Back
jorge_rosaleshas earned the badge English Speaker

Show all badges

30,152: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.