Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,543 Posts
50,238 Replies

When you subscribe we will email you when there is a new topic in this category

12543 Posts

Recently active

Most replies Most views Newest first

tb09114Contributor

asked in Transformers

SQLExecutor with Custom SQL schema failed warnings by Microsoft SQL Server Spatial Reader

I am using an SQLExecutor to write spatial data into an ArcGIS Enterprise database table.It took me a while to get it done, and there is still more work to do but currently a smaller chunk of data is for the first time written into the table. What bugs me is the 4 lines of warning that I get for every feature written.Microsoft SQL Server Spatial Reader: Getting Custom SQL schema failed. Custom SQL query 'INSERT INTO building (OBJECTID,SHAPE)VALUES (27, geometry::STGeomFromWKB(here is of course the binary, 25832))' may execute in an unexpected manner. Make sure all columns are named (any ambiguous columns, e.g. GEOM.STBuffer(1), must have an AS clause). If there is an ORDER BY clause, either remove it or add a TOP clause. If this warning is generated in a SQLCreator or SQLExecutor, you can avoid it by picking Data Features in the Features to Read field the message coming from Microsoft SQL Server Spatial Reader seems strange how can I avoid this in the SQLExecutor? Should I set th

mmacfarlaneContributor

asked in Transformers

Is there a way to get the Excel Writer to honour the cell width of the template file?

It used to work in older versions (2020?), but now will only use the value set in the writer. If I set it to 0 for automatic width, it results in "Error running translation"I need the cell size to be a specific decimal value, but the writer will only let me set an integer for the cell width.

vimva679Supporter

asked in Transformers

How to find Max and Min when you have missing value ?

antoinehersentContributor

asked in Transformers

Procéder au renommage simultané de l'ensemble des colonnes

Hello,Context : FME 2024.0.3, Windows 11I'm currently working on a project with source data and files “.shp” files within it. Each of these files has several columns, one of which is called “IdGen”. Only this column is not written in the same way according to the “.shp” file, example: IDgen, idgen, IDGEN, idGen……To insert it into our GIS, I would like to know if there was a way to change, at once and with a single transformer, all the columns having “idgen” regardless of how it is written to “ IdGen” as I wish ? All this with the aim that my FME project can work automatically during the next updates without having to use AttributeManager behind each of the files…Thank you !Antoine

jobvdnoortContributor

asked in Transformers

Chartgenerator show labels next to points?

Hi, Can someone help me with the Chartgenerator transformer. As a result I plot a pdf that looks like this: The only thing that I would like to do is to plot the values of the points as text labels next to the points. Like what was done before in EXCEL. Can anyone here help me to get labels next to my points? Thanks in advance.

filipforsbergObserver

asked in Transformers

Extract images from a scanned PDF and overlay on

Hello, I’m a beginner to FME and need help with how to exctract the images from a scanned pdf to fit with the OCR text I got from Tesseract. The idea is to create new pdf files from the scanned ones where you can copy the text and so on, and I also want to keep the original layout of the text and images. I have attached two images to illustrate what I mean. One is of the original scanned pdf and the other is my OCR extracted text and where I want to put the images. Also attached is my workspace. Thanks!

vmtngContributor

asked in Transformers

I'm getting an error in an Excel spreadsheet - Removed Feature: Named range - written by XSLXW from a template. Where exactly does it come from?

Hi, I have a workspace that writes a XLSX from a template. The source features come from Smallworld (there's also a very simple Excel spreadsheet that is joined in the process). I can run it in FME Desktop 2018 (32) + Smallworld 4.3 with no problem. But when I run it in FME Desktop 2021 (64) + Smallworld 5.2, the resulting XLSX seems to be corrupted. While starting Excel, I get a message: "We found a problem with some content in... <file name>. Do you want us to try to recover as much as we can? If you trust the source of this workbook, click Yes". After clicking Yes, Excel does its recovery thing, and tells me "Removed Feature: Named range from /xl/workbook.xml part (Workbook)". To rule out an Excel problem, I opened both output files (FME 2018 and FME 2021) in the same computer, and got the errors only in the FME 2021/Smallworld 5 file. I also see these warnings in the FME log when I run it in FME 2021 / Smallworld 5: Excel Reader: Found named range &#39

beetrizContributor

asked in Transformers

Delete attachments from AGOL using the API and httpcaller FME2019

Hello,We are trying to manage changing attachments on a feature layer on ArcGIS Online using FME. We can successfully read, compare, and add attachments using a combination of HTTP Callers and Python Callers. However, we are having difficulties deleting attachments that are no longer relevant. The easy solution would be to delete the entire record but we are trying to avoid that.Has anyone had success at using the deleteAttachments POST request outlined in the ESRI’s api guide.https://developers.arcgis.com/rest/services-reference/enterprise/delete-attachments/Or has anyone found another way of managing attachments?Thanks,

arthyContributor

asked in Transformers

How to Export Revit file to IFC?

Hello,I would like to export all the layers of a revit file to an ifc model.I used the ETL described here. Here are the layers of the input revit fileAnd the obtained layers of the output IFC file.The only layers that I'm getting rigth are:Architectural.DoorsArchitectural.RailingsArchitectural.RoofsArchitectural.StairsARchitectural.WallsThe other layers of the revit input file are missing in the output ifc file while I used the same logic to build them.What did I miss?

stevelawdisParticipant

asked in Transformers

ESRI PDF Attachments Exported as PDF

I’m trying to write a PDF, currently attached to a GIS point feature class, to a PDF file. Preference being that this would be an additional page to another. I currently have a FeatureReader accessing the Attribute Table for the feature class. I have tried using the Adobe PDF GeoSpatial Writer but I am not getting anything but a blank PDF document. Is there a transformer or set of transformers that handles this specific workflow? The Data attribute on the Attachments table contains the original PDF document’s information.Thank you all,

galigisEnthusiast

asked in Transformers

Issue trying to write an ESRI GDB Relationship

Hi All,I’m trying to write an existing ESRI GDB relationship 1:1. I have watched a few of the FME articles material here https://support.safe.com/hc/en-us/articles/25407490028813-Writing-Geodatabase-Relationship-Classes but can’t get it to work. Here is the scenario:I have created the relationship (1:1) manually in ArcPro as the relations can’t be created using FME. The relation is one to one and needs to be done by Title_Number field. I have also created the relevant fields after reading the article above, here is an screenshot of the AttributeCreator: Here is an screenshot of the relationship in ArcGIS:Also here is an screenshot of the FeatureWriter settings to write the relation in the template GDB: And finally the error in FME after trying to write the relation: Attempting to write a non-relationship feature to relationship class 'rel_NPS_CCOD'. Ensure the 'geodb_type' is set to a valid relationship class type Any idea how to make it to work?Thanks

ridleyjContributor

asked in Transformers

Generic feature reader to access a JPEG via URL within an attribute has no network authentication option.

Using generic feature reader to access a JPEG via a URL, that is an attachment for an ArcGIS Portal feature layer and requires authentication: this works well when explicitly stating the URL as the Dataset as the reader has the option to network authenticate in this mode. However, when the URL is supplied within an attribute, the reader has no authentication option and so the self same JPEG as above will fail with the message : 2022-06-29 16:47:51| 0.1| 0.0|ERROR |JPEG reader: `\\AppData\\Local\\Temp\\1\\wbrun_1656380366772_18540\\fmetmp_4\\TempFS_1656478070812_2916\\4' exists but could not be opened. File contents may be invalid, or the file format may not be supported2022-06-29 16:47:51| 0.1| 0.0|ERROR |JPEG reader: Failed to open the dataset '\\AppData\\Local\\Temp\\1\\wbrun_1656380366772_18540\\fmetmp_4\\TempFS_1656478070812_2916\\4'. Please ensure source data is valid and correct reader is selected2022-06-29 16:47:51| 0.1| 0.0|ERROR |A fatal error has occurred. Check t

roelofvosContributor

asked in Transformers

Excel writer bug in FME2024

Hi All,I'm experiencing a bug in the Excel writer in the new FME 2024.0. I've made a script that outputs multiple data categories I need to process in a particular order to ensure my calculations are fed as desired. The bug causes the attribute names to not be written in the first row in Excel; it just starts with the data in the second row. Whenever I open the exact same script in FME 2023.2, the writer does write the field row names, without me changing anything in the writer settings.For now, my solution is to not use FME 2024, but since my customer does use 2024, it's not desirable. Does anyone have any ideas?Here is a preview of Excel. I can't scroll up to the first row, the data is not hidden, and the navigator also won't allow me to go to row 1.

naveenContributor

asked in Transformers

Anchor snapping and overlapping points

Hello All, I hope you all are doing well. I am trying to figure this out - I have to align points on the lines without overlapping with each other. I have used Anchorsnapper(segment snapping..group by line global id). I have passed lines to anchors and points to candidates. The results have some overlapping points (using matcher). To disperse along the line, using sampler and offsetting by 5 ...and still some points are overlapped...so tried to -5 offset the points and then snap to line. I am still ending up with some overlapping points. Is there a better way to achieve this?Any help would be appreciated. Thanks,Naveen

stuarmitagehomeContributor

asked in Transformers

Move values from one column to create column names

Hi, and of course “HELP!” 😁I need to take some values in a column and create column names from them, taking the associated values with them.My starting table looks like this (note this is in Excel, but the table exists within an FME workflow, I am just showing it like this to make it easier to understand… hopefully!!!!!): Asset_ID is my unique identifier. You will see there are either 3 or 4 duplicates of that number.Column B “CHAR_TYPE_CD” has the values I want to turn into new column headings, combined with the existing column headings in C, D, and E.This is ultimately what I want it to look like: Note The values from the original Column B are transposed and combined with the previous column names. There are 4 individual attribute values in the original column B, namely:CM-ELCNT; CM-GRPNG; CM-VOLVL; and CM-VNOriginal column C “EFFDT” now becomes “EFFDT CM-ELCNT”Original column D “CHAR_VAL” now becomes “CHAR_VAL CM-ELCNT”Original column E “SRCH_CHAR_VAL” now becomes “SRCH_CHAR_VAL C

joySupporter

asked in Transformers

Is there an environment variable for the R interpreter?

Hello everyone,I was wondering if there is an environment variable available for the R interpreter.If I look at the following post, there appears to be an environment variable for python, but not for R.It would be nice that the R interpreter would be able to look at a certain folder on the C disk for example and when there is different version of R, then the R interpreter would automatically change it.For now, I manually changed the interpreter, however ideally I would like during an update of R, that the R interpreter would automatically change the R interepreter.Does anyone know whether that is possible or might be possible in the near future?

kattContributor

asked in Transformers

SQL Executor - Oracle Spatial Object with two tables having a geometry

Hello,I am using the SQL Executor to read two tables from oracle using a join.I would like to use Oracle Spatial Object as Format to have the geometry included.This is my sql query:select a.nm, a.fid, b.mlpst, b.featfrom t_csm ajoin t_fl bon a.clss=b.clssBoth table a and b have a geometry (GEOM). When I use SQL Executor - Oracle Spatial Object, how can I know the geometry of which table will be used ? I want it to be the geometry of table b but I don’t how to specify it. The geometries of these two tables are not the same and my next transformer is the neighborfinder so it makes a big different if I use the geometry of table a or table b.Thanks for your help.

asked in Transformers

Create Randomized Points within a Polygon based Attributes values

Hi,I have 100 polygons that state the population within each polygon, I'm essentially trying to break it down 1 stage below where I have that population essentially scattered across the polygon boundary in the form of points to then get a rough estimation of the population in small selections (and not for the entire polygon) I saw a question asked very similar to what I need where I have the population value in a field and I would like to add that as an input into the RandomPointGenerator (however this transformer does not accept inputs (aside from the fixed value you state), and this does not seem to have been changed in the 5 years since raising this question). Someone had mentioned the use of workspace runner, but I am not sure how to incorporate that into what I'm trying to do.

adele_jContributor

asked in Transformers

Coordinate System Gallery Inaccessible through Transformers (2024.0.1.0)

Hi all,When using a FeatureReader, FeatureWriter, or any other transformers, I can’t seem to access the Coordinate System Gallery. However this doesn’t seem to impact readers or writers (when accessed through parameters anyway).Excel ReaderReprojector (note that Source Coordinate System does use the Coordinate System Gallery)I’m currently using FME via Data Interoperability through ArcGIS, is this a limitation of the extension? Or have I missed a setting to use the gallery in all cases?Cheers for any help.

j.m-vismaContributor

asked in Transformers

Is there a better way to use the HTTPCaller for Multipart/ form data?

I am using the HTTPCaller to interact with an API, for that I use the setting Multipart/ Form Data. This is the way another user got the Endpoint to work for them and I just always used it. This works pretty well, the API does what I want, the connection is stable, but there is one problem. Sometimes it takes a lot of time to configure the Multipart-part.For some jobs I need to configure dozens of parameters, this leads to a lot of typing, proofreading, etc. For this particular endpoint I don't just need to give parameters about the object I want to edit (some inspection), but also something like a table definition. The row (row_id) and the value, for each attribute of my dataset. Since this API endpoint doesn't like it when I send in null values as values, I need to run several configurations of the same HTTPCaller one that drops each variation of Null values in the dataset. Now I was wondering if I could somehow build the whole statement about the rows and their values with something

imaric0503Observer

asked in Transformers

Read and write feature one by one

Greetings, I should read and write features one by one, namely in the feature reader I have a condition by which I retrieve data from the database, more precisely the ID. But every time I should first write a feature in the database that gets a new ID, and when reading the conditions for the second time, it should select that new ID, and not immediately select that first ID for me. how to create this?

csaba.szabadkaiObserver

asked in Transformers

Hi!I have a shapefile with a lot of lines with the same geometry, but different data. They are the fibers of an optical cable.How can I shift them parallelly to each other?

jasperwisEnthusiast

asked in Transformers

DWG: writing custom hatches (pat files) on a Linux/Kubernetes FME Flow

Hi,I would like to write custom hatches in a DWG file. But our FME Flow is deployed with Kubernetes.So the OS is Linux.Since the RealDWG writer is only available on Windows, I will need to use the other DWG writer (Acad).Where should I put these .pat files to write these custom hatches successfully?The documentations says:The ACAD format writer will look for custom hatch patterns in custom <filename>.pat files located in folder specified by the ACAD operating system environment variable, or in the related folder for any installed AutoCAD product.On windows, I have tried to create an “ACAD” environmental variable, pointing to a folder where I placed my .pat files. But no result.Secondly, will this be possible on a Kubernetes FME Flow?Thank you in advance Jasper

nicholasContributor

asked in Transformers

FeatureReader fails to recognise Attributes in CSV file

FeatureReader does not recognise attributesHello all, I am having problems with a FeatureReader that does not recognize the attribute columns of a CSV file.The background is, I regularly download the GNAF dataset from Geoscape Geocoded National Address File (G-NAF) | Datasets | data.gov.au - betaThe GNAF arrives as a zip file containing a large number of CSV files. I only need five of them.I have built a Directory and File Pathnames Reader that returns all of the CSV files, which I then filter down to just the five that I want.I am attempting (but failing) to build a FeatureReader that reads the CSV file.I should point out that the CSV file is actually a pipe-separated-value file. The separator is a pipe “|” and the file extension is “.psv” But I have confirmed that a normal CSV reader does successfully read the psv file.Now, the FeatureReader is successfully reading the correct number of features. And FME automatically recognises that two of the columns are LONGITUDE and LATITUDE and

sameerContributor

asked in Transformers

SQLExecutor outputs NULL as value {NULL} - Possible Bug

Current Version: 2024.0.3.0 (20240603 - Build 24220) Since upgrading from 2023 to 2024, some weird behaviours have happened.Some critical workflows have not been outputting the correct information on our public facing website.In this case, I’m referring to the Building Control (BC) header on that page after you type in an address.Instead of stating that there was a BC information against a property, it would say no information found.Whilst investigating I found the following: The result of SQL Query was outputting NULL values as a string value called {NULL}.Never seen that before. Therefore, the Conditional Value was returning the wrong information. i.e. If xxx IS NULL and xyz HAS A VALUE….Subsequently I had to add a StringReplacer to fix this anomaly for now. SQL StatementWITH bc_html_aggAS(SELECT blpu_uprn, ARRAY_AGG(bc_html) AS bc_html FROM myproperty.buildc_html_temp GROUP BY blpu_uprn ORDER BY blpu_uprn)Select Distinct(bc_html_agg.blpu_uprn), b.address_string, bc_html_ag

1
...
5
6
7
8
9
10
11
...
502

Page 8 / 502

Badge winners

librads284has earned the badge Student (Grey)
librads284has earned the badge English Speaker
judithhas earned the badge Student (Grey)
lgriehas earned the badge Welcome Back
popcornhas earned the badge Welcome Back

Show all badges

29,682: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK